I initially data deduped an entire volume and then later added two directories to the exclude list (because of some incompatibility between deduplication and indexing. I need to be able to index these two directories). I cannot figure out how to get these two folders to unoptimize.

I have fun both the scrubbing and garbage collection jobs with the -full parameter, but these two folders are still deduped. Is there a way I can tell the service to unoptimize a single directory?

Thanks for your help.

I'm searching on this topic and will update the reply soon. 

Hi,

Here is the result. Please test this cmdlet: 

Expand-DedupFile

http://technet.microsoft.com/en-us/library/dn456527.aspx

From deduplication team, the cmdlet apparently does not support wildcards in the -Path parameter, but you can do standard PowerShell pipelining to automate for multiple files.

dir g:\folder1 | expand-dedupfile

Note that when executing on a set of files, there will be an error reported for each file that is not already in the deduplicated state.  The cmdlet does best effort.

If there is anything further we can help please just let us know.

Can't believe I missed that cmdlet. Thanks so much!

Dear Shaon Shan,

I really needed this solution for un-dedup some folders. On one of our servers, I have luck till now, but on another I get a really strange error, when I try to expand a file. (exactly a whole directory, but one file is the most important) I tried all the above mentioned, and still get a "HRESULT 0x80070570" error. Searching for this I found it may be some disk or volume defect. So I tried all the solution mentioned on those articles, but still getting the error. So none the chkdsk (with nearly all the switches) from CMD and Reapir-Volume from PS and a third party tool found absolutely no errors on that disk. All the S.M.A.R.T flags are ok. I've checked the folders' security settings and the logged on domain user, the local admin, the domain admin even the enterprise admin have full control on all files in this directory. Finally I added the "Everyone" group full control but no change.

Can you please give me some advise, how to manage this error?

Here is the PS error message (some parts are in Hungarian, because I use a Hungarian Windows)

anyway I try to access the .vmdk file, I marked it with BOLD.

PS C:\Users\****> dir 'D:\Virtual Machines\WinXP' | Expand-DedupFile
Expand-DedupFile : MSFT_DedupVolume.Path='D:\Virtual Machines\WinXP\caches' - H
RESULT 0x80070005, A hozzfrs megtagadva.
At line:1 char:35
+ dir 'D:\Virtual Machines\WinXP' | Expand-DedupFile
+                                   ~~~~~~~~~~~~~~~~
    + CategoryInfo          : PermissionDenied: (MSFT_DedupVolume:ROOT/Microso
   ft/...SFT_DedupVolume) [Expand-DedupFile], CimException
    + FullyQualifiedErrorId : HRESULT 0x80070005,Expand-DedupFile
 
Expand-DedupFile : MSFT_DedupVolume.Path='D:\Virtual Machines\WinXP\Windows XP
Professional.vmx' - HRESULT 0x80070057, A paramter nem megfelel.
At line:1 char:35
+ dir 'D:\Virtual Machines\WinXP' | Expand-DedupFile
+                                   ~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidArgument: (MSFT_DedupVolume:ROOT/Microsof
   t/...SFT_DedupVolume) [Expand-DedupFile], CimException
    + FullyQualifiedErrorId : HRESULT 0x80070057,Expand-DedupFile
 
Expand-DedupFile : MSFT_DedupVolume.Path='D:\Virtual Machines\WinXP\Windows XP
Professional.nvram' - HRESULT 0x80070057, A paramter nem megfelel.
At line:1 char:35
+ dir 'D:\Virtual Machines\WinXP' | Expand-DedupFile
+                                   ~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidArgument: (MSFT_DedupVolume:ROOT/Microsof
   t/...SFT_DedupVolume) [Expand-DedupFile], CimException
    + FullyQualifiedErrorId : HRESULT 0x80070057,Expand-DedupFile
 
Expand-DedupFile : MSFT_DedupVolume.Path='D:\Virtual Machines\WinXP\Windows XP
Professional.vmsd' - HRESULT 0x80070057, A paramter nem megfelel.
At line:1 char:35
+ dir 'D:\Virtual Machines\WinXP' | Expand-DedupFile
+                                   ~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidArgument: (MSFT_DedupVolume:ROOT/Microsof
   t/...SFT_DedupVolume) [Expand-DedupFile], CimException
    + FullyQualifiedErrorId : HRESULT 0x80070057,Expand-DedupFile
 
Expand-DedupFile : MSFT_DedupVolume.Path='D:\Virtual Machines\WinXP\564d0cc5-ca
8b-a753-3cd1-8f98dca9efc4.vmem' - HRESULT 0x80070057, A paramter nem megfelel
.
At line:1 char:35
+ dir 'D:\Virtual Machines\WinXP' | Expand-DedupFile
+                                   ~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidArgument: (MSFT_DedupVolume:ROOT/Microsof
   t/...SFT_DedupVolume) [Expand-DedupFile], CimException
    + FullyQualifiedErrorId : HRESULT 0x80070057,Expand-DedupFile
 
Expand-DedupFile : MSFT_DedupVolume.Path='D:\Virtual Machines\WinXP\564d0cc5-ca
8b-a753-3cd1-8f98dca9efc4.vmem.lck' - HRESULT 0x80070005, A hozzfrs megtagad
va.
At line:1 char:35
+ dir 'D:\Virtual Machines\WinXP' | Expand-DedupFile
+                                   ~~~~~~~~~~~~~~~~
    + CategoryInfo          : PermissionDenied: (MSFT_DedupVolume:ROOT/Microso
   ft/...SFT_DedupVolume) [Expand-DedupFile], CimException
    + FullyQualifiedErrorId : HRESULT 0x80070005,Expand-DedupFile
 
Expand-DedupFile : MSFT_DedupVolume.Path='D:\Virtual Machines\WinXP\vmmcores.gz
' - HRESULT 0x80070057, A paramter nem megfelel.
At line:1 char:35
+ dir 'D:\Virtual Machines\WinXP' | Expand-DedupFile
+                                   ~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidArgument: (MSFT_DedupVolume:ROOT/Microsof
   t/...SFT_DedupVolume) [Expand-DedupFile], CimException
    + FullyQualifiedErrorId : HRESULT 0x80070057,Expand-DedupFile
 
Expand-DedupFile : MSFT_DedupVolume.Path='D:\Virtual Machines\WinXP\Windows XP
Professional.vmxf' - HRESULT 0x80070057, A paramter nem megfelel.
At line:1 char:35
+ dir 'D:\Virtual Machines\WinXP' | Expand-DedupFile
+                                   ~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidArgument: (MSFT_DedupVolume:ROOT/Microsof
   t/...SFT_DedupVolume) [Expand-DedupFile], CimException
    + FullyQualifiedErrorId : HRESULT 0x80070057,Expand-DedupFile
 
Expand-DedupFile : MSFT_DedupVolume.Path='D:\Virtual Machines\WinXP\vmware.log'
 - HRESULT 0x80070057, A paramter nem megfelel.
At line:1 char:35
+ dir 'D:\Virtual Machines\WinXP' | Expand-DedupFile
+                                   ~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidArgument: (MSFT_DedupVolume:ROOT/Microsof
   t/...SFT_DedupVolume) [Expand-DedupFile], CimException
    + FullyQualifiedErrorId : HRESULT 0x80070057,Expand-DedupFile
 
Expand-DedupFile : MSFT_DedupVolume.Path='D:\Virtual Machines\WinXP\vmware-0.lo
g' - HRESULT 0x80070057, A paramter nem megfelel.
At line:1 char:35
+ dir 'D:\Virtual Machines\WinXP' | Expand-DedupFile
+                                   ~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidArgument: (MSFT_DedupVolume:ROOT/Microsof
   t/...SFT_DedupVolume) [Expand-DedupFile], CimException
    + FullyQualifiedErrorId : HRESULT 0x80070057,Expand-DedupFile
 
Expand-DedupFile : MSFT_DedupVolume.Path='D:\Virtual Machines\WinXP\Windows XP
Professional.vmdk' - HRESULT 0x80070570, A fjl vagy a knyvtr srlt vagy nem
 olvashat.
At line:1 char:35
+ dir 'D:\Virtual Machines\WinXP' | Expand-DedupFile
+                                   ~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (MSFT_DedupVolume:ROOT/Microsoft/.
   ..SFT_DedupVolume) [Expand-DedupFile], CimException
    + FullyQualifiedErrorId : HRESULT 0x80070570,Expand-DedupFile
 

PS C:\Users\****>

Thanks for your help in advance.

I know this one is a bit old, but I thought I'd post a solution anyway.

You need to limit the output to files only because you'll get access denied when trying to dedupe a folder.

Get-ChildItem PATH -Recurse -Attributes !D | Expand-DedupFile

!D = not folders.

You will get a lot of errors as it recurses through files that aren't deduped but it will keep rolling till everything has completed.

We're doing this as we found with Commvault Simpana 10 that we cannot archive files that have been deduped by MS.

• Proposed as answer by J2E Friday, February 06, 2015 9:03 PM

I'll give it a try.