Common Windows version installation Winserver features feature to Dedup function as a display point

Install the Windows feature role

1. Select the installation source

The deduplication feature does not exist on Windows 8.1 systems, and it is necessary to extract the relevant files from the corresponding server version, Windows Server R2.

2. Extract Files

There are a lot of directories and files in the installation source, we only need three directories:
\windows\servicing\packages, package file;
\windows\winsxs: assembly file. Other subdirectories are not required except for the subdirectories directory;
\windows\winsxs\manifests: Manifest file.

The subdirectories and files in these three directories are copied to a directory. Assume that all files and directories are copied to s:\4\Packages.

3. Incremental compression

Delta Compression: Delta Compression
Why are you talking about incremental compression? Because many of the files copied to the s:\4\Packages are incrementally compressed, if you open with Notepad, you can see only the beginning of the DCN PA30 and other content, the rest are garbled.
Besides, the document identification.
DC, should be the abbreviation of the increment compression, N denotes some kind of compression; In addition to DCN, there is DCD, DCM. The PA30 should be an incrementally compressed version, indicating that this compression is using Msdelta.dll as the engine, the decompression also uses Msdelta.dll, and a version PA19 that uses Mspatchc.dll for compression, using Mspatcha.dll Decompression (decompression is also called application, apply).

4, pre-installation preparation

Disables the Hash test.
Because the default assembly file should be uncompressed, the files that we extracted from the installation CD are compressed, and when the package is installed, the system does a Hash test of the assembly file and certainly cannot pass the test. To do this, you must turn off the function of the Hash test. You need to add an attribute Disablefilehashverification in the registry, with a type of DWORD, a value of 1, and a location in hklm\software\microsoft\windows\currentversion\ Sidebyside\configuration.

5. Installation package

Commands used by the installation package: Dism
Dism/online/add-package/packagepath: Path to package file
Data deduplication is a feature in the file Services role that relies on some of the underlying functionality of file services, the Microsoft-windows-fileserver-package package.
dism/online/add-package/packagepath:microsoft-windows-fileserver-package~31bf3856ad364e35~amd64~~ 6.3.9600.16384.mum
dism/online/add-package/packagepath:microsoft-windows-fileserver-package~31bf3856ad364e35~amd64~zh-cn~ 6.3.9600.16384.mum
Dism/online/add-package/packagepath:microsoft-windows-dedup-package~31bf3856ad364e35~amd64~~6.3.9600.16384.mum
dism/online/add-package/packagepath:microsoft-windows-dedup-package~31bf3856ad364e35~amd64~zh-cn~ 6.3.9600.16384.mum

6. Preparation before enabling function

This step is critical because almost all of the errors are related to the settings here. This step can be skipped if the extracted file is the original file that was not compressed.
As mentioned earlier, the data deduplication feature involves 10 assemblies, three of which are already installed.
During the installation of the package, the contents of the registry should be automatically written, but not necessarily. If the feature cannot be enabled, the relevant registry values can be set in reference to the schedule. The registry location is hklm\components\deriveddata\components and the file is \windows\system32\config\components.
It is important to note that, typically, hklm\components does not load and needs to be loaded for subsequent operations.

7. Enable function

Enable-windowsoptionalfeature-online-featurename file-services
Enable-windowsoptionalfeature-online-featurename Corefileserver
Enable-windowsoptionalfeature-online-featurename Dedup-core

8. Verification

If the installation completes successfully, the following command can be run.
To view the commands for data deduplication: Get-command dedup
Enable data deduplication on disk: Enable-dedupvolume T:
Scan the disk to calculate the status after Deduplication: Update-dedupstatus T:
Returns the status after data deduplication: Get-dedupstatus

What we want to describe is how to install features that are not available in the current version of Windows.

We know that the same version of Windows, there are different version types (edition), such as the Standard Edition, Professional Edition, Enterprise Edition, and the corresponding server version type (exactly how many types of versions, you can see \windows\servicing\ Files under editions). If we install the Enterprise Edition and find that we want to use some features of the pro version, such as Media Center, is it a reload system? After reading this article, you may have one more choice. This article takes Windows 8.1 as an example to describe how to install the data deduplication feature of Windows Server R2.

First, the composition of the system

Windows is the operating system, so what does this whole system consist of? From the point of view of installing functional roles, you can broadly divide it into a few levels: systems, roles, features, packages, assemblies, and manifests. That

The system is composed of several roles;

A character consists of one or more functions;

A function consists of one or more packages, and a package may contain multiple functions;

A package consists of one or more assemblies and manifests, and one assembly corresponds to a manifest (that is, not rigorous, but does not affect the results).

This idea should be from the beginning of Windows Vista, but in different versions, the concept will change, the specific operation of the command is not the same.

The system, the role, the function is the logical concept, and the function and the role does not have the essential difference, the real physical existence is the package, the assembly and the manifest.

Package files, \windows\servicing\packages

assembly file, \windows\winsxs

Manifest file, \windows\winsxs\manifests

Here is a brief introduction to each.

1, the system is composed of a number of roles

This point is self-evident.

2. A role consists of one or more functions

Corresponds to the Select Role interface on the server version.

The Hyper-V role, for example, consists of a number of features:

Get-windowsoptionalfeature-online-featurename *hyper-v* | Select FeatureName

Microsoft-hyper-v

Microsoft-hyper-v-offline

Microsoft-hyper-v-online

Rsat-hyper-v-tools-feature

Microsoft-hyper-v-management-clients

Microsoft-hyper-v-management-powershell

The preceding command indicates that the role layer is purely logical, and on a non-server version of the system, there is no interface to select the role.

There is a dependency between features. The following command lets you know that the Dedup-core feature relies on the File-services feature.

Get-windowsoptionalfeature-online-featurename Dedup-core

Feature Name:dedup-core

Display Name: Data deduplication

Description: Reduce the amount of physical storage required for data by applying block-level deduplication and compression.

Restart required:possible

State:enabled

Custom properties:servercomponent\description: Data deduplication saves disk space by storing a single copy of the same data on the volume.

Servercomponent\displayname: Data deduplication Duplication

servercomponent\id:436

Servercomponent\parent:file-services

Servercomponent\type:roleservice

Servercomponent\uniquename:fs-data-deduplication

Servercomponent\nonancestordependencies\servercomponent\uniquename:fs-fileserver

Servercomponent\deploys\update\name:dedup-core

Servercomponent\systemservices\systemservice\defaultmonitoring:false

Servercomponent\systemservices\systemservice\name:ddpsvc

3, a function consists of one or more packages, a package may also contain multiple functions

Data deduplication (Dedup-core) is a feature in the file and storage services role that consists of two feature packs and corresponding language packs:

Microsoft-windows-dedup-chunklibrary-package~31bf3856ad364e35~amd64~~6.3.9600.16384.mum

Microsoft-windows-dedup-chunklibrary-package~31bf3856ad364e35~amd64~zh-cn~6.3.9600.16384.mum

Microsoft-windows-dedup-package~31bf3856ad364e35~amd64~~6.3.9600.16384.mum

Microsoft-windows-dedup-package~31bf3856ad364e35~amd64~zh-cn~6.3.9600.16384.mum

The file name is too long, it is difficult to look at this article (or log file), a little while the eye spent.

Each package file also has a corresponding certificate file with the extension. Cat. Because the package file is a plain text file with a certificate file, you can guarantee that the package file cannot be modified under the graphical interface, and it can be modified under the non-graphical interface (i.e. WinRE environment).

Why do you choose to use this function for demonstration? There are a number of reasons for this, one is practical, after enabling deduplication, you can save a lot of disk space. With the virtual machine, we will find that the large disk is not enough, the Deduplication feature is enabled, the effect of saving disk space is very obvious, the second is that the function is representative, the third is relatively simple.

Now let's talk about its representativeness, the data deduplication feature has two packages:

These two packages are two types, the first package microsoft-windows-dedup-chunklibrary-package, the system is installed automatically, on the client and server versions have The second package is microsoft-windows-dedup-package only on the server version. In addition, the incremental compression function of the component has been increased since Windows8.1.

4. A package consists of one or more assemblies and manifests, and one assembly corresponds to a manifest

Assemblies are also known as components.

The Microsoft-windows-dedup-chunklibrary-package package corresponds to three assemblies:

amd64_microsoft-windows-dedup-chunklibrary_31bf3856ad364e35_6.3.9600.16384_none_b739226fcac7b86b

amd64_microsoft-windows-dedup-common_31bf3856ad364e35_6.3.9600.16384_none_24924b7b049f1064

Amd64_microsoft-windows-dedup-common.resources_31bf3856ad364e35_6.3.9600.16384_zh-cn_735de6f4f3c9bf01

The Microsoft-windows-dedup-package package corresponds to seven assemblies:

Amd64_microsoft-windows-dedup-service_31bf3856ad364e35_6.3.9600.16384_none_bfb8b8d13d6b64ec

amd64_microsoft-windows-dedup-pipeline_31bf3856ad364e35_6.3.9600.16384_none_4a1a2e1b94c17293

amd64_microsoft-windows-dedup-backup_31bf3856ad364e35_6.3.9600.16384_none_082618006d52d13d

Amd64_microsoft-windows-dedup-vsswriter_31bf3856ad364e35_6.3.9600.16384_none_6a34e1622afa6abc

Amd64_microsoft-windows-d. p-service.resources_31bf3856ad364e35_6.3.9600.16384_zh-cn_ef122ebc772ca755

Amd64_microsoft-windows-dedup-filter_31bf3856ad364e35_6.3.9600.16384_none_f8cff29f2baf02c3

amd64_microsoft-windows-fsdm-hostprocess_31bf3856ad364e35_6.3.9600.16384_none_1dcf65c39dce3a7c

Each assembly corresponds to a directory on disk, there are several files in the directory, there may be subdirectories, when the package is installed, it is copied from the installation source to the \windows\winsxs directory, and each assembly also has a manifest file with the same name as the directory name, the extension manifest, and the copy to \ The Windows\winsxs\manifests directory. When the feature is enabled, the files that correspond to the components are copied to the system directory, and services are created, if necessary. Starting with Vista, the management system is in components and is no longer based on the INF.

Distribution manifest file for two packages:

Amd64_microsoft-windows-d. Klibrary-deployment_31bf3856ad364e35_6.3.9600.16384_none_586b9e5d057f82e3.manifest

Amd64_microsoft-windows-dedup-deployment_31bf3856ad364e35_6.3.9600.16384_none_417674c644d0189e.manifest

Second, extract files and incremental compression

1. Select the installation source

The deduplication feature does not exist on Windows 8.1 systems, and it is necessary to extract the relevant files from the corresponding server version, Windows Server R2.

Client and server table

Client	Server	Major Version number
Windows 8.1	Windows R2	6.3
Windows 8	Windows 2012	6.2
Windows 7	Windows R2	6.1
Windows Vista	Windows 2008	6.0

Find the Install.wim file in the Soures directory on the Windows Server R2 CD, open with the new version of the compression software, you will see 1, 2, 3, 4 such directories, respectively, corresponding to the Standard Edition core, Standard Edition, data center version core, data Center Edition. The data Center Edition has the most functionality, but there are no differences between the four versions for the deduplication feature we demonstrate. There is no official version of the disc also does not matter, fully can download the trial version from the Microsoft site, in addition, do not use the new version of the CD, preferably with the most original version, because the new version will have more files are compressed, the operation caused unnecessary trouble.

If you are extracting files from a functioning system, you should use a system that has related features enabled and that has not been patched.

2. Extract Files

There are a lot of directories and files in the installation source, we only need three directories:

\windows\servicing\packages, package file;

\windows\winsxs: assembly file. Other subdirectories are not required except for the subdirectories directory;

\windows\winsxs\manifests: Manifest file.

The subdirectories and files in these three directories are copied to a directory. Because there are tens of thousands of files and directories, the process of copying is long and boring. Previously in the DOS era, there was a command append can put the directory together, the equivalent of working in a directory, and now it is not; In addition, the command DISM that installs the package can only specify one installation source, so it is more tedious to replicate.

Assume that all files and directories are copied to s:\4\Packages.

3. Incremental compression

Delta Compression: Delta Compression

Remote Differential compression: Remotes differential Compression

Singleton storage: Single Instance Store

Deduplication: Data deduplication

Although these concepts all refer to compression, the core idea is not compression, but the single-instance storage, that is, the same part is saved only one copy, but some at the file level, some at the disk level.

Why are you talking about incremental compression? Because many of the files copied to the s:\4\Packages are incrementally compressed, if you open with Notepad, you can see only the beginning of the DCN PA30 and other content, the rest are garbled.

Incremental compression is based on the difference of two files, with one version (usually the latest version) as the benchmark, and the temporarily unwanted version (usually the older version) preserves the difference of the relative benchmark file.

The difference between versions of the same file is usually small, and some are even identical, so incremental compression can significantly save disk space.

There are two cases of incremental compression: First, the feature has not been enabled, temporary files are saved as compressed (but not immediately compressed), once a feature is enabled, the files associated with it will be automatically extracted, and the new version of the installation of a new release of the file is uncompressed. The superseded version is saved as an incremental compression, and if a new version is uninstalled, the old version of the file is automatically decompressed.

Execution of a task plan forces compression.

Schtasks.exe/run/tn "\microsoft\windows\servicing\startcomponentcleanup"

Besides, the document identification.

DC, should be the abbreviation of the increment compression, n denotes some kind of compression; In addition to DCN, there is DCD, DCM. The PA30 should be an incrementally compressed version, indicating that the compression is using Msdelta.dll as the engine, the decompression also uses Msdelta.dll, and a version PA19 that uses Mspatchc.dll for compression, using Mspatcha.dll is decompressed (decompression is also called application, apply).

compression type	registry value
	DCD	cf:10;f! Xxx:3
No reference compression	DCN	cf:200 f! xxx:21
	DC M	cf:c
uncompressed	,	cf:0;f! Xxx:1

Because there is too little information on this, the above content is more speculative and less full-faith. For more information on the contents of the file ID, refer to the Msdelta.h file in the Windows SDK.

Three, installation package

1, pre-installation preparation

Disables the Hash test.

Because the default assembly file should be uncompressed, the files that we extracted from the installation CD are compressed, and when the package is installed, the system does a hash test of the assembly file and certainly cannot pass the test. To do this, you must turn off the function of the Hash test. You need to add an attribute Disablefilehashverification in the registry, with a type of DWORD, a value of 1, and a location in hklm\software\microsoft\windows\currentversion\ Sidebyside\configuration.

2. Installation package

Commands used by the installation package: Dism

Dism/online/add-package/packagepath: Path to package file

As mentioned earlier, data deduplication is a feature in the file Services role that also relies on some of the underlying functionality of file services, the Microsoft-windows-fileserver-package package.

dism/online/add-package/packagepath:microsoft-windows-fileserver-package~31bf3856ad364e35~amd64~~ 6.3.9600.16384.mum

dism/online/add-package/packagepath:microsoft-windows-fileserver-package~31bf3856ad364e35~amd64~zh-cn~ 6.3.9600.16384.mum

Dism/online/add-package/packagepath:microsoft-windows-dedup-package~31bf3856ad364e35~amd64~~6.3.9600.16384.mum

dism/online/add-package/packagepath:microsoft-windows-dedup-package~31bf3856ad364e35~amd64~zh-cn~ 6.3.9600.16384.mum

3. Preparation before enabling function

This step is critical because almost all of the errors are related to the settings here. This step can be skipped if the extracted file is the original file that was not compressed.

As mentioned earlier, the data deduplication feature involves 10 assemblies, three of which are already installed.

During the installation of the package, the contents of the registry should be automatically written, however, the installation of several times, only one or two times is correct, most of them are unsuccessful, the specific reason is unknown. If the settings in the registry are incorrect, it cannot be decompressed properly and the feature cannot be enabled.

If the feature cannot be enabled, the relevant registry values can be set in reference to the schedule. The registry location is hklm\components\deriveddata\components and the file is \windows\system32\config\components.

It is important to note that, typically, hklm\components does not load and needs to be loaded for subsequent operations.

4. Enable function

Enable-windowsoptionalfeature-online-featurename file-services

Enable-windowsoptionalfeature-online-featurename Corefileserver

Enable-windowsoptionalfeature-online-featurename Dedup-core

The previous two commands indicate that a package (Fileserver) contains two functions, followed by a command stating that two packages form a function.

5. Verification

If the installation completes successfully, the following command can be run.

To view the commands for data deduplication: Get-command *dedup*

Enable data deduplication for disks: Enable-dedupvolumet:

Scan disk, calculate the status after Deduplication: Update-dedupstatust:

Returns the status after data deduplication: Get-dedupstatus

This may be the slowest command in the system, and will not see the effect immediately after execution, and will generally wait until two days after the effect.

Four, the wrong row

Common errors are as follows:

1. Unable to read configuration registry key

Enable-windowsoptionalfeature: Could not read configuration registry key.

This is because Fileserver is not properly installed and enabled, see the previous section.

2. The component's file does not match the validation information in the component manifest

This is because the hash test is not disabled, see the previous section.

3, 0x800f0922

Enable-windowsoptionalfeature:enable-windowsoptionalfeature failed. Error code = 0x800f0922

This is because the value of the associated delta compression in the registry is not set correctly when the Deduplication feature is enabled, see the previous section.

However, it is important to note that if the Deduplication feature has been enabled, it is possible that some of the files have been successfully decompressed, although they have not been successful. At this point, the extracted files can no longer be set to 21, and if set to 21, it will also need to extract, there must be an error.

4, 0x8056530b, 0x80565306

Enable-dedupvolume:msft_dedupvolume.volume= ' C: '-HRESULT 0x8056530b, the specified volume type is not supported. Fixed, write-capable NTFS data volumes and CSV supported by NTFS data volumes support data deduplication.

This is due to the inability to de-duplicate the system volume, network path.

5, 0x800f0830

The specified image is no longer available and may be corrupted.

Please discard the modified image. and start again.

This error is really small, find the registry hklm\software\microsoft\windows\currentversion\componentbased servicing, delete the attribute unserviceable, or change to 0, But Microsoft actually let us give up, do not know why.

In addition, there are a few mistakes that need to be mentioned, but limited to space, only a few hints. If you do not understand, it is not met, directly ignored.

1, cannot find the reference assembly

Missing hklm\components\deriveddata\components\identity

2, the referenced program is not installed on the system

Missing v!xxx in Hklm\components\deriveddata\versionedindex\xxx (winblue_rxxx) \componentfamilies\componentsfamily

Missing hklm\components\deriveddata\components\identity

3. Component storage is corrupted

Missing assembly or manifest file

Missing Hklm\components\deriveddata\versionedindex\xxx (winblue_rxxx) \componentfamilies\componentsfamily

4. One or more transactions do not exist

Missing hklm\software\microsoft\windows\currentversion\sidebyside\winners\winners

Errors are not exhaustive, and ultimately you need to look at the logs yourself. There are two main:

1, \windows\logs\cbs\cbs.log

The content of this file is very rich, but it may not be easy to understand at the beginning, you can refer to a Microsoft article "Optional Component installation log diagnostics."

Although the DISM command prompts an error to look at the DISM log file, \windows\logs\dism\dism.log. But this file in the graphical interface is almost useless, can not see, only in the WinRE environment only need to see this file.

2, \windows\inf\setupapi.dev.log

When it comes to installing a driver that prompts you not to complete the update, be sure to look at this file.

Finally to say, see this article, Microsoft will not be happy?

Schedule: Registry values for data Deduplication components

amd64_microsoft-windows-dedup-common_31bf3856ad364e35_6.3.9600.16384_none_24924b7b049f1064

CF = 200

f!ddp_ps.dll_549a992a3c8616e4= 21

F!ddputils.dll = 21

F!ddptrace.dll = 21

F!ddp.mof = 21

Amd64_microsoft-windows-dedup-common.resources_31bf3856ad364e35_6.3.9600.16384_zh-cn_735de6f4f3c9bf01

CF = 200

F!DDP.MFL = 1

F!ddputils.dll.mui = 21

Amd64_microsoft-windows-dedup-vsswriter_31bf3856ad364e35_6.3.9600.16384_none_6a34e1622afa6abc

CF = 200

F!ddpvssvc.dll = 21

Amd64_microsoft-windows-dedup-service_31bf3856ad364e35_6.3.9600.16384_none_bfb8b8d13d6b64ec

F!dedupfilemetadata.cdxml= 1

F!ddpsvc.dll = 21

F!DEDUPLICATION.PSD1 = 1

F!ddpeval.exe = 21

F!dedupjob.cdxml = 21

F!ddpwmi.dll = 21

F!ddpcli.exe = 21

F!dedupmetadata.cdxml = 1

f!deduplication.types.ps1xm_9ba49f296646713d= 21

F!dedupstatus.cdxml = 1

F!dedupschedule.cdxml = 21

F!dedupvolume.cdxml = 21

f!deduplication.format.ps1x_74de558af5a08661= 21

f!deduplicationprovider.mof= 21

CF = 200

amd64_microsoft-windows-dedup-pipeline_31bf3856ad364e35_6.3.9600.16384_none_4a1a2e1b94c17293

CF = 200

F!ddppipeline.dll = 21

F!ddpscan.dll = 21

F!ddpstore.dll = 21

amd64_microsoft-windows-dedup-backup_31bf3856ad364e35_6.3.9600.16384_none_082618006d52d13d

CF = 200

F!ddpbackup.dll = 21

Amd64_microsoft-windows-d. p-service.resources_31bf3856ad364e35_6.3.9600.16384_zh-cn_ef122ebc772ca755

CF = 200

F!ddpsvc.dll.mui = 21

f!deduplicationprovider.mfl= 21

F!ddpwmi.dll.mui = 21

Amd64_microsoft-windows-dedup-filter_31bf3856ad364e35_6.3.9600.16384_none_f8cff29f2baf02c3

CF = 200

F!dedup.sys = 21

amd64_microsoft-windows-dedup-chunklibrary_31bf3856ad364e35_6.3.9600.16384_none_b739226fcac7b86b

CF = 200

F!ddpchunk.dll = 21

amd64_microsoft-windows-fsdm-hostprocess_31bf3856ad364e35_6.3.9600.16384_none_1dcf65c39dce3a7c

CF = 200

F!fsdmhost.exe = 21

Note: This is the setting value that is based on extracting files from the disc.

Common Windows version installation Winserver features feature to Dedup function as a display point