Azure Storage Management Tools--azcopy

In the Azure Public cloud service, the storage service is a feature that users are very dependent on and very central to, and the previous blog post also mentions some of the content related to azure storage, all from a few practical scenarios, such as SQL Backup to BLOB and restore.

Cheese, who used azure storage services, knows that Azure is primarily divided into storage accounts, containers, and file services (which may not be available in the country), and finer granularity includes three types of storage, blob, table, and queue. Blob should be the most widely used, I understand it should be a typical object class storage; the latter is used to store unstructured data. I personally feel a narrower use. For the domestic version of Azure per subscription should be able to support up to 50 storage accounts, each storage account the sum of the various types of data size total should be 500GB if you remember correctly, then obviously Azure can provide petabytes of data volume management capabilities, think still enough ...

650) this.width=650; "title=" Storage-concepts.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M01/58/CC/ Wkiol1s9e4ogl6xbaacmuemjsgi462.jpg "alt=" Wkiol1s9e4ogl6xbaacmuemjsgi462.jpg "/>

Blob blob and page blob inside, a single block blob maximum capacity of 200GB, for some pictures, audio, video and other file types, page blob for some of the write type of file, most typical is the virtual machine VHD file. Therefore, the Azure VM defaults to a page blob to hold the VHD file, with a single capacity of up to 1TB, which is why we only have 1TB to attach the disk to the VM on Azure.

###################################################################

To manage and use data on Azure storage, Microsoft offers several out-of-the-box management tools to enable users to upload downloads locally and in the cloud, in addition to interface calls, Azcopy is one of the options.

Azcopy can download the offline installation package via the official website, such as:

650) this.width=650; "title=" 2015-01-12_21-56-52.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M01/58/ Cc/wkiol1s9dm3ztvbzaatjnhevvfk586.jpg "alt=" Wkiol1s9dm3ztvbzaatjnhevvfk586.jpg "/>

Or you can install Azure PowerShell via Web installer, and the azcopy will be installed with the following path:

650) this.width=650; "title=" 2015-01-12_21-57-19.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M01/58/ Cf/wkiom1s9dzqqbs5qaasxrzulhr4014.jpg "alt=" Wkiom1s9dzqqbs5qaasxrzulhr4014.jpg "/>

After you open azcopy (Microsoft Azure Storage tools), you can use the/? To see the use of help and some simple examples:

650) this.width=650; "title=" 2015-01-12_21-57-37.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M02/58/ Cc/wkiol1s9dm3z0uhraayrsiwxusu023.jpg "alt=" Wkiol1s9dm3z0uhraayrsiwxusu023.jpg "/>

###################################################################

Here are a few simple and frequently used demos in my environment, first I prepared three files under the local D:\test, the suffix is different, such as:

650) this.width=650; "title=" 2015-01-19_14-48-34.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M02/58/ Cf/wkiom1s9dzusj2rjaak_7oqt6dc988.jpg "alt=" Wkiom1s9dzusj2rjaak_7oqt6dc988.jpg "/>

In addition, I have prepared a storage account called LABSTORAGE01 under my Azure subscription, which will use two containers (container), Labcontainer01 and 02, respectively, such as:

650) this.width=650; "title=" 2015-01-19_14-49-19.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M00/58/ Cc/wkiol1s9dm7gbz69aakub9v4sry750.jpg "alt=" Wkiol1s9dm7gbz69aakub9v4sry750.jpg "/>

Azcopy syntax is very well understood, basically is around the source and Destination,key these key fields to do, in the following example, I copy the local d:\test under the Labcontainer01 container,/s to specify the recursive mode, That is, all the files under the test folder are uploaded:

650) this.width=650; "title=" 2015-01-19_15-06-35.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M00/58/ Cf/wkiom1s9dzuzfcwsaakmhjrusy4625.jpg "alt=" Wkiom1s9dzuzfcwsaakmhjrusy4625.jpg "/>

When you're done, you can see it on the Azure portal, such as:

650) this.width=650; "title=" 2015-01-19_15-08-26.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M01/58/ Cc/wkiol1s9dm6cb8aqaajp3qd7g70190.jpg "alt=" Wkiol1s9dm6cb8aqaajp3qd7g70190.jpg "/>

Depending on the type of upload file, you can specify the blob type as a block or a page, as shown in:

650) this.width=650; "title=" 2015-01-19_16-47-21.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M01/58/ Cf/wkiom1s9dzuxq2praakml9n7mj0935.jpg "alt=" Wkiom1s9dzuxq2praakml9n7mj0935.jpg "/>

The uploaded VHD file properties are displayed as page blobs, such as:

650) this.width=650; "title=" 2015-01-19_16-49-05.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M02/58/ Cc/wkiol1s9dm7r68q2aajliiubja4085.jpg "alt=" Wkiol1s9dm7r68q2aajliiubja4085.jpg "/>

Here I will prepare another storage account LABSTORAGE02, and create a new container labcontainer03 under this account:

650) this.width=650; "title=" 2015-01-19_20-28-43.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M02/58/ Cf/wkiom1s9dzzwd-ccaaijecmhkys768.jpg "alt=" Wkiom1s9dzzwd-ccaaijecmhkys768.jpg "/>

With azcopy, you can transfer data in different storage accounts, such as:

650) this.width=650; "title=" 2015-01-19_20-33-22.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M00/58/ Cc/wkiol1s9dm-wwtypaanjgjeqwmu255.jpg "alt=" Wkiol1s9dm-wwtypaanjgjeqwmu255.jpg "/>

Copy the VHD file in the labstorage01 under Labcontainer02 to LABSTORAGE02 under the LABCONTAINER03 container using the instructions above, such as:

650) this.width=650; "title=" 2015-01-19_20-34-08.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M00/58/ Cf/wkiom1s9dzzxc8guaaimqh87caq910.jpg "alt=" Wkiom1s9dzzxc8guaaimqh87caq910.jpg "/>

In addition, if you want to blur the specified file name or a separate file, you can define it by/pattern: For example, specify all the files that start with T, and copy all to the destination path in/s mode:

650) this.width=650; "title=" 2015-01-19_20-41-17.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M00/58/ Cc/wkiol1s9dm-anhj2aamknhu4-ou806.jpg "alt=" Wkiol1s9dm-anhj2aamknhu4-ou806.jpg "/>

Similarly azcopy if an unexpected interrupt is performed during execution, the log file can be generated by/Z to restore the operation (journal file), and/V is used to generate the log, and if no other path is specified for both parameters, the file is generated in the default path:

650) this.width=650; "title=" 2015-01-19_21-11-00.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M01/58/ Cc/wkiol1s9dm_i-gvnaajxpxruqiy195.jpg "alt=" Wkiol1s9dm_i-gvnaajxpxruqiy195.jpg "/>

It's strange that I didn't find the journal file with/z, but the log file can still be generated normally, the default path is as follows:

650) this.width=650; "title=" 2015-01-19_21-11-40.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M01/58/ Cf/wkiom1s9dz2bxlkdaakgoqiosbe517.jpg "alt=" Wkiom1s9dz2bxlkdaakgoqiosbe517.jpg "/>

Of course, the content in the log file is similar to what you see in the Command Line window, such as:

650) this.width=650; "title=" 2015-01-19_21-11-59.png "style=" Float:none "src=" http://s3.51cto.com/wyfs02/M02/58/ Cc/wkiol1s9dndjfbefaam6cwdn0q8077.jpg "alt=" Wkiol1s9dndjfbefaam6cwdn0q8077.jpg "/>

###################################################################

Overall, Azcopy is a great tool for managing data in azure storage, and there are still many features not mentioned, such as setting the number of concurrent executions (concurrent), in Azure BLOBs and azure FileShare in the copy of data, management table data and so on, and Azcopy is also constantly updated, I believe in the future will bring more excellent features.

This article is from the "Technology Not Home" blog, please be sure to keep this source http://maomaostyle.blog.51cto.com/2220531/1605939

Azure Storage Management Tools--azcopy