Linux under gzip compression the same content size is not the same reason

Source: Internet
Author: User

A data, two transmission ways to collect.

One data: Multiple data acquisition nodes or multiple sources

Two ways: one is to copy data from multiple collection nodes or multiple data sources, and merge into one file.

The other is that multiple acquisition nodes or data sources send data to the summary end at the same time, and finally merge into a file

The difference between the two methods: the aggregated data is the same, but the order will be different

Compress merged files using the gzip command .... The final display of compressed file size is not the same ....

This shows that the same data with the GZIP compression comparison size needs to ensure that the same order!! Compression algorithm results in different order compression result is different ...

This problem has been a long time to find, the main reason is the gzip compression algorithm does not understand.

Back to the column page: http://www.bianceng.cnhttp://www.bianceng.cn/OS/Linux/

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.