[Translation] sequencefile, mapfile, setfile, arrayfile, bloommapfile

Source: Internet
Author: User

Apache hadoop sequencefile provides a way to save data to HDFS in the form of binary key-value pairs. And other key-Value

Compared with data structures (such as B-tree), sequencefile cannot modify or delete data, nor insert data into data. Sequencefile can only end

Data.

Sequencefile provides three storage formats:

1. uncompressed format: no compression format 2. Record compressed: Record compression format 3. Block compressed: block compression format

The headers of the three storage formats are the same. Their headers contain the following information, which will be read by sequencefile. Reader.

 

1. the header part includes the class type of key and value, sequencefile. reader will read these two attributes and instantiate them through reflection; 2. version includes the version information of sequencefile; 3.is compressed is used to specify whether it is record compressed; 4.is block compressed is used to specify whether it is block compressed
5. Metadata is a key-Value List structure that can be used to store metadata of files. Key-value pairs can only be of the <text, text> type. And the information
It is written in the construction method of sequencefile. Writer. Cannot be modified.
  
6.

 

Not complete...

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.