Home > Internet > Online Trends

Research on the method of storing mass small files based on Hadoop

Source: Internet
Author: User
Keywords HADOOP HDFS mass of small files
Tags .mall based data development file files hadoop platform
Developer on Alibaba Coud: Build your first app with APIs, SDKs, and tutorials on the Alibaba Cloud. Read more ＞

Research on the method of storing mass small files based on Hadoop

Shi Fang Yuai Liang Peng

With the development of science and technology, the data in various industries and fields need to be processed exploded. Hadoop is an ideal platform for large file storage processing, but Hadoop does not perform satisfactorily when dealing with massive amounts of small files. Firstly, this paper introduces the system architecture of HDFS, then analyzes the problems existing in the HDFS processing of large amount of small files, and finally introduces the optimization scheme of this problem at home and abroad.


Research on the method of storing mass small files based on Hadoop

This article is an English version of an article which is originally in the Chinese language on aliyun.com and is provided for information purposes only. This website makes no representation or warranty of any kind, either expressed or implied, as to the accuracy, completeness ownership or reliability of the article or any translations thereof. If you have any concerns or complaints relating to the article, please send an email, providing a detailed description of the concern or complaint, to info-contact@alibabacloud.com. A staff member will contact you within 5 working days. Once verified, infringing content will be removed immediately.

Related Keywords:
which of the following os is not based on linux installation of hadoop on ubuntu research on internet ______ was the first sql on hadoop application research on internet addiction research paper on addiction error on the side of
Related Article
Front-end Must Learn: CDN Acceleration Principle
Elements of CDN Network
Understand the Principle of CDN Acceleration in One Article
Cloud Security Issues Derived from the Development of Cloud C...
8 New Types of Attacks Facing the Cloud Environment

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

Hot Article
Hot Tags
computing conference access forum computer class data get http html applications
Popular Keywords
html add blank space register business logo register ssl certificate full site sign in sign up node js build cloud register register a subdomain in python network management system tutorial how to learn computer science by myself

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

Get Started for Free

  • Sales Support

    1 on 1 presale consultation

    Chat Contact Sales

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

    Open a Ticket

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.

    Learn More