Home > Developer Tools > Technical Articles

Hadoop uses MapReduce sorting ideas

Source: Internet
Author: User
Keywords Boundaries multiple solutions each
Tags course distributed hadoop how to internal key multiple the key
Developer on Alibaba Coud: Build your first app with APIs, SDKs, and tutorials on the Alibaba Cloud. Read more ＞

This article focuses on the key sort, the main use of Hadoop mechanism to sort.

1, Partition

The role of partition is to distribute the result of the map to multiple Reduce. Of course, multiple reduce can reflect the advantages of distributed.

2, ideas

Because each partition is internal, so long as the order to ensure that all partitions, you can ensure that all ordered.

3, the problem

With ideas, how to define the boundaries of partitions is a problem.

The solution: hadoop provides a sampler to help us predict the entire boundary so that the data is distributed as evenly as possible.

This article is an English version of an article which is originally in the Chinese language on aliyun.com and is provided for information purposes only. This website makes no representation or warranty of any kind, either expressed or implied, as to the accuracy, completeness ownership or reliability of the article or any translations thereof. If you have any concerns or complaints relating to the article, please send an email, providing a detailed description of the concern or complaint, to info-contact@alibabacloud.com. A staff member will contact you within 5 working days. Once verified, infringing content will be removed immediately.

Related Keywords:
hadoop uses hadoop mapreduce download java hadoop mapreduce apache hadoop mapreduce architecture hadoop mapreduce java hadoop api for mapreduce framework uses for hadoop
Related Article
What is SFTP Commands Linux_the Introduction
How to Configure CentOS 7.4 SFTP Server
Build an SFTP Server Using CentOS Built-in SSH Service
Configure Linux SFTP and Configure User Access
How to Easily Configure SFTP Server Linux In 6 Steps
Automatic Upload and Download of SFTP Files_Shell Script

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

Hot Article
Hot Tags
computing conference access forum computer class data get http html applications
Popular Keywords
node js build network management system tutorial network configure network ipv6 need to connect to internet no machine download network with new users network dns name of 7 days

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

Get Started for Free

  • Sales Support

    1 on 1 presale consultation

    Chat Contact Sales

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

    Open a Ticket

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.

    Learn More