Architecture of the architecture of Hadoop

Source: Internet
Author: User
Tags hadoop mapreduce

Architecture of MapReduce

Hadoop MapReduce is an easy-to-use software framework that can be run on a large cluster of thousands of commercial machines, based on the applications it writes out.
And in a reliable fault-tolerant way in parallel processing of the upper terabytes of data sets.

Programs implemented with the MapReduce architecture enable parallelization in a large number of general-configured computers.
The MapReduce system only cares about how the data is segmented, how it is dispatched, and how the computer in the cluster handles the error.
Manages the communication between computers.

The MapReduce framework consists of a separate master jobtracker and slave tasktracker on the cluster nodes.
Master is responsible for scheduling all tasks in a job and distributing these tasks on different slave.
Master monitors the execution of these tasks on the slave node and re-executes the failed task, while Slave is only responsible for performing the tasks assigned by master.

1. MapReduce is a programming mode

2, Map/reduce

Architecture of the architecture of Hadoop

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.