Hadoop V1 and V2 understanding

Source: Internet
Author: User

MRV1:

This request is managed by Jobtracker when a client makes a request to a Hadoop cluster. Jobtracker with NameNode to distribute the work to the closest possible location to the data it is working with. NameNode is the main system of the file system, providing metadata services to perform data distribution and replication. Jobtracker the Map and Reduce tasks to an available slot on one or more tasktracker. Tasktracker and DataNode (Distributed File System) perform Map and Reduce tasks with data from DataNode. When the Map and Reduce tasks are completed, Tasktracker informs Jobtracker that it determines when all tasks are completed and ultimately informs the client that the job is complete.


MRV2:

The essence of YARN layered structure is ResourceManager. This entity controls the entire cluster and manages the allocation of the application to the underlying computing resources. ResourceManager arranges the various resource parts (compute, memory, bandwidth, etc.) to the base NodeManager (per-node agent of YARN). ResourceManager also allocates resources together with Applicationmaster to launch and monitor their underlying applications together with NodeManager. In this context, Applicationmaster assumed some of the roles of previous Tasktracker, ResourceManager assumed the role of Jobtracker.


Hadoop V1 and V2 understanding

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.