Come with me. Cloud Computing (2) YARN

Source: Internet
Author: User
Tags hadoop mapreduce

Introduced

The Apache Hadoop yarn is added to the Hadoop Common (core libraries) as a subproject of Hadoop, Hadoop HDFS (storage) and Hadoop MapReduce (the MapReduce implementation), it is also the top project of Apache.

In Hadoop 2.0, each client submits various MapReduce applications to the MapReduce V2 framework running on yarn. In Hadoop 1.0, each client submits a maprecude application to the MapReduce v1 framework.

Both types of APIs refer to the Maprecude framework available to developers to create MapReduce applications. The Org.apache.hadoop.mapred API is the earliest API that is most widely used in the creation of MapReduce applications. Any MapReduce v1 application developed using the Mapred API can be submitted to the MapReduce V2 framework running on yarn and run in the framework. In this case, there is no need to modify the MapReduce application.

The difference between hadoop1.0 and 2.0

A direct look at the picture will be more clear:

As part of hadoop2.0, yarn has the ability to manage resources, so it can use multiple new engines. Using yarn, you can run multiple applications on Hadoop, as shown in the following diagram:

See more highlights of this column: http://www.bianceng.cnhttp://www.bianceng.cn/Servers/cloud-computing/

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.