"Hadoop" 14, hadoop2.5 's mapreduce configuration

Source: Internet
Author: User

Configuring MapReduce
<?xml version= "1.0"?><?xml-stylesheet type= "text/xsl" href= "configuration.xsl"?><!--Licensed under the Apache License, Version 2.0 (the "License");  You are not a use of this file except in compliance with the License. Obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 unless required by applicable law O  R agreed to writing, software distributed under the License are distributed on a "as is" BASIS, without warranties OR  CONDITIONS of any KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. See accompanying LICENSE file.--><!--Put Site-specific property overrides in this file.--<configuration></configuration>Plus this.<configuration>    <property >        <name>Mapreduce.framework.name</name>        <value>Yarn</value>    </Property ></configuration>


And then configure it inside the yarn-site.xml.

<configuration><!--Site specific YARN Configuration Properties --    <property >        <name>Yarn.resourcemanager.hostname</name>        <!--where to run the appropriate program--        <value>Hadoop1</value>    </Property >    <property >        <name>Yarn.nodemanager.aux-services</name>        <value>Mapreduce_shuffle</value>    </Property >    <property >        <name>Yarn.nodemanager.aux-services.mapreduce_shuffle.class</name>        <value>Org.apache.hadoop.mapred.ShuffleHandler</value>    </Property > </configuration>

Start

After you start HDFs in front
When you start yarn

sbin/start-yarn.sh

HADOOP1 on

Node1

Node2

Node3

Project
Start our project of the MapReduce in Eclipse run

First build a Java project

Then import the appropriate package
Common the following

Under MapReduce.

Yarn below the amount

Under HDFs,

Our Requirements Documentation

1949-10-01 14:21:02 34 ℃
1949-10-02 14:01:02 36 ℃
1950-01-01 11:21:02 32 ℃
1950-10-01 12:21:02 37 ℃
1951-12-01 12:21:02 23 ℃
1950-10-02 12:21:02 41 ℃
1950-10-03 12:21:02 27 ℃
1951-07-01 12:21:02 45 ℃
1951-07-02 12:21:02 46 ℃
?
1949-10-01 14:21:02 34 ℃
1949-10-01 14:21:02 34 ℃
1949-10-01 14:21:02 34 ℃
?
1949-10-01 14:21:02 34 ℃
?

Copyright NOTICE: This article for Bo Master original article, without Bo Master permission not reproduced.

"Hadoop" 14, hadoop2.5 's mapreduce configuration

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.