Configuring MapReduce
<?xml version= "1.0"?><?xml-stylesheet type= "text/xsl" href= "configuration.xsl"?><!--Licensed under the Apache License, Version 2.0 (the "License"); You are not a use of this file except in compliance with the License. Obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 unless required by applicable law O R agreed to writing, software distributed under the License are distributed on a "as is" BASIS, without warranties OR CONDITIONS of any KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. See accompanying LICENSE file.--><!--Put Site-specific property overrides in this file.--<configuration></configuration>Plus this.<configuration> <property > <name>Mapreduce.framework.name</name> <value>Yarn</value> </Property ></configuration>
And then configure it inside the yarn-site.xml.
<configuration><!--Site specific YARN Configuration Properties -- <property > <name>Yarn.resourcemanager.hostname</name> <!--where to run the appropriate program-- <value>Hadoop1</value> </Property > <property > <name>Yarn.nodemanager.aux-services</name> <value>Mapreduce_shuffle</value> </Property > <property > <name>Yarn.nodemanager.aux-services.mapreduce_shuffle.class</name> <value>Org.apache.hadoop.mapred.ShuffleHandler</value> </Property > </configuration>
Start
After you start HDFs in front
When you start yarn
sbin/start-yarn.sh
HADOOP1 on
Node1
Node2
Node3
Project
Start our project of the MapReduce in Eclipse run
First build a Java project
Then import the appropriate package
Common the following
Under MapReduce.
Yarn below the amount
Under HDFs,
Our Requirements Documentation
1949-10-01 14:21:02 34 ℃
1949-10-02 14:01:02 36 ℃
1950-01-01 11:21:02 32 ℃
1950-10-01 12:21:02 37 ℃
1951-12-01 12:21:02 23 ℃
1950-10-02 12:21:02 41 ℃
1950-10-03 12:21:02 27 ℃
1951-07-01 12:21:02 45 ℃
1951-07-02 12:21:02 46 ℃
?
1949-10-01 14:21:02 34 ℃
1949-10-01 14:21:02 34 ℃
1949-10-01 14:21:02 34 ℃
?
1949-10-01 14:21:02 34 ℃
?
Copyright NOTICE: This article for Bo Master original article, without Bo Master permission not reproduced.
"Hadoop" 14, hadoop2.5 's mapreduce configuration