Hadoop 2.x installation FAQ (I) nodemanager cannot be started

I. Problem Description

The last step to build a hadoop hadoop-2.4.1 cluster to start the cluster is that no error is reported in the Command window, but the nodemanager process on the slave node is always not started. Then looked at the background boot log yarn-hadoop-nodemanager-Slave1.Hadoop.log, found the following error:

 

1. 01:02:17, 228 fatal org. Apache. hadoop. yarn. server. nodemanager. containermanager. auxservices: failed to initialize mapreduce. Shuffle
2. Java. Lang. illegalargumentexception: The servicename: mapreduce. Shuffle set in yarn. nodemanager. Aux-services is invalid. The valid service name shocould only contain a-zA-Z0-9 _ and can not start with numbers
3. At com. Google. Common. Base. preconditions. checkargument (preconditions. Java: 88)
4. At org. Apache. hadoop. yarn. server. nodemanager. containermanager. auxservices. serviceinit (auxservices. Java: 98)
5. At org. Apache. hadoop. Service. abstractservice. INIT (abstractservice. Java: 163)
6. At org. Apache. hadoop. Service. compositeservice. serviceinit (compositeservice. Java: 107)
7. At org. Apache. hadoop. yarn. server. nodemanager. containermanager. containermanagerimpl. serviceinit (containermanagerimpl. Java: 221)
8. At org. Apache. hadoop. Service. abstractservice. INIT (abstractservice. Java: 163)
9. At org. Apache. hadoop. Service. compositeservice. serviceinit (compositeservice. Java: 107)
10. At org. Apache. hadoop. yarn. server. nodemanager. nodemanager. serviceinit (nodemanager. Java: 188)
11. At org. Apache. hadoop. Service. abstractservice. INIT (abstractservice. Java: 163)
12. At org. Apache. hadoop. yarn. server. nodemanager. nodemanager. initandstartnodemanager (nodemanager. Java: 357)
13. At org. Apache. hadoop. yarn. server. nodemanager. nodemanager. Main (nodemanager. Java: 405)
14. 2014-08-01 01:02:17, 235 info Org. apache. hadoop. service. abstractservice: Service Org. apache. hadoop. yarn. server. nodemanager. containermanager. auxservices failed in State inited; cause: Java. lang. illegalargumentexception: The servicename: mapreduce. shuffle set in yarn. nodemanager. aux-services is invalid. the valid service name shocould only contain a-zA-Z0-9 _ and can not start with numbers
15. Java. lang. illegalargumentexception: The servicename: mapreduce. shuffle set in yarn. nodemanager. aux-services is invalid <strong>. <span style = "font-size: 14px; color: # ff0000; "> the valid service name shocould only contain a-zA-Z0-9 _ and can not start with numbers </span> </strong>

 

1. /*************************************** *********************
2. Shutdown_msg: Shutting Down nodemanager at slave1.hadoop/192.168.1.3
3. **************************************** ********************/

 

 

Ii. Problem Solving

 

Found that yarn-site.xml configuration does not meet the requirements. Modify as follows:

Incorrect Configuration:

 

1. <Property>
2. <Span style = "white-space: pre"> </span> <Name> yarn. nodemanager. Aux-services </Name>
3. <Span style = "white-space: pre"> </span> <value> <strong> <span style = "color: # ff0000;"> mapreduce. shuffle </span> </strong> </value>
4. </Property>

 

Correct configuration after modification:

1. <Property>
2. <Span style = "white-space: pre"> </span> <Name> yarn. nodemanager. Aux-services </Name>
3. <Span style = "white-space: pre"> </span> <value> <span style = "color: # ff0000; "> <strong> mapreduce_shuffle </strong> </span> </value>
4. </Property>

Solve the problem from the new cluster.

Hadoop 2.x installation FAQ (I) nodemanager cannot be started