Common exceptions to Hadoop and their solutions

1, Shell$exitcodeexception

Behavior: The following exception occurred while running the Hadoop job:

14/07/09 14:42:50 INFO MapReduce. Job:http://www.aliyun.com/zixun/aggregation/17034.html ">task id:attempt_1404886826875_0007_m_000000_1, Status : FAILED

Exception from Container-launch:org.apache.hadoop.util.shell$exitcodeexception:

Org.apache.hadoop.util.shell$exitcodeexception:

At Org.apache.hadoop.util.Shell.runCommand (shell.java:505)

At Org.apache.hadoop.util.Shell.run (shell.java:418)

At Org.apache.hadoop.util.shell$shellcommandexecutor.execute (shell.java:650)

At Org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer ( defaultcontainerexecutor.java:195)

At Org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call ( CONTAINERLAUNCH.JAVA:300)

At Org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call ( CONTAINERLAUNCH.JAVA:81)

At Java.util.concurrent.FutureTask.run (futuretask.java:262)

At Java.util.concurrent.ThreadPoolExecutor.runWorker (threadpoolexecutor.java:1145)

At Java.util.concurrent.threadpoolexecutor$worker.run (threadpoolexecutor.java:615)

At Java.lang.Thread.run (thread.java:744)

Container exited with a Non-zero exit code 1

Reasons and Solutions: unknown reasons. Reboot to restore normal

2, libhadoop.so.1.0.0 abound might have disabled stack guard

Phenomenon: Hadoop 2.2.0-warning:you have loaded library/home/hadoop/2.2.0/lib/native/libhadoop.so.1.0.0 abound might Disabled stack guard.

Reasons and Solutions:

Add in/etc/profile:

#hadoop revisit

Export path= $PATH:/home/jediael/hadoop-2.4.1/bin:/home/jediael/hadoop-2.4.1/sbin

Export hadoop_home=/home/jediael/hadoop-2.4.1

Export Hadoop_common_home= $HADOOP _home

Export Hadoop_hdfs_home= $HADOOP _home

Export Hadoop_mapred_home= $HADOOP _home

Export Hadoop_yarn_home= $HADOOP _home

Export hadoop_conf_dir= $HADOOP _home/etc/hadoop

Export hadoop_common_lib_native_dir= $HADOOP _home/lib/native

Export hadoop_opts= "-djava.library.path= $HADOOP _home/lib"

This warning occurs because the last 2 entries were not added.

Original link: http://blog.csdn.net/jediael_lu/article/details/37598727