Common hadoop exceptions and Solutions

1. Shell $ exitcodeexception

Symptom: The following exception occurs when running a hadoop job:

14/07/09 14:42:50 info mapreduce. Job: task id: attempt_1404886826875_0007_m_000000_1, status: Failed
Exception from container-launch: org. Apache. hadoop. util. Shell $ exitcodeexception:
Org. Apache. hadoop. util. Shell $ exitcodeexception:
At org. Apache. hadoop. util. Shell. runcommand (shells. Java: 505)
At org. Apache. hadoop. util. Shell. Run (shell. Java: 418)
At org.apache.hadoop.util.shell?shellcommandexecutor.exe cute (shell. Java: 650)
At org. Apache. hadoop. yarn. server. nodemanager. defaultinerexecutor. launchcontainer (defaultinerexecutor. Java: 195)
At org. Apache. hadoop. yarn. server. nodemanager. containermanager. launcher. containerlaunch. Call (containerlaunch. Java: 300)
At org. Apache. hadoop. yarn. server. nodemanager. containermanager. launcher. containerlaunch. Call (containerlaunch. Java: 81)
At java. util. Concurrent. futuretask. Run (futuretask. Java: 262)
At java. util. Concurrent. threadpoolexecutor. runworker (threadpoolexecutor. Java: 1145)
At java. util. Concurrent. threadpoolexecutor $ worker. Run (threadpoolexecutor. Java: 615)
At java. Lang. thread. Run (thread. Java: 744)

Container exited with a non-zero exit code 1

Cause and solution: unknown cause. Restart to restore normal

2. libhadoop. so.1.0.0 which might have disabled stack guard

Symptom: hadoop 2.2.0-warning: You have loaded Library/home/hadoop/2.2.0/lib/native/libhadoop. so.1.0.0 which might have disabled stack guard.

Cause and solution: Add: # hadoop configuration in/etc/profile
Export Path = $ path:/home/Jediael/hadoop-2.4.1/bin:/home/Jediael/hadoop-2.4.1/sbin
Export hadoop_home =/home/Jediael/hadoop-2.4.1
Export hadoop_common_home = $ hadoop_home
Export hadoop_hdfs_home = $ hadoop_home
Export hadoop_mapred_home = $ hadoop_home
Export hadoop_yarn_home = $ hadoop_home
Export hadoop_conf_dir = $ hadoop_home/etc/hadoop
Export hadoop_common_lib_native_dir = $ hadoop_home/lib/native
Export hadoop_opts = "-djava. Library. Path = $ hadoop_home/lib"
The cause of this warning is that the last two items are not added.