This blog post is based on the http://blog.csdn.net/u010911997/article/details/44099165. Thank Yumbo Lord!
Issue 1: No more files can be manipulated on DFS lcation:
Modify the file on each node on the Hadoop conf/mapred-site.xml
Increase:
<property>
<name>dfs.permissions</name>
<value>false</value>
</property>
Turn off permission validation
Question 2
Log4j:warn No appenders could be foundfor logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
Log4j:warn Initialize the Log4jsystem properly.
Log4j:warn seehttp://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Create a file named Log4j.properties under the SRC folder
The file contents are as follows
Log4j.rootlogger=warn, stdout
Log4j.appender.stdout=org.apache.log4j.consoleappender
Log4j.appender.stdout.layout=org.apache.log4j.patternlayout
log4j.appender.stdout.layout.conversionpattern=%d%p [%c]-%m%n
Question 3
Java.io.IOException:Could not locateexecutable Null/bin/winutils.exe in the Hadoop binaries.
Missing winutils.exe download One add it in the line
http://download.csdn.net/detail/u010106732/9630094
Question 4
Exceptionin thread "main" Java.lang.unsatisfiedlinkerror:o Rg.apache.hadoop.util.NativeCrc32.nativeComputeChunkedSumsByteArray (ii[bi[biiljava/lang/string; JZ) V
This is due to the Hadoop.dll version issue , 2.2 before and after the need for a different
Need to select the correct version and replace it on Hadoop/bin and C:\windows\system32
Question 5
Exception in thread "main" JAVA.LANG.UNSATISFIEDLINKERROR:ORG.APACHE.HADOOP.IO.NATIVEIO.NATIVEIO$WINDOWS.ACCESS0 ( Ljava/lang/string;i) Z
Atorg.apache.hadoop.io.nativeio.nativeio$windows.access0 (Native Method)
At Org.apache.hadoop.io.nativeio.nativeio$windows.access (nativeio.java:557)
No workaround is currently found, only source code can be modified
Source code Download Http://pan.baidu.com/s/1jGJzVSy
Put the source code in the project's SRC directory and create the same package name, then modify the source code
Before the source code is modified
PublicstaticbooleanAccess (String path, accessright desiredaccess)
throws IOException {
return Access0 (Path,desiredaccess.accessright ());
}
After the source code has been modified
Public Staticbooleanaccess (String path, accessright desiredaccess)
throws IOException {
return ture;
return access0(Path,desiredaccess.accessright ());
}
The compilation succeeds after the modification, but does not see the information feedback when the software runs
Build (Windows) eclipse/myeclipse remote operation (on Linux) hadoop2.2.0/hadoop2.6.0 error set