Build (Windows) eclipse/myeclipse remote operation (on Linux) hadoop2.2.0/hadoop2.6.0 error set

This blog post is based on the http://blog.csdn.net/u010911997/article/details/44099165. Thank Yumbo Lord!

Issue 1: No more files can be manipulated on DFS lcation:

Modify the file on each node on the Hadoop conf/mapred-site.xml

Increase:

<property>

<name>dfs.permissions</name>

<value>false</value>

</property>

Turn off permission validation

Question 2

Log4j:warn No appenders could be foundfor logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).

Log4j:warn Initialize the Log4jsystem properly.

Log4j:warn seehttp://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

Create a file named Log4j.properties under the SRC folder

The file contents are as follows

Log4j.rootlogger=warn, stdout

Log4j.appender.stdout=org.apache.log4j.consoleappender

Log4j.appender.stdout.layout=org.apache.log4j.patternlayout

log4j.appender.stdout.layout.conversionpattern=%d%p [%c]-%m%n

Question 3

Java.io.IOException:Could not locateexecutable Null/bin/winutils.exe in the Hadoop binaries.

Missing winutils.exe download One add it in the line

http://download.csdn.net/detail/u010106732/9630094

Question 4

Exceptionin thread "main" Java.lang.unsatisfiedlinkerror:o Rg.apache.hadoop.util.NativeCrc32.nativeComputeChunkedSumsByteArray (ii[bi[biiljava/lang/string; JZ) V

This is due to the Hadoop.dll version issue , 2.2 before and after the need for a different

Need to select the correct version and replace it on Hadoop/bin and C:\windows\system32

Question 5

Exception in thread "main" JAVA.LANG.UNSATISFIEDLINKERROR:ORG.APACHE.HADOOP.IO.NATIVEIO.NATIVEIO$WINDOWS.ACCESS0 ( Ljava/lang/string;i) Z

Atorg.apache.hadoop.io.nativeio.nativeio$windows.access0 (Native Method)

At Org.apache.hadoop.io.nativeio.nativeio$windows.access (nativeio.java:557)

No workaround is currently found, only source code can be modified

Source code Download Http://pan.baidu.com/s/1jGJzVSy

Put the source code in the project's SRC directory and create the same package name, then modify the source code

Before the source code is modified

PublicstaticbooleanAccess (String path, accessright desiredaccess)

throws IOException {

return Access0 (Path,desiredaccess.accessright ());

}

After the source code has been modified

Public Staticbooleanaccess (String path, accessright desiredaccess)

throws IOException {

return ture;

return access0(Path,desiredaccess.accessright ());

}

The compilation succeeds after the modification, but does not see the information feedback when the software runs

Build (Windows) eclipse/myeclipse remote operation (on Linux) hadoop2.2.0/hadoop2.6.0 error set