Common errors and workarounds for running remote Hadoop mapreduce programs in eclipse with the win system

First, Permission denied

1. Error in running remote Hadoop mapreduce program with Eclipse under win system

Org.apache.hadoop.security.AccessControlException:org.apache.hadoop.security.AccessControlException:Permission Denied:user=xxx, access=write, inode= "xxx": Xxx:supergroup:rwxr-xr-xat Sun.reflect.NativeConstructorAccessorImpl.newInstance0 (Native Method)

Because Eclipse uses the Hadoop plug-in to submit jobs, it defaults to using Windows system users to write jobs to the HDFs file system, which causes the exception to occur because the user does not have write access to the Hadoop directory.

The workaround is: Release the Hadoop directory permissions, the command is as follows: $ Hadoop fs-chmod-r 777/

Of course, you can also operate on only one directory:

If you are unfamiliar with commands, you can view them directly with the following commands:

2.

Common errors and workarounds for running remote Hadoop mapreduce programs in eclipse with the win system