Kettle connecting to Hadoop in error

Kettle writing files from Windows to HDFs

One

2016/07/19 14:14:53-spoon-Starting task ...
2016/07/19 14:14:53-load_hdfs-Start performing tasks
2016/07/19 14:14:53-load_hdfs-Start Item [Hadoop Copy Files]
2016/07/19 14:14:53-hadoop Copy Files-Start ...
2016/07/19 14:14:53-hadoop Copy Files-processing rows, source files/directories: [File:///E:/weblogs_rebuild.txt/weblogs_rebuild.txt] ... Target file/directory: [Hdfs://58.135.93.165:8020/data] ... wildcard character: [^.*\.txt]
2016/07/19 14:14:53-cfgbuilder-warning:the configuration parameter [org] is isn't supported by the default Configuratio N Builder for Scheme:sftp
2016/07/19 14:14:53-cfgbuilder-warning:the configuration parameter [org] is isn't supported by the default Configuratio N Builder for Scheme:sftp
2016/07/19 14:14:53-cfgbuilder-warning:the configuration parameter [org] is isn't supported by the default Configuratio N Builder for Scheme:sftp
2016/07/19 14:14:53-hadoop Copy files-error (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by Buildguy): File system Exception: Could not copy ' File:///E:/weblogs_rebuild.txt/weblogs_rebuild.txt ' to ' hdfs://58.135.93.165:8020/data/weblogs_ Rebuild.txt ".
2016/07/19 14:14:53-hadoop Copy files-error (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by Buildguy): Reason: C Ould not write to "Hdfs://58.135.93.165:8020/data/weblogs_rebuild.txt".
2016/07/19 14:14:53-hadoop Copy files-error (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by Buildguy): Reason: P Ermission Denied:user=administrator, Access=write, inode= "/data/weblogs_rebuild.txt": root:hadoop:drwxr-xr-x
At Org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check (fspermissionchecker.java:320)
At Org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check (fspermissionchecker.java:292)
At Org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission (fspermissionchecker.java:213)
At Org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission (fspermissionchecker.java:190)
At Org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission (fsdirectory.java:1698)
At Org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission (fsdirectory.java:1682)
At Org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess (fsdirectory.java:1665)
At Org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal (fsnamesystem.java:2517)
At Org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt (fsnamesystem.java:2452)
At Org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile (fsnamesystem.java:2335)
At Org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create (namenoderpcserver.java:623)
At Org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create ( clientnamenodeprotocolserversidetranslatorpb.java:397)
At org.apache.hadoop.hdfs.protocol.proto.clientnamenodeprotocolprotos$clientnamenodeprotocol$2. Callblockingmethod (Clientnamenodeprotocolprotos.java)
At Org.apache.hadoop.ipc.protobufrpcengine$server$protobufrpcinvoker.call (protobufrpcengine.java:616)
At Org.apache.hadoop.ipc.rpc$server.call (rpc.java:969)
At Org.apache.hadoop.ipc.server$handler$1.run (server.java:2049)
At Org.apache.hadoop.ipc.server$handler$1.run (server.java:2045)
At java.security.AccessController.doPrivileged (Native Method)
At Javax.security.auth.Subject.doAs (subject.java:422)
At Org.apache.hadoop.security.UserGroupInformation.doAs (usergroupinformation.java:1657)
At Org.apache.hadoop.ipc.server$handler.run (server.java:2045)

Some ideas on the Internet

1. Modify the configuration file for Hadoop on the server hdfs-site.xml

Change to False, restart Hadoop, but I tried it, then restarted the cluster from Ambari, and found it to be true again, for no reason

2. Corresponding directory authorization chmod 777, or an error

3. Final Solution:

Hadoop fs-mkdir/user/administrator

Hadoop Fs-chown Administrator:hdfs/user/administrator

Both

2016/07/20 10:07:03-hadoop Copy files-error (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by Buildguy): File system Exception: Could not copy ' File:///E:/Test/red.txt ' to ' hdfs://58.135.93.165:8020/kettle/red.txt '.
2016/07/20 10:07:03-hadoop Copy files-error (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by Buildguy): Reason: C Ould not close the output stream for file "Hdfs://58.135.93.165:8020/kettle/red.txt".
2016/07/20 10:07:03-hadoop Copy files-error (version 6.1.0.1-196, build 1 from 2016-04-07 12.08.49 by Buildguy): Reason: C Onnection timed Out:no Further information

Cause: This is the error reported on the power server, but the same way to the x86 server can be successful.

Specific workaround: My other blog post Linux boot Kettle and Linux and Windows kettle in HDFs write data (3) http://www.cnblogs.com/womars/p/5718349.html

Kettle connecting to Hadoop in error