Hadoop runs Mr program Times wrong:
15/05/18 19:25:33 INFO mapred. Clientservicedelegate:application is completed. Finalapplicationstatus=succeeded. Redirecting to Job history server
15/05/18 19:25:34 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 0 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:35 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 1 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:36 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 2 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:37 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 3 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:38 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 4 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:39 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 5 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:40 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 6 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:41 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 7 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:42 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 8 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:43 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 9 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:43 INFO mapred. Clientservicedelegate:application is completed. Finalapplicationstatus=succeeded. Redirecting to Job history server
15/05/18 19:25:44 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 0 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:45 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 1 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:46 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 2 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:47 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 3 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:48 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 4 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:49 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 5 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:50 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 6 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:51 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 7 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:52 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 8 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:53 INFO IPC. Client:retrying Connect to server:nwj5/192.168.11.104:10020. Already tried 9 time (s); Retry policy is Retryuptomaximumcountwithfixedsleep (maxretries=10, sleeptime=1 SECONDS)
15/05/18 19:25:53 ERROR Security. Usergroupinformation:priviledgedactionexception as:hp (auth:simple) Cause:java.io.IOException: Java.net.ConnectException:Call from nwj5/192.168.11.104 to nwj5:10020 failed on connection exception: Java.net.ConnectException: Deny connection; For more details see:http://wiki.apache.org/hadoop/connectionrefused
Exception in thread "main" Java.io.IOException:java.net.ConnectException:Call from nwj5/192.168.11.104 to nwj5:10020 FA Iled on connection exception:java.net.ConnectException: Reject connection; For more details see:http://wiki.apache.org/hadoop/connectionrefused
At Org.apache.hadoop.mapred.ClientServiceDelegate.invoke (clientservicedelegate.java:331)
At Org.apache.hadoop.mapred.ClientServiceDelegate.getJobCounters (clientservicedelegate.java:368)
At Org.apache.hadoop.mapred.YARNRunner.getJobCounters (yarnrunner.java:511)
At Org.apache.hadoop.mapreduce.job$7.run (job.java:756)
At Org.apache.hadoop.mapreduce.job$7.run (job.java:753)
At java.security.AccessController.doPrivileged (Native Method)
At Javax.security.auth.Subject.doAs (subject.java:415)
At Org.apache.hadoop.security.UserGroupInformation.doAs (usergroupinformation.java:1491)
At Org.apache.hadoop.mapreduce.Job.getCounters (job.java:753)
At Org.apache.mahout.cf.taste.hadoop.als.ParallelALSFactorizationJob.run (parallelalsfactorizationjob.java:200)
At Org.apache.hadoop.util.ToolRunner.run (toolrunner.java:70)
At Org.apache.hadoop.util.ToolRunner.run (toolrunner.java:84)
At Org.apache.mahout.cf.taste.hadoop.als.ParallelALSFactorizationJob.main (parallelalsfactorizationjob.java:113)
At Sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
At Sun.reflect.NativeMethodAccessorImpl.invoke (nativemethodaccessorimpl.java:57)
At Sun.reflect.DelegatingMethodAccessorImpl.invoke (delegatingmethodaccessorimpl.java:43)
At Java.lang.reflect.Method.invoke (method.java:606)
At Org.apache.hadoop.util.programdriver$programdescription.invoke (programdriver.java:72)
At Org.apache.hadoop.util.ProgramDriver.run (programdriver.java:144)
At Org.apache.hadoop.util.ProgramDriver.driver (programdriver.java:152)
At Org.apache.mahout.driver.MahoutDriver.main (mahoutdriver.java:195)
At Sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
At Sun.reflect.NativeMethodAccessorImpl.invoke (nativemethodaccessorimpl.java:57)
At Sun.reflect.DelegatingMethodAccessorImpl.invoke (delegatingmethodaccessorimpl.java:43)
At Java.lang.reflect.Method.invoke (method.java:606)
At Org.apache.hadoop.util.RunJar.main (runjar.java:212)
caused By:java.net.ConnectException:Call from nwj5/192.168.11.104 to nwj5:10020 failed on connection exception:java.net . Connectexception: Deny connection; For more details see:http://wiki.apache.org/hadoop/connectionrefused
At Sun.reflect.NativeConstructorAccessorImpl.newInstance0 (Native Method)
At Sun.reflect.NativeConstructorAccessorImpl.newInstance (nativeconstructoraccessorimpl.java:57)
At Sun.reflect.DelegatingConstructorAccessorImpl.newInstance (delegatingconstructoraccessorimpl.java:45)
At Java.lang.reflect.Constructor.newInstance (constructor.java:526)
At Org.apache.hadoop.net.NetUtils.wrapWithMessage (netutils.java:783)
At Org.apache.hadoop.net.NetUtils.wrapException (netutils.java:730)
At Org.apache.hadoop.ipc.Client.call (client.java:1351)
At Org.apache.hadoop.ipc.Client.call (client.java:1300)
At Org.apache.hadoop.ipc.protobufrpcengine$invoker.invoke (protobufrpcengine.java:206)
At Com.sun.proxy. $Proxy 14.getCounters (Unknown Source)
At Org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getCounters ( mrclientprotocolpbclientimpl.java:166)
At Sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
At Sun.reflect.NativeMethodAccessorImpl.invoke (nativemethodaccessorimpl.java:57)
At Sun.reflect.DelegatingMethodAccessorImpl.invoke (delegatingmethodaccessorimpl.java:43)
At Java.lang.reflect.Method.invoke (method.java:606)
At Org.apache.hadoop.mapred.ClientServiceDelegate.invoke (clientservicedelegate.java:317)
... More
Caused by:java.net.ConnectException: Deny connection
At Sun.nio.ch.SocketChannelImpl.checkConnect (Native Method)
At Sun.nio.ch.SocketChannelImpl.finishConnect (socketchannelimpl.java:739)
At Org.apache.hadoop.net.SocketIOWithTimeout.connect (socketiowithtimeout.java:206)
At Org.apache.hadoop.net.NetUtils.connect (netutils.java:529)
At Org.apache.hadoop.net.NetUtils.connect (netutils.java:493)
At Org.apache.hadoop.ipc.client$connection.setupconnection (client.java:547)
At Org.apache.hadoop.ipc.client$connection.setupiostreams (client.java:642)
At org.apache.hadoop.ipc.client$connection.access$2600 (client.java:314)
At Org.apache.hadoop.ipc.Client.getConnection (client.java:1399)
At Org.apache.hadoop.ipc.Client.call (client.java:1318)
... More
Cause: Hadoop configuration did not start the history server;
WORKAROUND: [[email protected] root]$ mr-jobhistory-daemon.sh start historyserver
Starting Historyserver, logging to/home/hadoop/logs/mapred-hp-historyserver-nwj5.out
ERROR security. Usergroupinformation:priviledgedactionexception + java.net.ConnectException Solutions