14/12/17 19:18:53ERROR shell:failed to locate the winutils binary in the Hadoop binary pathjava.io.IOException:Could not locate exec UtableNULL\bin\winutils.exe in the Hadoop binaries. At Org.apache.hadoop.util.Shell.getQualifiedBinPath (Shell.java:318) at Org.apache.hadoop.util.Shell.getWinUtilsPath (Shell.java:333) at Org.apache.hadoop.util.Shell.<clinit> (shell.java:326) at Org.apache.hadoop.util.StringUtils.<clinit> (stringutils.java:76) at org.apache.hadoop.security.Groups.parseStaticMapping (Groups.java:93) at org.apache.hadoop.security.Groups.<init> (groups.java:77) at Org.apache.hadoop.security.Groups.getUserToGroupsMappingService (Groups.java:240) at Org.apache.hadoop.security.UserGroupInformation.initialize (Usergroupinformation.java:255) at Org.apache.hadoop.security.UserGroupInformation.setConfiguration (Usergroupinformation.java:283) at Org.apache.spark.deploy.SparkHadoopUtil.<init> (sparkhadooputil.scala:36) at org.apache.spark.deploy.sparkhadooputil$.<init> (sparkhadooputil.scala:109) at org.apache.spark.deploy.sparkhadooputil$.<clinit>(Sparkhadooputil.scala) at Org.apache.spark.SparkContext.<init> (sparkcontext.scala:228) at Org.apache.spark.streaming.streamingcontext$.createnewsparkcontext (Streamingcontext.scala:555) at Org.apache.spark.streaming.StreamingContext.<init> (streamingcontext.scala:75) at Com.hark.test$.main (Test.scala:28) at Com.hark.Test.main (Test.scala) at Sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at Sun.ref Lect. Nativemethodaccessorimpl.invoke (Nativemethodaccessorimpl.java:57) at Sun.reflect.DelegatingMethodAccessorImpl.invoke (Delegatingmethodaccessorimpl.java:43) at Java.lang.reflect.Method.invoke (Method.java:606) at Com.intellij.rt.execution.application.AppMain.main (Appmain.java:134)14/12/17 19:18:54 INFO akkautils:connecting to HeartbeatReceiver:akka.tcp://[Email Protected]:60477/user/heartbeatreceiver
Windows idea run times this exception
Just add it in front of the code
New File ("." ). Getcanonicalpath ()//File workaround = new file ("."); System.getproperties (). Put ("Hadoop.home.dir", path); New File ("./bin"). Mkdirs (); New File ("./bin/winutils.exe"). CreateNewFile ();
Can..
Reason: Unknown ...
It's a wonderful problem.
ERROR shell:failed to locate the winutils binary in the Hadoop binary path