18/06/24 16:41:40 ERROR Spark. Sparkcontext:error initializing Sparkcontext.
Java.net.BindException:Cannot assign requested Address:service ' Sparkdriver ' failed after + retries (starting from 0)! Consider explicitly setting the appropriate port for the service ' Sparkdriver ' (for example spark.ui.port in Sparkui) to An available port or increasing spark.port.maxRetries.
At Sun.nio.ch.Net.bind0 (Native Method)
At Sun.nio.ch.Net.bind (net.java:433)
At Sun.nio.ch.Net.bind (net.java:425)
At Sun.nio.ch.ServerSocketChannelImpl.bind (serversocketchannelimpl.java:223)
At Io.netty.channel.socket.nio.NioServerSocketChannel.doBind (nioserversocketchannel.java:127)
At Io.netty.channel.abstractchannel$abstractunsafe.bind (abstractchannel.java:501)
At Io.netty.channel.defaultchannelpipeline$headcontext.bind (defaultchannelpipeline.java:1218)
At Io.netty.channel.AbstractChannelHandlerContext.invokeBind (abstractchannelhandlercontext.java:496)
At Io.netty.channel.AbstractChannelHandlerContext.bind (abstractchannelhandlercontext.java:481)
At Io.netty.channel.DefaultChannelPipeline.bind (defaultchannelpipeline.java:965)
At Io.netty.channel.AbstractChannel.bind (abstractchannel.java:210)
At Io.netty.bootstrap.abstractbootstrap$2.run (abstractbootstrap.java:353)
At Io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks (singlethreadeventexecutor.java:399)
At Io.netty.channel.nio.NioEventLoop.run (nioeventloop.java:446)
At Io.netty.util.concurrent.singlethreadeventexecutor$2.run (singlethreadeventexecutor.java:131)
At Io.netty.util.concurrent.defaultthreadfactory$defaultrunnabledecorator.run (defaultthreadfactory.java:144)
At Java.lang.Thread.run (thread.java:748)
Java.net.BindException:Cannot assign requested Address:service ' Sparkdriver ' failed after + retries (starting from 0)! Consider explicitly setting the appropriate port for the service ' Sparkdriver ' (for example spark.ui.port in Sparkui) to An available port or increasing spark.port.maxRetries.
At Sun.nio.ch.Net.bind0 (Native Method)
At Sun.nio.ch.Net.bind (net.java:433)
At Sun.nio.ch.Net.bind (net.java:425)
At Sun.nio.ch.ServerSocketChannelImpl.bind (serversocketchannelimpl.java:223)
At Io.netty.channel.socket.nio.NioServerSocketChannel.doBind (nioserversocketchannel.java:127)
At Io.netty.channel.abstractchannel$abstractunsafe.bind (abstractchannel.java:501)
At Io.netty.channel.defaultchannelpipeline$headcontext.bind (defaultchannelpipeline.java:1218)
At Io.netty.channel.AbstractChannelHandlerContext.invokeBind (abstractchannelhandlercontext.java:496)
At Io.netty.channel.AbstractChannelHandlerContext.bind (abstractchannelhandlercontext.java:481)
At Io.netty.channel.DefaultChannelPipeline.bind (defaultchannelpipeline.java:965)
At Io.netty.channel.AbstractChannel.bind (abstractchannel.java:210)
At Io.netty.bootstrap.abstractbootstrap$2.run (abstractbootstrap.java:353)
At Io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks (singlethreadeventexecutor.java:399)
At Io.netty.channel.nio.NioEventLoop.run (nioeventloop.java:446)
At Io.netty.util.concurrent.singlethreadeventexecutor$2.run (singlethreadeventexecutor.java:131)
At Io.netty.util.concurrent.defaultthreadfactory$defaultrunnabledecorator.run (defaultthreadfactory.java:144)
At Java.lang.Thread.run (thread.java:748)
<console>:14:error:not Found:value Spark
Import Spark.implicits._
^
<console>:14:error:not Found:value Spark
Import Spark.sql
^
Solution: This is because IP does not correspond to host name
sudo vim/etc/hosts
Intranet IP (which is obtained through IFCONFIG) hostname
Save to exit
Spark-shell Boot Error