Worker cannot start in spark build (failed to launch Org.apache.spark.deploy.worker.worker)
[Email protected] spark-1.5.0]$./sbin/start-all.sh
Starting Org.apache.spark.deploy.master.Master, logging to/srv/spark-1.5.0/sbin/. /logs/spark-dyq-org.apache.spark.deploy.master.master-1-master.out
Slave2:starting Org.apache.spark.deploy.worker.Worker, logging to/srv/spark-1.5.0/sbin/. /logs/spark-dyq-org.apache.spark.deploy.worker.worker-1-slave2.out
Slave1:starting Org.apache.spark.deploy.worker.Worker, logging to/srv/spark-1.5.0/sbin/. /logs/spark-dyq-org.apache.spark.deploy.worker.worker-1-slave1.out
Slave2:failed to launch Org.apache.spark.deploy.worker.Worker:
Slave1:failed to launch Org.apache.spark.deploy.worker.Worker:
Slave1:full log in/srv/spark-1.5.0/sbin/. /logs/spark-dyq-org.apache.spark.deploy.worker.worker-1-slave1.out
Slave2:full log in/srv/spark-1.5.0/sbin/. /logs/spark-dyq-org.apache.spark.deploy.worker.worker-1-slave2.out
What's the reason?
Master Machine
Spark Command:/srv/jdk1.7.0_79/bin/java-cp/srv/spark-1.5.0/sbin/. /conf/:/srv/spark-1.5.0/lib/spark-assembly-1.5.0-hadoop2.6.0.jar:/srv/spark-1.5.0/lib/ datanucleus-core-3.2.10.jar:/srv/spark-1.5.0/lib/datanucleus-api-jdo-3.2.6.jar:/srv/spark-1.5.0/lib/ datanucleus-rdbms-3.2.9.jar-xms1g-xmx1g-xx:maxpermsize=256m Org.apache.spark.deploy.master.Master--ip 192.168.0.100--port 7077--webui-port 8080
========================================
Using Spark ' s default log4j profile:org/apache/spark/log4j-defaults.properties
16/07/19 09:11:23 INFO master:registered signal handlers for [term, HUP, INT]
16/07/19 09:11:47 WARN nativecodeloader:unable to load Native-hadoop library for your platform ... using Builtin-java clas SES where applicable
16/07/19 09:12:08 INFO securitymanager:changing View ACLs To:dyq
16/07/19 09:12:08 INFO securitymanager:changing Modify ACLs To:dyq
16/07/19 09:12:08 INFO SecurityManager:SecurityManager:authentication disabled; UI ACLs Disabled; Users with View Permissions:set (DYQ); Users with Modify Permissions:set (DYQ)
16/07/19 09:13:45 INFO Slf4jlogger:slf4jlogger started
16/07/19 09:13:56 INFO remoting:starting Remoting
Exception in thread "main" Java.util.concurrent.TimeoutException:Futures timed out after [10000 milliseconds]
On the Slave machine:
Spark Command:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-3.b17.el7.x86_64/jre/bin/java-cp/srv/spark-1.5.0/sbin/. /conf/:/srv/spark-1.5.0/lib/spark-assembly-1.5.0-hadoop2.6.0.jar:/srv/spark-1.5.0/lib/ datanucleus-core-3.2.10.jar:/srv/spark-1.5.0/lib/datanucleus-api-jdo-3.2.6.jar:/srv/spark-1.5.0/lib/ datanucleus-rdbms-3.2.9.jar-xms1g-xmx1g org.apache.spark.deploy.worker.Worker--webui-port 8081 spark:// 192.168.0.100:7077
========================================
Caused by: [Deny connection:/192.168.0.100:7077]
Worker cannot start in spark build (failed to launch Org.apache.spark.deploy.worker.worker)