Worker cannot start in spark build (failed to launch Org.apache.spark.deploy.worker.worker)

Source: Internet
Author: User
Tags log4j

Worker cannot start in spark build (failed to launch Org.apache.spark.deploy.worker.worker)


[Email protected] spark-1.5.0]$./sbin/start-all.sh

Starting Org.apache.spark.deploy.master.Master, logging to/srv/spark-1.5.0/sbin/. /logs/spark-dyq-org.apache.spark.deploy.master.master-1-master.out

Slave2:starting Org.apache.spark.deploy.worker.Worker, logging to/srv/spark-1.5.0/sbin/. /logs/spark-dyq-org.apache.spark.deploy.worker.worker-1-slave2.out

Slave1:starting Org.apache.spark.deploy.worker.Worker, logging to/srv/spark-1.5.0/sbin/. /logs/spark-dyq-org.apache.spark.deploy.worker.worker-1-slave1.out

Slave2:failed to launch Org.apache.spark.deploy.worker.Worker:

Slave1:failed to launch Org.apache.spark.deploy.worker.Worker:

Slave1:full log in/srv/spark-1.5.0/sbin/. /logs/spark-dyq-org.apache.spark.deploy.worker.worker-1-slave1.out

Slave2:full log in/srv/spark-1.5.0/sbin/. /logs/spark-dyq-org.apache.spark.deploy.worker.worker-1-slave2.out


What's the reason?

Master Machine


Spark Command:/srv/jdk1.7.0_79/bin/java-cp/srv/spark-1.5.0/sbin/. /conf/:/srv/spark-1.5.0/lib/spark-assembly-1.5.0-hadoop2.6.0.jar:/srv/spark-1.5.0/lib/ datanucleus-core-3.2.10.jar:/srv/spark-1.5.0/lib/datanucleus-api-jdo-3.2.6.jar:/srv/spark-1.5.0/lib/ datanucleus-rdbms-3.2.9.jar-xms1g-xmx1g-xx:maxpermsize=256m Org.apache.spark.deploy.master.Master--ip 192.168.0.100--port 7077--webui-port 8080

========================================

Using Spark ' s default log4j profile:org/apache/spark/log4j-defaults.properties

16/07/19 09:11:23 INFO master:registered signal handlers for [term, HUP, INT]

16/07/19 09:11:47 WARN nativecodeloader:unable to load Native-hadoop library for your platform ... using Builtin-java clas SES where applicable

16/07/19 09:12:08 INFO securitymanager:changing View ACLs To:dyq

16/07/19 09:12:08 INFO securitymanager:changing Modify ACLs To:dyq

16/07/19 09:12:08 INFO SecurityManager:SecurityManager:authentication disabled; UI ACLs Disabled; Users with View Permissions:set (DYQ); Users with Modify Permissions:set (DYQ)

16/07/19 09:13:45 INFO Slf4jlogger:slf4jlogger started

16/07/19 09:13:56 INFO remoting:starting Remoting

Exception in thread "main" Java.util.concurrent.TimeoutException:Futures timed out after [10000 milliseconds]


On the Slave machine:

Spark Command:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.65-3.b17.el7.x86_64/jre/bin/java-cp/srv/spark-1.5.0/sbin/. /conf/:/srv/spark-1.5.0/lib/spark-assembly-1.5.0-hadoop2.6.0.jar:/srv/spark-1.5.0/lib/ datanucleus-core-3.2.10.jar:/srv/spark-1.5.0/lib/datanucleus-api-jdo-3.2.6.jar:/srv/spark-1.5.0/lib/ datanucleus-rdbms-3.2.9.jar-xms1g-xmx1g org.apache.spark.deploy.worker.Worker--webui-port 8081 spark:// 192.168.0.100:7077

========================================

Caused by: [Deny connection:/192.168.0.100:7077]

Worker cannot start in spark build (failed to launch Org.apache.spark.deploy.worker.worker)

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.