<spark> error: View process after initiating spark, master and worker process conflict in process

Source: Internet
Author: User

After starting Hadoop and then starting Spark JPS, the master process and worker process are found to be present, and a half-day configuration file is debugged.

The test found that when I shut down Hadoop the worker process still exists,

However, when I shut down spark again and then JPS, I found that the worker process still exists.

Then remembered in the ~/spark/conf/slaves configuration of slave1 slave2 above also has a localhost, directly delete localhost, and then Kill-s 9 worker process.

The first Test solved the error, but do not know whether it is temporary, if the problem is still unresolved or there is a better solution, please tell me.

<spark> error: View process after initiating spark, master and worker process conflict in process

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.