Spark startup problem, found that the task is running under localhost, the original boot Spark-shell need to take the main node parameters

To run an app on the spark cluster, simply pass through the master's Spark://ip:port link to the Sparkcontext constructor

Run the Interactive Spark command on the cluster and run the following command:

Master=spark://ip:port./spark-shell

Note that if you run the Spark-shell script on a spark cluster, Spark-shell will pass the SPARK_MASTER_IP and Spark_master_ under conf/spark-env.sh Port automatically sets master.

You can also pass a parameter-C <numCores> to control the number of cores that Spark-shell uses on the cluster

Spark startup problem, found that the task is running under localhost, the original boot Spark-shell need to take the main node parameters