Using IntelliJ idea to write Scala running in spark

Write a test code using Scala:

Object= {println ("helloWorld")      }}

Consider this test as a class, the project organization structure such as:

Then set the compile options:

The compiled jar package can then be found under the project folder:

Copied to the directory specified by Spark (built by yourself):

Start Spark, and then submit the task:

Spark-submit--class Test--master Spark://Localhost:7077/home/data/myjar/hello.jar

You can see the output information of execution from the console above, and we can also view the task information in the Web Manager:

The next thing left is to write the Scala program to implement its own algorithm.

Using IntelliJ idea to write Scala running in spark