Loading spark source code with IntelliJ

How to use IntelliJ to load spark source code

Reprint Annotated Original http://www.cnblogs.com/shenh062326/p/6189643.html

A suitable IDE editor is required to view the spark source code or to modify the spark source code, and the Spark source editor is the IntelliJ.

However, if using IntelliJ to load the spark source mode is not correct, there will be a lot of red dots, as shown, and a lot of code can not complete the jump, today I would like to show you how to use IntelliJ to load spark source code.

Loading spark code with IntelliJ

1. first download the spark code.

2. compile mvn-pyarn-dhadoop.version=2.6.0-dyarn.version=2.6.0-dskiptests-phive compile with mvn

3. after successful compilation, open IntelliJ, select File->new->project from Existing Sources.

4. Select the project directory and select Import Project from external Model->maven.

5. After selecting Next, add several items that need to be introduced in the Import Project window, such as.

6. After you have selected Next, you will need to wait for a period of time to set up index after opening the project.

7. After the completion of the effect, such as, can open all dependent jars and Class,intellij will not appear a lot of red dot!

This will be a happy code code.

Loading spark source code with IntelliJ