Spark API programming Hands-on-01-Spark API Live map, filter and collect in native mode

First Test the spark API in Spark's native mode and run Spark-shell as Local:

Let's start with the parallelize:

Results after map operation:

Below is a look at the filter operation:

Filter execution Results:

We use the most authentic Scala functional style of programming:

Execution Result:

As you can see from the results, the results are the same as that of the previous step.

But in this way, the style of the compound Scala is the same as the application style of spark, in the spark programming, most of the functions are implemented as long as one line of code is complete.

Spark API programming Hands-on-01-Spark API Live map, filter and collect in native mode