Spark Configuration (4)-----Spark streaming

Spark Streaming

Spark streaming uses the spark API for streaming calculations, which means that streaming and batching are done on spark. So you can reuse batch code, build powerful interactive applications using Spark streaming, and not just analyze data.

Spark Streaming Example (stream-based word count) to demonstrate spark streaming: The local server receives text data over TCP and outputs word statistics in real time.

  
 

   
  

  
nc -l -p 9999
   
  

  

   
  

  
# 需要另外开启一个终端，记为终端 2，然后运行如下命令
   
  

  

   
  

  
/usr/local/spark/bin/run-example streaming.NetworkWordCount localhost 9999
  
 

Input text in Terminal 1, in the Terminal 2 can be seen in real-time word statistics results.

Reference reprinted from: http://www.powerxing.com/spark-quick-start-guide/

From for notes (Wiz)

Spark Configuration (4)-----Spark streaming