Original address
本系列内容适用范围：* 2015.12.05 update, Spark 1.6 全系列 √ (1.6.0-preview，尚未正式发布)* 2015.11.09 update, Spark 1.5 全系列 √ (1.5.0, 1.5.1, 1.5.2)* 2015.07.15 update, Spark 1.4 全系列 √ (1.4.0, 1.4.1)* 2015.04.17 update, Spark 1.3 全系列 √ (1.3.0, 1.3.1)
- Overview
- 0.1 Spark streaming implementation ideas and modules overview
- module 1:dag static definition
- 1.1 DStream, Dstreamgraph detailed
- 1.2 DStream generate an RDD instance detailed
- Module 2:job Dynamic Generation
- 2.1 Jobscheduler, Job, Jobset detailed
- 2.2 Jobgenerator Detailed
- Module 3: Data generation and import
- 3.1 Receiver Distribution Detailed
- 3.2 Receiver, Receiversupervisor, Blockgenerator, Receivedblockhandler
- 3.3 Receivertraker, Receivedblocktracker detailed
- Module 4: Long-time fault tolerance
预计 12.134.1 Executor long-time fault-tolerant explanation预计 12.134.2 Driver long-time fault-tolerant explanation
- StreamingContext
预计 12.205.1 StreamingContext Detailed
Spark Streaming Source Detailed
