Hadoop&spark MapReduce Comparison & framework Design and understanding

Hadoop MapReduce:

MapReduce reads the data from disk every time it executes, and then puts the data on the disk after the calculation is complete.

Spark Map Reduce:

RDD is everything for dev:

Basic Concepts:

Graph RDD:

Spark Runtime:

Schedule

Depency Type:

Scheduler Optimizations:

Event Flow:

Submit Job:

New Job Instance:

Job in Detail:

Executor.launchtask:

Standalone:

Work Flow:

Standalone Detail:

Driver Application to Clustor:

Worker Exception:

Executor Exception:

Master Exception:

Master HA:

Hadoop&spark MapReduce Comparison & framework Design and understanding