Hadoop Yarn Core Concepts

The fundamental idea of YARN was to split the major responsibilities of the Jobtracker-that are, resource management and Job Scheduling/monitoring-into Separate

DAEMONS:A Global ResourceManager and a per-application applicationmaster (AM).

The ResourceManager and Per-node Slave, the NodeManager (NM), form the new,

and generic,operating system for managing applications in a distributed manner.

The NodeManager is the Per-machine slave, which are responsible for launching the

Applications ' containers, monitoring their resource usage (CPU, memory, disk, network), and reporting the same to the Reso Urcemanager.

The applicationmaster is, in effect, an instanceof a framework-specific Libraryand are responsible for negotiating resource s from the ResourceManager and working with the NodeManager (s) to

Execute and monitor the containers and their resource consumption. It has the responsibility of negotiating for appropriate resource containers from the ResourceManager,

Tracking their status, and monitoring progress.

Hadoop Yarn Core Concepts