Spark on yarn's job submission process

1.Spark On YARN The main process of the project ：

1.SparkSubmit
2.ResourceManager
3.NodeManager
4.Executor
5.ApplicationMaster

2. Execute the process

1. The client wants to YARN Of resourceManager Submit the application
2.ResourceManager Upon receipt of the request , Select a NodeManager The node assigns a Container, And in Container Start in ApplicationMaster,ApplicationMaster Contained in the SparkContext The initialization .
3.ApplicationMaster Want to ResourceManager apply Container.ResourceManager Upon receipt of the request , towards ApplicationMaster Distribute Container.
4.ApplicationMaster request NodeManager,NodeManager In the Container Start in Executor
5.Executor After starting , towards ApplicationMaster Of Driver Medium SparkContext Register and apply for Task
6.Executor Get in Task after , Start execution Task, And to SparkContext Report implementation status and progress and other information