当前位置:网站首页>The role of applicationmaster in spark on Yan's cluster mode

The role of applicationmaster in spark on Yan's cluster mode

2022-07-06 21:37:00 Big data Xiaochen

Why? Spark On Yarn Through ApplicationMaster Whereabouts ResourceManager Apply to start Executors, Not through Driver To do these things ?

  • Because in standalone In cluster mode ,Driver towards Master apply Worker Resources for starting Executor, And the same , stay Yarn In cluster mode ,Spark The application needs to ResourceManager apply NodeManager Resources for starting Executor, This responsibility can make ApplicationMaster To do , Rather than let Driver To do , It can make Driver More relaxed , Achieve decoupling .

原网站

版权声明
本文为[Big data Xiaochen]所创,转载请带上原文链接,感谢
https://yzsam.com/2022/02/202202131122070968.html