当前位置:网站首页>[solution] final app status- undefined, exitcode- 16
[solution] final app status- undefined, exitcode- 16
2022-07-07 06:29:00 【Ride a snail forward】
Abnormal information
ERROR yarn.ApplicationMaster: RECEIVED SIGNAL TERM
INFO yarn.ApplicationMaster: Final app status: UNDEFINED, exitCode: 16, (reason: Shutdown hook called before final status was reported.)
INFO util.ShutdownHookManager: Shutdown hook called
My scene is :java The code uses SparkLauncher
Submit spark Mission jar Package to yarn The cluster to perform , The above exception occurred . Sui google The right way to open .
terms of settlement
- stay
${HADOOP_HOME}/etc/hadoop/yarn-site.xml
Add the following configuration :
<property>
<name>yarn.nodemanager.aux-services</name>
<value>spark_shuffle,mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.spark_shuffle.class</name>
<value>org.apache.spark.network.yarn.YarnShuffleService</value>
</property>
- see
${HADOOP_HOME}/share/yarn/lib
Is there anyspark-*-yarn-shuffle.jar
This jar package ,*
It's the version number . without , hold spark Corresponding jar Copy the package to this directory :
cd ${HADOOP_HOME}/share/yarn/lib
cp ${SPARK_HOME}/yarn/spark-2.4.8-yarn-shuffle.jar ./
- restart yarn.
cd ${HADOOP_HOME}
./sbin/stop-yarn.sh
./sbin/start-yarn.sh
边栏推荐
- 基本Dos命令
- Haqi projection Black Horse posture, avec seulement six mois de forte pénétration du marché des projecteurs de 1000 yuans!
- tkinter窗口选择pcd文件并显示点云(open3d)
- JMeter function assistant - random value, random string, fixed value random extraction
- string(讲解)
- Redis (II) - redis General Command
- QT console output in GUI applications- Console output in a Qt GUI app?
- C语言整理(待更新)
- 【GNN】图解GNN: A gentle introduction(含视频)
- MySQL的安装
猜你喜欢
laravel 使用腾讯云 COS5全教程
博士申请 | 上海交通大学自然科学研究院洪亮教授招收深度学习方向博士生
字符串常量与字符串对象分配内存时的区别
Haqi projection Black Horse posture, avec seulement six mois de forte pénétration du marché des projecteurs de 1000 yuans!
屏幕程序用串口无法调试情况
JMeter's own functions are not enough? Why don't you develop one yourself
软件测试到了35岁,真的就干不动了吗?
Common problems of caching in high concurrency scenarios
HKUST & MsrA new research: on image to image conversion, fine tuning is all you need
Ant manor safety helmet 7.8 ant manor answer
随机推荐
软件测试到了35岁,真的就干不动了吗?
如何解决数据库插入数据显示SQLSTATE[HY000]: General error: 1364 Field ‘xxxxx‘ doesn‘t have a default value错误
QT console output in GUI applications- Console output in a Qt GUI app?
FlexRay通信协议概述
生活中的开销,怎么记账合适
Ideas of high concurrency and high traffic seckill scheme
Rk3399 platform development series explanation (WiFi) 5.53, hostapd (WiFi AP mode) configuration file description
JMeter's own functions are not enough? Why don't you develop one yourself
Ant manor safety helmet 7.8 ant manor answer
【GNN】图解GNN: A gentle introduction(含视频)
谷歌 Chrome 浏览器发布 103.0.5060.114 补丁修复 0-day 漏洞
基本Dos命令
3428. Put apples
屏幕程序用串口无法调试情况
当我们谈论不可变基础设施时,我们在谈论什么
Find duplicate email addresses
Handling hardfault in RT thread
Navicat导入15G数据报错 【2013 - Lost connection to MySQL server during query】 【1153:Got a packet bigger】
UIC(组态UI工程)公版文件库新增7款行业素材
蚂蚁庄园安全头盔 7.8蚂蚁庄园答案