当前位置：网站首页>记录一次spark on yarn 任务报错 Operation category READ is not supported in state standby
记录一次spark on yarn 任务报错 Operation category READ is not supported in state standby
2022-07-01 21:45:00 【健忘主义】
根本原因
Operation category READ is not supported in state standby
spark任务重checkpoint的hdfs路径把namenode写死了,hadoop namenode切换后就会报错.
过程中获得的其他知识
spark从hadoop配置中得到nn1,nn2两个namenode 他会一个个尝试 直到找到可用的,也就是说 如果第一次尝试的恰好是standby节点,那么就会显示该信息,但是并不会影响他继续尝试到正常的namenode节点.
但是 如果你写死ip在checkpoint中就会有问题.
边栏推荐
- AirServer2022最新版功能介绍及下载
- [NOIP2013]积木大赛 [NOIP2018]道路铺设 贪心/差分
- 测试撤销1
- Recent public ancestor (LCA) online practices
- Simple interactive operation of electron learning (III)
- 焱融看 ｜ 混合云时代下，如何制定多云策略
- 【直播回顾】战码先锋首期8节直播完美落幕，下期敬请期待！
- A debugging to understand the slot mechanism of redis cluster
- 信标委云原生专题组组长，任重道远！
- Using closures to switch toggle by clicking a button
猜你喜欢
Sonic cloud real machine learning summary 6 - 1.4.1 server and agent deployment
BlocProvider 为什么感觉和 Provider 很相似？
Recent public ancestor (LCA) online practices
业务可视化-让你的流程图'Run'起来
对象内存布局
13th Blue Bridge Cup group B national tournament
What is the difference between PMP and NPDP?
Microsoft, Columbia University | Godel: large scale pre training of goal oriented dialogue
【juc学习之路第9天】屏障衍生工具
从零开始学 MySQL —数据库和数据表操作
随机推荐
Copy ‘XXXX‘ to effectively final temp variable
基于LSTM模型实现新闻分类
详解Volatile关键字
＃yyds干货盘点＃ 解决名企真题：扭蛋机
What is the difference between consonants and Initials? (difference between initials and consonants)
Icml2022 | interventional contrastive learning based on meta semantic regularization
Make a three digit number of all daffodils "recommended collection"
Burpsuite simple packet capturing tutorial [easy to understand]
Recent public ancestor (LCA) online practices
Classify boost libraries by function
Introduction and download of the latest version of airserver2022
MQ learning notes
linux下清理系统缓存并释放内存
MySQL清空表数据
linux下清理系统缓存并释放内存
小 P 周刊 Vol.11
Mask wearing detection method based on yolov5
信标委云原生专题组组长，任重道远！
PHP reflective XSS, reflective XSS test and repair
Which securities company should we choose to open an account for flush stock? Is it safe to open an account with a mobile phone?