当前位置：网站首页>记录一次spark on yarn 任务报错 Operation category READ is not supported in state standby
记录一次spark on yarn 任务报错 Operation category READ is not supported in state standby
2022-07-01 21:45:00 【健忘主义】
根本原因
Operation category READ is not supported in state standby
spark任务重checkpoint的hdfs路径把namenode写死了,hadoop namenode切换后就会报错.
过程中获得的其他知识
spark从hadoop配置中得到nn1,nn2两个namenode 他会一个个尝试 直到找到可用的,也就是说 如果第一次尝试的恰好是standby节点,那么就会显示该信息,但是并不会影响他继续尝试到正常的namenode节点.
但是 如果你写死ip在checkpoint中就会有问题.
边栏推荐
- 基于LSTM模型实现新闻分类
- Interview question: what is the difference between MySQL's Union all and union, and how many join methods MySQL has (Alibaba interview question) [easy to understand]
- linux下清理系统缓存并释放内存
- News classification based on LSTM model
- Recent public ancestor (LCA) online practices
- 手动实现function isInstanceOf(child,Parent)
- Basic operation of binary tree
- Redis配置与优化
- [intelligent QBD risk assessment tool] Shanghai daoning brings you leanqbd introduction, trial and tutorial
- linux下清理系统缓存并释放内存
猜你喜欢
上半年暂停考试要补考？包含监理工程师、建筑师等十项考试
Application of real estate management based on 3D GIS
pytest合集（2）— pytest運行方式
黑马程序员-软件测试--06阶段2-linux和数据库-01-08第一章-linux操作系统阶段内容说明，linux命令基本格式以及常见形式的说明，操作系统的常见的分类，查看命令帮助信息方法，
![快乐数[环类问题之快慢指针]](/img/37/5c94b9b062a54067a50918f94e61ea.png)
快乐数[环类问题之快慢指针]
What is the difference between PMP and NPDP?
Chapter 9 Yunji datacanvas company has been ranked top 3 in China's machine learning platform market
Flume interview questions
91.（cesium篇）cesium火箭发射模拟
Basic knowledge of ngnix
随机推荐
Introduction and download of the latest version of airserver2022
pytest合集（2）— pytest运行方式
【MySQL】索引的创建、查看和删除
Difference and use between require and import
Several ways of writing main function in C
微信小程序，连续播放多段视频。合成一个视频的样子，自定义视频进度条
The leader of the cloud native theme group of beacon Committee has a long way to go!
Can I choose to open an account for stock trading on flush? Is it safe?
Do you want to make up for the suspended examination in the first half of the year? Including ten examinations for supervision engineers, architects, etc
黑马程序员-软件测试--06阶段2-linux和数据库-01-08第一章-linux操作系统阶段内容说明，linux命令基本格式以及常见形式的说明，操作系统的常见的分类，查看命令帮助信息方法，
Internet of things RFID, etc
JS how to get a list of elements in a collection object
MySQL系列之事务日志Redo log学习笔记
Classify boost libraries by function
详解JMM
mysql 学习笔记-优化之SQL优化
Go - exe corresponding to related dependency
[deep learning] use deep learning to monitor your girlfriend's wechat chat?
【直播回顾】战码先锋首期8节直播完美落幕，下期敬请期待！
《QTreeView+QAbstractItemModel自定义模型》：系列教程之三[通俗易懂]