当前位置：网站首页>记录一次spark on yarn 任务报错 Operation category READ is not supported in state standby
记录一次spark on yarn 任务报错 Operation category READ is not supported in state standby
2022-07-01 21:45:00 【健忘主义】
根本原因
Operation category READ is not supported in state standby
spark任务重checkpoint的hdfs路径把namenode写死了,hadoop namenode切换后就会报错.
过程中获得的其他知识
spark从hadoop配置中得到nn1,nn2两个namenode 他会一个个尝试 直到找到可用的,也就是说 如果第一次尝试的恰好是standby节点,那么就会显示该信息,但是并不会影响他继续尝试到正常的namenode节点.
但是 如果你写死ip在checkpoint中就会有问题.
边栏推荐
- Case of camera opening by tour
- [STM32] stm32cubemx tutorial II - basic use (new projects light up LED lights)
- MySQL series transaction log redo log learning notes
- [NOIP2013]积木大赛 [NOIP2018]道路铺设 贪心/差分
- Fundamentals - IO intensive computing and CPU intensive computing
- mysql 学习笔记-优化之SQL优化
- 基础—io密集型计算和cpu密集型计算
- Do you want to make up for the suspended examination in the first half of the year? Including ten examinations for supervision engineers, architects, etc
- Sonic cloud real machine learning summary 6 - 1.4.1 server and agent deployment
- 从零开始学 MySQL —数据库和数据表操作
猜你喜欢
Copy ‘XXXX‘ to effectively final temp variable
News classification based on LSTM model
Mask wearing detection method based on yolov5
AirServer2022最新版功能介绍及下载
Little p weekly Vol.11
Sonic云真机学习总结6 - 1.4.1服务端、agent端部署
plantuml介绍与使用
从MLPerf谈起：如何引领AI加速器的下一波浪潮
微软、哥伦比亚大学|GODEL：目标导向对话的大规模预训练
CIO's discussion and Analysis on the definition of high-performance it team
随机推荐
Mask wearing detection method based on yolov5
Sonic cloud real machine learning summary 6 - 1.4.1 server and agent deployment
微软、哥伦比亚大学|GODEL：目标导向对话的大规模预训练
Communication between browser tab pages
[intelligent QBD risk assessment tool] Shanghai daoning brings you leanqbd introduction, trial and tutorial
One of the basic learning of function
Basic operation of binary tree
Microsoft, Columbia University | Godel: large scale pre training of goal oriented dialogue
[deep learning] use deep learning to monitor your girlfriend's wechat chat?
完全注解的ssm框架搭建
Interview question: what is the difference between MySQL's Union all and union, and how many join methods MySQL has (Alibaba interview question) [easy to understand]
Recent public ancestor offline practice (tarjan)
What is the difference between consonants and Initials? (difference between initials and consonants)
Separate the letters and numbers in the string so that the letters come first and the array comes last
Pytest Collection (2) - mode de fonctionnement pytest
【MySQL】explain的基本使用以及各列的作用
【juc学习之路第8天】Condition
mysql 学习笔记-优化之SQL优化
Unity 使用Sqlite
Difference and use between require and import