当前位置:网站首页>Flink checkPoint和SavePoint
Flink checkPoint和SavePoint
2022-06-24 09:46:00 【少年鹿】
savepoint和checkpoint都是flink为容错提供的强大功能特性,能够自动或手动保存job的运行状态
两者区别
checkpoint:
应用定时触发,用户保存状态,会过期,内部应用失败重启的时候启用,但是手动cancel时,会删除之前的checkpoint
savepoint:
用户手动置顶,相当于状态的备份,可以在bin/flink cancel xx的时候调用,一般用于修改并行度,程序升级等等。
如果想要在程序停掉后重启,数据一致的情况下,强烈推荐使用cancel时做savepoint,当然如果程序中没有涉及到state,可以不用
触发savepoint
触发有2种方式:
1)直接触发===>bin/flinksavepointjobId [targetDirectory] [-yid yarnAppId] 针对yarn模式需要指定 -yid参数
2)cancel/stop时触发===> bin/flinkcancel/stop-s [targetDirectory] jobId [-yid yarnAppId]。针对yarn模式需要指定 -yid参数
Checkpoint解读
在Flink分布式计算中,容错往往是值得关注的点,Flink本身通过Checkpoint操作进行快照处理,保证job执行的稳定性以及Failover的可靠性。checkpoint不会打断stream、data-flow。

在Checkpoint中有个很关键的要素:barriers
- barrier将stream中的record划分不同的checkpoint段,barrier不会超过record,严格排在数据的后面
- 每个barrier都会携带相应的ID,来区分相应的快照snapshot(checkpoint)
- 不同checkpoint的barrier可以在stream中并行传输,意味着相同时间可以并行执行快照操作
边栏推荐
- PHP encapsulates a file upload class (supports single file and multiple file uploads)
- 涂鸦智能携多款重磅智能照明解决方案,亮相2022美国国际照明展
- 形状变化loader加载jsjs特效代码
- 包装类型与基本类型的区别
- 学习使用KindEditor富文本编辑器,点击上传图片遮罩太大或白屏解决方案
- SQL Server AVG函数取整问题
- Which of the top ten securities companies has the lowest Commission and is the safest and most reliable? Do you know anything
- numpy.linspace()
- 413-二叉树基础
- Tutorial (5.0) 08 Fortinet security architecture integration and fortixdr * fortiedr * Fortinet network security expert NSE 5
猜你喜欢

Using pandas to read SQL server data table

SQL Sever中的窗口函数row_number()rank()dense_rank()

Phpstrom code formatting settings

2.登陆退出功能开发

numpy.linspace()

SVG+js拖拽滑块圆形进度条

415 binary tree (144. preorder traversal of binary tree, 145. postorder traversal of binary tree, 94. inorder traversal of binary tree)

24. 图像拼接大作业

记录一下MySql update会锁定哪些范围的数据

微信小程序學習之 實現列錶渲染和條件渲染.
随机推荐
How to customize sharing links in wechat for H5 web pages
分布式 | 如何与 DBLE 进行“秘密通话”
dedecms模板文件讲解以及首页标签替换
H5网页如何在微信中自定义分享链接
解决Deprecated: Methods with the same name as their class will not be constructors in报错方案
Mise en œuvre du rendu de liste et du rendu conditionnel pour l'apprentissage des applets Wechat.
MYSQL数据高级
PHP uses recursive and non recursive methods to create multi-level folders
4. classification management business development
Juul, the American e-cigarette giant, suffered a disaster, and all products were forced off the shelves
2022-06-23:给定一个非负数组,任意选择数字,使累加和最大且为7的倍数,返回最大累加和。 n比较大,10的5次方。 来自美团。3.26笔试。
Troubleshooting steps for Oracle pool connection request timeout
leetCode-498: 对角线遍历
SQL Sever关于like操作符(包括字段数据自动填充空格问题)
canvas管道动画js特效
How large and medium-sized enterprises build their own monitoring system
SQL Server AVG function rounding
Is there a reliable and low commission futures account opening channel in China? Is it safe to open an account online?
Distributed | how to make "secret calls" with dble
MySQL data advanced