当前位置:网站首页>File queue in Bifrost (1)
File queue in Bifrost (1)
2020-11-09 00:28:00 【Boo】
In order to solve the problem of table synchronization, set parallel synchronization , Share one Binlog Parsing thread , Because of some synchronization error and other reasons Binlog Resolve the blocking situation .
stay Bifrost v1.2.1 Version start , Bifrost Added a file queue function , When table synchronization is blocked , Auto start file queue , Does not affect Binlog analysis , It does not affect other table data synchronization .
To put it simply As long as all synchronization is fast enough , Just use the pure memory queue , As long as one synchronization fails , To make sure you make a mistake , No effect Other tables are synchronized , Current synchronization thread , A file queue that is automatically enabled .
File queues , It's a synchronization problem , To keep pace with Binlog When analyzing the speed , Automatically activated , You don't need a human interface to click to start . At present Management system interface Points provide methods Let the user click force start !
File queue configuration
# Whether to turn on the file queue function true|false
file_queue_usable=true
# Count whether the file queue is started or not , Unit millisecond
file_queue_usable_count_time_diff=5000
#file_queue_usable_count_time_diff The number of times the memory queue has been filled in time
file_queue_usable_count=10
If the configuration file_queue_usable = false , No matter what , Does not enable file queuing
By default , The file queue is in 5000ms Inside The memory queue is continuously full 10 Time , Auto start , It doesn't need any human operation in the management interface
File queues , It is started according to the synchronization configuration of the table , in other words , If a table is configured with 10 Synchronization , The first configuration synchronization is to synchronize to Redis, Syncing to Redis Synchronization is slow in synchronization , In the case of memory queue blocking , A file queue is enabled , For buffering Synchronize to the current table to Redis
版权声明
本文为[Boo]所创,转载请带上原文链接,感谢
边栏推荐
- Flink's datasource Trilogy 3: customization
- The vowels in the inverted string of leetcode
- Copy on write collection -- copyonwritearraylist
- Introduction to nmon
- APP 莫名崩溃,开始以为是 Header 中 name 大小写的锅,最后发现原来是容器的错!
- Installation record of SAP s / 4hana 2020
- Flink的DataSource三部曲之三:自定义
- 接口测试工具Eolinker进行post请求
- C + + adjacency matrix
- Tips in Android Development: requires permission android.permission write_ Settings solution
猜你喜欢
Octave基本语法
How to get started with rabbitmq
实现图片的复制
几行代码轻松实现跨系统传递 traceId,再也不用担心对不上日志了!
Web上的分享(Share)API
A few lines of code can easily transfer traceid across systems, so you don't have to worry about losing the log!
1.操作系统是干什么的?
接口测试工具Eolinker进行post请求
Introduction to nmon
App crashed inexplicably. At first, it thought it was the case of the name in the header. Finally, it was found that it was the fault of the container!
随机推荐
非阻塞的无界线程安全队列 —— ConcurrentLinkedQueue
Concurrent linked queue: a non blocking unbounded thread safe queue
老大问我:“建表为啥还设置个自增 id ?用流水号当主键不正好么?”
Five factors to consider before choosing API management platform
Factory pattern pattern pattern (simple factory, factory method, abstract factory pattern)
大数据软件学习入门技巧
Esockettimeout solution in request in nodejs
为什么需要使用API管理平台
Get the first cover image of video through canvas
C + + adjacency matrix
Chapter 5 programming
《MFC dialog中加入OpenGL窗体》
移动大数据自有网站精准营销精准获客
Linked blocking queue based on linked list
SaaS: another manifestation of platform commercialization capability
一堆代码忘了缩进?快捷方式教你无忧无虑!
Realization of file copy
Octave basic syntax
AI人工智能编程培训学什么课程?
几行代码轻松实现跨系统传递 traceId,再也不用担心对不上日志了!