当前位置:网站首页>Logstash+jdbc data synchronization +head display problems
Logstash+jdbc data synchronization +head display problems
2022-07-03 09:23:00 【Great you don't know】
Have a problem
- head UI Show only one piece of data , The index cannot be filtered
- reason : document_id => “%{user_id}” in user_id The reference tutorial has not been changed
- solve : According to its own primary key, it is changed into an object %{ The primary key of your own table }
- follow-up : What if multiple tables are synchronized ? - When the synchronization sql_last_value Has always been a 0, see logstash_jdbc_last_run And indeed 0
- reason : use_column_value=> false Is the default value , The reference tutorial is set to true
- solve : shielding use_column_value=> true - Example synchronization file :
input{
jdbc {
# jdbc_driver_library => "mysql-connector-java-5.1.44-bin.jar"
# drive
jdbc_driver_library => "/usr/local/soft/logstash-input-jdbc-master/lib/mysqljdbc-5.1.18.jar"
jdbc_driver_class => "com.mysql.jdbc.Driver"
jdbc_connection_string => "jdbc:mysql://172.16.0.178:3308/mtp_dev"
jdbc_user => "mtp_dev"
jdbc_password => "mtp_dev"
jdbc_paging_enabled => "true"
jdbc_page_size => "1000"
jdbc_default_timezone =>"Asia/Shanghai"
schedule => "* * * * *"
statement => "SELECT * FROM user_sys_user where latest_time > :sql_last_value"
# record_last_run => true
# use_column_value=> false
tracking_column => "latest_time"
last_run_metadata_path => "./logstash_jdbc_last_run"
clean_run => "false"
}
}
output{
elasticsearch {
hosts => "172.16.0.94:9200"
user => "elastic"
password => "changme"
index => "sys_user"
document_id => "%{user_id}"
}
stdout {
codec => json_lines
}
}
边栏推荐
- [point cloud processing paper crazy reading classic version 8] - o-cnn: octree based revolutionary neural networks for 3D shape analysis
- IDEA 中使用 Hudi
- [kotlin learning] classes, objects and interfaces - define class inheritance structure
- 【点云处理之论文狂读经典版10】—— PointCNN: Convolution On X-Transformed Points
- [kotlin learning] operator overloading and other conventions -- overloading the conventions of arithmetic operators, comparison operators, sets and intervals
- [set theory] order relation (chain | anti chain | chain and anti chain example | chain and anti chain theorem | chain and anti chain inference | good order relation)
- What is an excellent fast development framework like?
- Digital management medium + low code, jnpf opens a new engine for enterprise digital transformation
- On a un nom en commun, maître XX.
- 2022-2-13 learning the imitation Niuke project - home page of the development community
猜你喜欢

【点云处理之论文狂读前沿版11】—— Unsupervised Point Cloud Pre-training via Occlusion Completion
![[set theory] order relation (chain | anti chain | chain and anti chain example | chain and anti chain theorem | chain and anti chain inference | good order relation)](/img/fd/c0f885cdd17f1d13fdbc71b2aea641.jpg)
[set theory] order relation (chain | anti chain | chain and anti chain example | chain and anti chain theorem | chain and anti chain inference | good order relation)

The "booster" of traditional office mode, Building OA office system, was so simple!

2022-2-13 learning the imitation Niuke project - home page of the development community
![[kotlin learning] operator overloading and other conventions -- overloading the conventions of arithmetic operators, comparison operators, sets and intervals](/img/8d/938e232c1016cabe9ee0f72be87a22.png)
[kotlin learning] operator overloading and other conventions -- overloading the conventions of arithmetic operators, comparison operators, sets and intervals

NPM install installation dependency package error reporting solution

【点云处理之论文狂读经典版10】—— PointCNN: Convolution On X-Transformed Points

LeetCode 508. 出现次数最多的子树元素和

excel一小时不如JNPF表单3分钟,这样做报表,领导都得点赞!
![[advanced feature learning on point clouds using multi resolution features and learning]](/img/f0/abed28e94eb4a95c716ab8cecffe04.png)
[advanced feature learning on point clouds using multi resolution features and learning]
随机推荐
Wonderful review | i/o extended 2022 activity dry goods sharing
STM32F103 can learning record
AcWing 785. 快速排序(模板)
Vscode编辑器右键没有Open In Default Browser选项
网络安全必会的基础知识
[point cloud processing paper crazy reading frontier version 11] - unsupervised point cloud pre training via occlusion completion
LeetCode 535. Encryption and decryption of tinyurl
State compression DP acwing 91 Shortest Hamilton path
Beego learning - JWT realizes user login and registration
剑指 Offer II 029. 排序的循环链表
Introduction to the basic application and skills of QT
【点云处理之论文狂读经典版10】—— PointCNN: Convolution On X-Transformed Points
LeetCode 438. Find all letter ectopic words in the string
【毕业季|进击的技术er】又到一年毕业季,一毕业就转行,从动物科学到程序员,10年程序员有话说
LeetCode 532. 数组中的 k-diff 数对
Jenkins learning (II) -- setting up Chinese
[point cloud processing paper crazy reading frontier version 8] - pointview gcn: 3D shape classification with multi view point clouds
On February 14, 2022, learn the imitation Niuke project - develop the registration function
Utilisation de hudi dans idea
What is an excellent fast development framework like?