当前位置:网站首页>Logstash+jdbc data synchronization +head display problems
Logstash+jdbc data synchronization +head display problems
2022-07-03 09:23:00 【Great you don't know】
Have a problem
- head UI Show only one piece of data , The index cannot be filtered
- reason : document_id => “%{user_id}” in user_id The reference tutorial has not been changed
- solve : According to its own primary key, it is changed into an object %{ The primary key of your own table }
- follow-up : What if multiple tables are synchronized ? - When the synchronization sql_last_value Has always been a 0, see logstash_jdbc_last_run And indeed 0
- reason : use_column_value=> false Is the default value , The reference tutorial is set to true
- solve : shielding use_column_value=> true - Example synchronization file :
input{
jdbc {
# jdbc_driver_library => "mysql-connector-java-5.1.44-bin.jar"
# drive
jdbc_driver_library => "/usr/local/soft/logstash-input-jdbc-master/lib/mysqljdbc-5.1.18.jar"
jdbc_driver_class => "com.mysql.jdbc.Driver"
jdbc_connection_string => "jdbc:mysql://172.16.0.178:3308/mtp_dev"
jdbc_user => "mtp_dev"
jdbc_password => "mtp_dev"
jdbc_paging_enabled => "true"
jdbc_page_size => "1000"
jdbc_default_timezone =>"Asia/Shanghai"
schedule => "* * * * *"
statement => "SELECT * FROM user_sys_user where latest_time > :sql_last_value"
# record_last_run => true
# use_column_value=> false
tracking_column => "latest_time"
last_run_metadata_path => "./logstash_jdbc_last_run"
clean_run => "false"
}
}
output{
elasticsearch {
hosts => "172.16.0.94:9200"
user => "elastic"
password => "changme"
index => "sys_user"
document_id => "%{user_id}"
}
stdout {
codec => json_lines
}
}
边栏推荐
- Basic knowledge of network security
- State compression DP acwing 91 Shortest Hamilton path
- 常见渗透测试靶场
- LeetCode 515. Find the maximum value in each tree row
- [untitled] use of cmake
- Go language - IO project
- 【点云处理之论文狂读经典版8】—— O-CNN: Octree-based Convolutional Neural Networks for 3D Shape Analysis
- Crawler career from scratch (I): crawl the photos of my little sister ① (the website has been disabled)
- [point cloud processing paper crazy reading frontier version 8] - pointview gcn: 3D shape classification with multi view point clouds
- 推荐一个 yyds 的低代码开源项目
猜你喜欢

【点云处理之论文狂读经典版9】—— Pointwise Convolutional Neural Networks

IDEA 中使用 Hudi

Crawler career from scratch (IV): climb the bullet curtain of station B through API

Install third-party libraries such as Jieba under Anaconda pytorch

【Kotlin学习】高阶函数的控制流——lambda的返回语句和匿名函数

Basic knowledge of network security

NPM install installation dependency package error reporting solution

Recommend a low code open source project of yyds
![[point cloud processing paper crazy reading classic version 8] - o-cnn: octree based revolutionary neural networks for 3D shape analysis](/img/fa/36d28b754a9f380bfd86d4562268c3.png)
[point cloud processing paper crazy reading classic version 8] - o-cnn: octree based revolutionary neural networks for 3D shape analysis

【点云处理之论文狂读经典版11】—— Mining Point Cloud Local Structures by Kernel Correlation and Graph Pooling
随机推荐
网络安全必会的基础知识
传统企业数字化转型需要经过哪几个阶段?
Explanation of the answers to the three questions
LeetCode 30. Concatenate substrings of all words
[point cloud processing paper crazy reading frontier edition 13] - gapnet: graph attention based point neural network for exploring local feature
[kotlin learning] operator overloading and other conventions -- overloading the conventions of arithmetic operators, comparison operators, sets and intervals
低代码起势,这款信息管理系统开发神器,你值得拥有!
【毕业季|进击的技术er】又到一年毕业季,一毕业就转行,从动物科学到程序员,10年程序员有话说
[point cloud processing paper crazy reading cutting-edge version 12] - adaptive graph revolution for point cloud analysis
Computing level network notes
Vs2019 configuration opencv3 detailed graphic tutorial and implementation of test code
excel一小时不如JNPF表单3分钟,这样做报表,领导都得点赞!
Internet Protocol learning record
Sword finger offer II 091 Paint the house
Go language - Reflection
【点云处理之论文狂读经典版13】—— Adaptive Graph Convolutional Neural Networks
Temper cattle ranking problem
Solve POM in idea Comment top line problem in XML file
LeetCode 1089. Duplicate zero
AcWing 786. 第k个数