[untitled] JDBC connection database read timeout

1、 background

When you encounter something at work, please record it by the way , Use when there is a large amount of data jdbc Connecting to the database will cause a read timeout when the actual read time exceeds the set read time . At that time, the customer environment data was hundreds of millions of data , Use jdbc Connect to the corresponding database （ All corresponding data will be submitted to spark Middle computation , It takes too long ） Monitor the data quality of the corresponding table , At this time, the reading time exceeds the set value, and the following error is thrown

2、 Use scenarios

In order to solve the above problems , Prepare to extend the connection time setting , When reading the source code, I found jdbc The set connection is the global time , As a result, the connection time of the driver in other places will be loaded into the connection time of the current driver （ Make complaints JDBC The timeout is global operation ）



Because it's using hive Connection driver

Get into HiveConnection You will find that the global time is called


This will cause my calculations in other places to change to the currently set connection time

3、 terms of settlement

The current solution is to extend the overall connection time （ Lead one to start the whole body ）

notes ： I hope the big guy I read has a good solution to discuss （ Can't change JDBC The premise of connection ）