Tencent cloud released the upgraded version of CDW Clickhouse to provide a fast experience for massive data real-time analysis scenarios

6 month 28 Japan , Tencent cloud launched a newly upgraded fully managed data warehouse product CDW-ClickHouse, This version is the first to fill in the native ClickHouse There is no technology gap for subsequent capacity expansion , Comparison Hadoop The ecosystem has as high as 10 Times and even 100 Times performance improvement , Support millisecond response of trillion scale data , It can provide users with an extremely fast experience in the scene of massive data real-time analysis .

At this stage , Thousands of banks and businesses are actively using big data capabilities for digital upgrading , This also puts forward higher requirements for big data technology . However, the current technology is generally difficult to apply 、 The high cost 、 Low efficiency challenge , Such as the traditional Hadoop There is flow batch separation in the ecosystem 、 The structure is bloated 、 It's hard to maintain , Popular in recent years ClickHouse Although in terms of performance Hadoop A big increase , But the enterprise is building and using itself ClickHouse There is still data imbalance after capacity expansion and contraction 、 Operation and maintenance is very difficult 、 Low stability pain points .

Regarding this , Ma Wenbo, head of Tencent cloud data warehouse, said ,“ The simple and easy-to-use cloud data warehouse is favored by more and more customers , Enterprises are more inclined to use cloud data warehouse to complete real-time analysis of massive data . Tencent cloud CDW ClickHouse Release , It will provide customers from all walks of life with ultra-low cost 、 Extreme data analysis performance .

Take a music platform as an example , As a key music streaming media platform in China , It carries trillions of new data every day ,PB Level data analysis services . To cope with the accelerated development of business , This customer is based on CDW ClickHouse Built high availability 、 Low latency real-time analysis and calculation visualization platform , Greatly improve the daily access capability of real-time data , The average delay of the real-time link is reduced by 10 Seconds , Greatly improve the timeliness of data analysis , Thus, a basic real-time data agile analysis platform is built , Self help is realized OLAP analysis .

According to introducing , Previously, the user was self building ClickHouse Encountered data imbalance after capacity expansion in the attempt of 、 Difficult problems such as heavy workload of metadata reconstruction , use CDW ClickHouse after , The O & M personnel can automatically synchronize metadata to the new node when expanding capacity , The manual creation operation is omitted , And ensure that the query performance is not affected . meanwhile , The operation and maintenance personnel can also initiate data redistribution according to business needs , Real time control of redistribution speed , Even cancel the task . Based on these two core competencies , Tencent cloud CDW ClickHouse To help the music platform comprehensively improve the usability and process efficiency of big data analysis .

Compared with traditional warehouse products , Tencent cloud CDW ClickHouse It can also effectively help enterprises reduce costs and increase efficiency . Take a national application as an example , To meet the challenge of massive business forms to data analysis , The customer is in 2020 At the end of the year, I tried to build a small-scale self construction ClickHouse, But the data access is slow 、 Poor stability and other challenges , Use CDW ClickHouse after , Stability and performance have been greatly improved , Than the overall performance Hadoop The maximum performance of the cluster has been improved by nearly 100 times . and 2022 year CDW ClickHouse  The use of cloud native elastic version , It also solves the problem of calculating the peak and valley demand of resources in data analysis , By realizing the second level time-sharing flexibility  , The idle offline computing resources in the daytime are scheduled to cope with the online analysis business in the daytime peak , Improve the resource utilization of the whole system , Achieve cost reduction and efficiency improvement .

Ma Wenbo concluded that ,CDW ClickHouse The upgraded version is not only in performance 、 Supporting functions 、 Operation and maintenance provide better product experience , At the same time, its cluster reliability 、 Calculation node type 、 Advantages in storage type, etc , It also provides users with a wealth of choices . Tencent cloud expects to pass CDW ClickHouse, Provide leading big data analysis services for the increasingly extensive business scenarios of enterprises , So as to promote the enterprise to reduce cost, increase efficiency and business innovation and growth .