Make the seckill Carnival more leisurely: the database behind the promotion (Part 2)

author ： TiDB Community assistant The source of the original ：https://tidb.net/blog/b81367f8

annual 6.18 Once again, I came here , The best gift for technicians is the technical guide ！ And after years of development , The shopping festival is no longer limited to the e-commerce industry , Now all walks of life will actually use similar methods to do operational activities , There are in the automotive industry 818, Xiaomi has a rice noodle festival and so on , This poses many new challenges to the basic software including database , At the same time, many best practices have been accumulated .

PingCAP And Jingdong 、 zhongtong 、 Car home 、 Users such as e-Car launched a series of in-depth discussions , I hope to reveal what kind of technical problems are hidden behind the soaring sales year by year ？ What technical framework can be used to carry the flow peak smoothly ？ This article is 「 The database behind the promotion 」 The second part of the series , It introduces TiDB Application practice in super car Carnival .

01

How to promote as big as e-commerce giants

The ideal is full , Reality but bone .

Look around the world , Few enterprises can have the technical system and team configuration of Internet giants , But in reality, there is a real need to promote the scene , For example, car home 、 E-Car and other auto Internet platforms are promoting 818 Car Carnival ; Another example is Xiaomi Youpin as the representative of fan economy , Pass... Every year 816 Thanksgiving season activities to give back to fans and expand influence ; Ping An Life is in “ It's a good start ” Upgrade to 108 God of wealth day …… In today's emphasis on user first , Big promotion will gradually become the standard configuration of all walks of life .

One of the biggest challenges is that most enterprises do not have a large enough technical team to support the big promotion scenario . Take the car home as an example , It has worked with Hunan Satellite TV for three consecutive years to build “818 Global car night ”, This kind of live broadcast activity is more interactive 、 The variables are big , The data traffic caused by a second kill may be dozens of times as much as usual , The biggest data peak this year is as high as 40 ten thousand / Second write ; Database not only needs to solve the challenge of massive real-time transactions , It is also necessary to feed back the real-time analysis data to the on-site host , The whole process needs to be stable and reliable .

Whole “818 Global car night ” High scalability for distributed database 、 Disaster resilience 、 Cloud capabilities are extremely demanding , With the preparation of the technical team of Auto Home , Design the scheme by yourself 、 Pressure measurement 、 Optimizing and deploying online is extremely difficult in a short time . The fact proved that , Car home choice TiDB It's a wise choice , Through maturity 、 Reliable distributed database solution , as well as PingCAP The power of technical experts , So that auto home can quickly make up for the shortcomings of its own technical team , Efficiently complete the support for the big promotion scene .

>>> Check out the full version 《TiDB stay 2021 Car home “818 Global car night ” Application 》

Similarly, , As one of the earliest automotive Internet platform enterprises in China , It was last year   “818”  period , Jointly launched a comprehensive auto craft show with Zhejiang satellite TV 、 The car industry of star song and dance performances and star variety shows “ Spring Festival Gala ” ——**  “ Easy car super 818 Car carnival night ” **. Bringing audio-visual feast to car users 、 While buying car benefits , The party also launched super 150 Extra value benefits for half price cars , The audience can grab while watching the party 5 A good car for sale , At the same time, there is a red envelope for buying a car 、 Deduction voucher 、 Multiple discounts such as direct reduction of car model , Get real car purchase benefits . By the end of the party , People watching the live broadcast on the whole platform reached 2.24 Billion , Get online orders 4.39 ten thousand , Cumulative turnover （GMV）64.2 One hundred million yuan .

In the car changing 818 In Carnival , There are many database application scenarios , among Real time data Kanban Is one of the main application businesses . Kanban can display the easy car in real time 818 The theme of the car buying Festival 、 Activities 、 Traffic 、 clue 、 Interaction and other data performance , It is the overall data output of the big data platform .

Because the car carnival night of Yiche is a live interactive activity of the network , shake （ Red envelopes 、 Half price car 、 Car change coin ） The voting of live programs in the main venue and sub venues has the highest user participation 、 The link with the largest data flow . Throughout the event , It not only requires that the database can store massive data , At the same time, it is also required to be able to deal with high concurrency 、 Low latency and other scenario requirements . The database here will not only serve as a data storage medium , It will also serve as a data source for real-time computing , With flow data , Realize real-time broadcasting of second level data .

Database and Flink Are two very important components in the whole system ,Flink The data sources include database and business flow data , Therefore, the database should not only meet the real-time push of data at the second level , Also support Flink Highly concurrent read and write requests .

TiDB The technical support of the community gave Yiche DBA Our very important help , It has been officially approved since July ,** It took less than a month to complete the model selection 、 The project design 、 Pressure measurement 、 Online deployment ,** And in “818” Carry the large flow smoothly without danger .

                                                                     818  Car Carnival data Kanban business architecture diagram 

Throughout 818 In the activity ,**TiDB be used as 818 The core database of auto Carnival data Kanban .** Yiche has prepared two sets TiDB colony , It corresponds to the active and standby schemes of real-time calculation one by one . Business R & D writes data to two clusters simultaneously by double writing , Query link cluster of some businesses 1 , The other part is the query connection cluster 2, When one of the clusters has a problem , The application side will switch to another cluster . Two TiDB Clusters are deployed 3 individual TiDB Server、3 individual PD Server、6 individual TiKV node 、2 individual TiFlash node . Besides , And I'm ready for 4 Expand the capacity of each machine to avoid the surge of data volume. The cluster can't support .

Final , Easy car 818 During the auto carnival, the amount of data reached the usual 10 More than times , At the end of the live broadcast, when Cai Xukun appeared , The database traffic has directly quadrupled , Almost enabled the one click expansion scheme prepared in advance . In the whole process ,818 Auto Carnival data Kanban business SQL 999 Always control in 8ms within ,SQL 99 stay 3ms about ,QPS achieve 62k.

>>> Check out the full version 《 Technology upgrade & Industry upgrading ,TiDB + Build super car Carnival by changing cars 》

02

The enlightenment behind the promotion

Forrester Chief analyst James McQuivey stay 《 subversion ： Innovative thinking and business model of digital economy 》 To be frank ： In the digital wave , Market competitors are taking advantage of new technologies 、 Tools and platforms to participate in market competition 、 Access to users , Even subvert the old business model .

Now , Big promotion is not just a “ dominance ” Business festivals , More like a “ Invisible ” Technology battlefield . It represents the wrestling of business , It is also a competition of digital ability . It's like a touchstone , Testing the success or failure of digital transformation of enterprises . Big promotion gives enterprises more than just an increase in turnover 、 Enhanced user stickiness , It is also a rethink of digital transformation and the value of new technologies .

First , In the digital age , The rapid change of the scene is by no means empty talk , Even if it's a big promotion , Now the big promotion is in the form of ten years ago 、 Method 、 The scale varies greatly , The innovation of big promotion scene will only be more and more in the future , The rapidly changing business logic will further promote the digital transformation of enterprises and the choice of Technology .

secondly , Big promotion and other new scenes are to break the technical bias 、 A great opportunity to embrace advanced technology , New technology trends will be implemented in the scene 、 Recognition and promotion . In today's hot HTAP For example , Don't look like MySQL Divide the table like that , Realize real-time massive scale OLTP And real-time data analysis , It can also be deployed in cloudy areas and disaster recovery centers , This has nothing to do with the massive transactions promoted by Da 、 Real time data presentation 、 The requirements for smooth operation are highly consistent . People used to think that HTAP Too far from the actual scene , But car house 、 Users such as e-car.com have proved the value of the new technology with facts .

Last , All enterprises are facing an era of increasing uncertainty , Only continuous scene innovation and digitization can resist all kinds of uncertainty . The business scale of Internet giants 、 The technical system certainly represents the top level in the industry , But whether it is really suitable for yourself and for use remains to be discussed , Users need to constantly know themselves , Find a technology suitable for their own development needs 、 Scheme and mode .

Facing the future , Data will become the most important production factor of enterprises , Around data storage 、 The ability to manage and apply innovation will become the core competitiveness of enterprises , In particular, with the normalization of high peak scenes such as the great promotion , image TiDB Such a low threshold 、 Low cost and high-quality distributed database technology and solutions will be favored by more industry users , To realize the rapid improvement of digital core competence , So as to have... In mind in the ever-changing market “ Count ”.