Design and practice of new generation cloud native database

Database and operating system 、 Middleware constitutes the troika of basic software , It's also an enterprise IT The core technology of the system is essential . From the last century 60 Since the birth of the age , Whether it is the Internet industry or the bank 、 telecom 、 Traditional industries like manufacturing , All depend on the evolution of database technology .

After entering the era of cloud primordial , Traditional databases are in service availability 、 Data reliability 、 System security 、 Database backup 、 Hardware and software investment 、 System hosting 、 Maintenance cost 、 Deployment expansion 、 There are deficiencies in key aspects such as resource utilization . In this context , The distributed database system has got exciting development , Further integration of cloud infrastructure and database , It makes up for the pain point of traditional database , Brings high scalability 、 Full automation 、 Rapid deployment 、 Cost savings 、 Convenient management and other advantages . The focus of discussion on database technology has shifted from the cloud （ On Cloud ） How to truly integrate with cloud primitives （ In Cloud ）, This is a transition from the outside to the inside , For databases , Embracing cloud primordial seems to be an obvious and quite right way .

There are many kinds of business 、 There is a large stock of data , The high cost ; Business growth is fast , Appeal to changing challenges , It brings higher requirements for the underlying technical capabilities of the database , How to design a future oriented 、 Yunyuan biochemical database system ？ What new features does data Lake technology bring ？ How to intelligently analyze and diagnose operation and maintenance alarms ？ These problems all depend on the ingenuity of database and cloud native engineers .

stay 7 month 22 The coming 2022 Rare earth Developers Conference , Zhang Lei, the technical director of ByteDance database, is the producer 《 New generation cloud native database 》 Special speech , We will sincerely invite core business experts from major manufacturers to share their valuable experience in exploring the use of cloud native databases . Free registration for this Developer Conference , Click the end of the text to read the original text or identify the QR code of the poster to share and communicate with you .

Speech theme ： Cloud native database technology trends and Intel best practices

The traditional database system is designed based on tight coupling , The flexibility and scalability of the system are greatly limited . With the arrival of cloud's original era , Pooling resources , Calculation and storage are decoupled , It can be used as needed 、 Flexible scheduling resources , The database system under cloud native technology has also become the mainstream direction of future technology . The new generation of cloud native database combined with cloud native and distributed has high scalability 、 Ease of use 、 Fast iteration 、 Cost reduction, etc . This speech analyzes the technical trends and technical architecture of common cloud native databases , At the same time, it also shared the case analysis of the user's cloud native database deployment , Including how to adopt the overall ability of Intel in database technology from hardware to software , To help users optimize their cloud native database solutions .

Speech outline ：

1. Cloud native database technology development trend

2. Cloud native database technology ecology

3. Typical cloud native distributed database solutions and Intel best practices

Speakers ： Renxiaolei Intel data centers and AI Division solution architect

near 20 Year of IT Work experience , Currently working as a solution architect at Intel Corporation , The main technical field is big data analysis / database , He has rich experience in architecture design and system optimization of database and big data software .

Speech theme ：Apache Doris Data Lake analysis technology and application practice

Apache Doris It's based on MPP Open source analytical database based on . Relying on its powerful parallel processing ability and high-performance operators , It can provide sub second level interactive query experience on massive data sets . In recent years , With the rapid development of data Lake Technology , More and more enterprises begin to rely on data Lake Technology to build their basic data storage architecture , And make use of the batch flow provided by the data lake , Transaction isolation and data update capabilities , Precipitated a large amount of enterprise data . This sharing , We'll show you how to build on Apache Doris Quickly analyze the data in the data Lake , as well as Doris Functions and progress in federated query of multi-source data . Help the audience understand Apache Doris The technical details of data Lake analysis and how to quickly build an efficient query analysis system .

Speech outline ：

1. Apache Doris Introduction and list of core functions

2. Apache Doris Insider of data Lake analysis technology

3. be based on Apache Doris Build a unified multi-source data analysis system

4. Apache Doris Community and future planning

Speakers ： Lijibing SelectDB Senior software R & D expert 、Apache Doris Contributor

SelectDB Senior R & D expert , Mainly engaged in Apache Doris Query layer optimization and data Lake related R & D work , Have more than 10 Years of design and development experience in the field of big data system and database kernel . Join in SelectDB front , He used to be a senior R & D Engineer of Baidu big data department , be responsible for Apache Doris Design and development of metadata module . Then add AWS, be responsible for AWS Snowmobile EB Design and implementation of data migration service .

Speech theme ： Byte cloud native database （MySQL） Excellent technical practice

Byte cloud native database （veDB for MySQL） since 2020 year 4 Since launch in , It has launched a large number of byte internal businesses and will be officially tested on the volcanic engine platform , However, most of the internal businesses are from MySQL + Local NVME SSD Move from , There are also many problems in the process of use . What is more prominent is that , Calculate the performance problems caused by remote storage . How to overcome these problems without affecting the business side experience and reputation is very important . This lecture will select several typical technical cases , In depth introduction veDB （for MySQL） How to overcome these challenges technically .

Speech outline ：

1. Byte cloud native database （MySQL） brief introduction

2. Technical case 1 ：Fast DDL

3. Technical case 2 ：Hot （Extended） Buffer Pool

4. Technical case 3 ：Quick Resharding

5. Technical case 4 ：Parallel Query

6. The direction of future technology development

Speakers ： Nie Yuanyuan ByteDance Software Engineer

Graduated from Wuhan Huazhong University of science and technology , Yes 10 Years of experience in database kernel development , Worked for IBM/Teradata/ Huawei ,2019 Joined the byte beat infrastructure team , He is currently responsible veDB (for MySQL) Technical direction and team . Mainly focus on distributed database 、 Distributed storage technology . After adding byte beat , From nothing to participate in the construction of veDB (for MySQL) product , And a large number of on-line applications have been launched inside the byte .

Speech theme ： Construction and practice of database autonomy system in the cloud era

With the rapid expansion of business , The private cloud database of meituan has a blowout , Accompanied by a large number of alarms . The root cause of these alarms often requires long-term analysis by operation and maintenance personnel , And brings uncontrollable time cost and misjudgment risk , There are countless cases in which small failures caused by this have expanded into major accidents . therefore , This topic will introduce how to take advantage of real-time computing power (Flink/Spark) Build the calculation and storage of massive monitoring data 、 Enrich the observability of database based on massive data 、 Combined with expert experience + AI Realize database exception discovery and root cause location 、 Let decision-making and processing linkage improve the ability of fault self-healing .

Speech outline ：

1. With the rapid growth of database instances , The main contradiction faced by the team

2. PB Level massive monitoring data real-time computing and storage capacity construction

3. Improve database observability （ Total quantity SQL/Transaction/Lock etc. ）

4. be based on AI Database exception discovery for 、 Root cause localization and fault self-healing

5. Show classic cases in actual scenes

Speakers ： Cai Jinlong Meituan basic research and development platform database research and development director

Head of R & D team of meituan database platform , In charge of SRE、KV and DBA Relevant operation and maintenance teams , Led the meituan relational database change and control platform RDS、 Database autonomous service DAS And database security firewall DBSS Related items from 0-1 Construction . At present, a new generation of database intelligent operation and maintenance platform is being built , With the help of AI Achieve a high degree of autonomy of the database .

Speech theme ：Google Cloud Practice and Exploration on cloud native database

The development of cloud native databases is changing with each passing day ,“ turn left , Or to the right ”？Google Cloud As a global database leader , Built an increasingly complete cloud native database system , Through continuous innovation 、 lead , Help our users solve many data calculations 、 Storage 、 analysis 、 Challenges and problems faced by management , Stimulate business vitality .

Speech outline ：

1. Overview of cloud native databases

2. Spanner Innovation brought by database

3. AlloyDB stay Log is database Exploration

Instructor information ： Guo Bin Google Cloud Database architect

Many years of practical experience in database technology , Proficient in mainstream relational databases and NoSQL database , Have a deep understanding of various new database technologies and rich practical experience , Especially in the past two years, I have cooperated more with game companies , The database requirements of the game company are very accurate , Drill deep . Before joining Google , I was in Elastic、MongoDB、Oracle As an architect 、 Consulting engineer and other positions .

  In addition to the new generation of cloud native database, the topics planned for this conference , It also includes open source and commercial exploration 、 Big front end 、 Low code 、 The evolution of the architecture behind the business 、 Microservices and Serverless、 There are more than ten special sessions on cloud native technology architecture and transformation , From bytes 、 Ali 、 tencent 、 Industry experts with technical influence and insight from companies such as Kwai are responsible for controlling the issue , At present, all the producers of the conference have been collected , The instructor lineup is about to be confirmed . In addition to a two-day immersive content experience , The rare earth developers conference also prepared rich prizes for thousands of developers , Developers who sign up for the conference will have the opportunity to participate in the lucky draw , Win big prizes , Coming soon .

Click below to read the article , Register for the best viewing spot for free now ！