当前位置:网站首页>Design and practice of new generation cloud native database
Design and practice of new generation cloud native database
2022-07-01 22:19:00 【Rare earth gentleman】
Database and operating system 、 Middleware constitutes the troika of basic software , It's also an enterprise IT The core technology of the system is essential . From the last century 60 Since the birth of the age , Whether it is the Internet industry or the bank 、 telecom 、 Traditional industries like manufacturing , All depend on the evolution of database technology .
After entering the era of cloud primordial , Traditional databases are in service availability 、 Data reliability 、 System security 、 Database backup 、 Hardware and software investment 、 System hosting 、 Maintenance cost 、 Deployment expansion 、 There are deficiencies in key aspects such as resource utilization . In this context , The distributed database system has got exciting development , Further integration of cloud infrastructure and database , It makes up for the pain point of traditional database , Brings high scalability 、 Full automation 、 Rapid deployment 、 Cost savings 、 Convenient management and other advantages . The focus of discussion on database technology has shifted from the cloud ( On Cloud ) How to truly integrate with cloud primitives ( In Cloud ), This is a transition from the outside to the inside , For databases , Embracing cloud primordial seems to be an obvious and quite right way .
There are many kinds of business 、 There is a large stock of data , The high cost ; Business growth is fast , Appeal to changing challenges , It brings higher requirements for the underlying technical capabilities of the database , How to design a future oriented 、 Yunyuan biochemical database system ? What new features does data Lake technology bring ? How to intelligently analyze and diagnose operation and maintenance alarms ? These problems all depend on the ingenuity of database and cloud native engineers .
stay 7 month 22、23 Japan The coming 2022 Rare earth Developers Conference On , from Zhang Lei, the technical director of ByteDance database, is the producer 《 New generation cloud native database 》 Special speech , We will sincerely invite core business experts from major manufacturers to share their valuable experience in exploring the use of cloud native databases . Free registration for this Developer Conference , Click on Enrollment link or Identify poster QR code You can share and exchange with everyone .
Speech theme : Cloud native database technology trends and Intel best practices
Design method based on tight coupling , The flexibility and scalability of traditional database systems are greatly limited . With the arrival of cloud's original era , Pooling resources , Calculation and storage are decoupled , It can be used as needed 、 Flexible scheduling resources , The database system under cloud native technology has also become the mainstream direction of future technology . The new generation of cloud native database combined with cloud native and distributed has high scalability 、 Ease of use 、 Fast iteration 、 Cost reduction, etc . This speech will analyze the technical trends and technical architecture of common cloud native databases , At the same time, share the case analysis of users' cloud native database deployment , Including how to adopt the overall ability of Intel in database technology from hardware to software , To help users optimize their cloud native database solutions .
Speech outline :
- Cloud native database technology development trend
- Cloud native database technology ecology
- Typical cloud native distributed database solutions and Intel best practices
Speakers :
Renxiaolei Intel data centers and AI Division solution architect
near 20 Year of IT Work experience , Currently working as a solution architect at Intel Corporation , The main technical field is big data analysis / database , He has rich experience in architecture design and system optimization of database and big data software .
Speech theme :Apache Doris Data Lake analysis technology and application practice
Apache Doris It's based on MPP Open source analytical database based on . Relying on its powerful parallel processing ability and high-performance operators , It can provide sub second level interactive query experience on massive data sets . In recent years , With the rapid development of data Lake Technology , More and more enterprises begin to rely on data Lake Technology to build their basic data storage architecture , And make use of the batch flow provided by the data lake , Transaction isolation and data update capabilities , Precipitated a large amount of enterprise data . This sharing , We'll show you how to build on Apache Doris Quickly analyze the data in the data Lake , as well as Doris Functions and progress in federated query of multi-source data . Help the audience understand Apache Doris The technical details of data Lake analysis and how to quickly build an efficient query analysis system .
Speech outline :
- Apache Doris Introduction and list of core functions
- Apache Doris Insider of data Lake analysis technology
- be based on Apache Doris Build a unified multi-source data analysis system
- Apache Doris Community and future planning
Speakers :
Lijibing SelectDB Senior software R & D expert 、Apache Doris Contributor
Mainly engaged in Apache Doris Query layer optimization and data Lake related R & D work , Have more than 10 Years of design and development experience in the field of big data system and database kernel . Join in SelectDB front , He used to be a senior R & D Engineer of Baidu big data department , be responsible for Apache Doris Design and development of metadata module . Then add AWS, be responsible for AWS Snowmobile EB Design and implementation of data migration service .
Speech theme : Construction and practice of database autonomy system in the cloud era
With the rapid expansion of business , The private cloud database of meituan has a blowout , Accompanied by a large number of alarms . The root cause of these alarms often requires long-term analysis by operation and maintenance personnel , And brings uncontrollable time cost and misjudgment risk , There are countless cases in which small failures caused by this have expanded into major accidents . therefore , This topic will introduce how to take advantage of real-time computing power (Flink/Spark) Build the calculation and storage of massive monitoring data 、 Enrich the observability of database based on massive data 、 Combined with expert experience + AI Realize database exception discovery and root cause location 、 Let decision-making and processing linkage improve the ability of fault self-healing .
Speech outline :
- With the rapid growth of database instances , The main contradiction faced by the team
- PB Level massive monitoring data real-time computing and storage capacity construction
- Improve database observability ( Total quantity SQL/Transaction/Lock etc. )
- be based on AI Database exception discovery for 、 Root cause localization and fault self-healing
- Show classic cases in actual scenes
Speakers :
Cai Jinlong Meituan basic research and development platform database research and development director
Head of R & D team of meituan database platform , In charge of SRE、KV and DBA Relevant operation and maintenance teams , Led the meituan relational database change and control platform RDS、 Database autonomous service DAS And database security firewall DBSS Related items from 0-1 Construction . At present, a new generation of database intelligent operation and maintenance platform is being built , With the help of AI Achieve a high degree of autonomy of the database .
Speech theme : Byte cloud native database (MySQL) Excellent technical practice
Byte cloud native database (veDB for MySQL) since 2020 year 4 Since launch in , It has launched a large number of byte internal businesses and will be officially tested on the volcanic engine platform , However, most of the internal businesses are from MySQL + Local NVME SSD Move from , There are also many problems in the process of use . What is more prominent is that , Calculate the performance problems caused by remote storage . How to overcome these problems without affecting the business side experience and reputation is very important . This lecture will select several typical technical cases , In depth introduction veDB (for MySQL) How to overcome these challenges technically .
Speech outline :
- Byte cloud native database (MySQL) brief introduction
- Technical case 1 :Fast DDL
- Technical case 2 :Hot (Extended) Buffer Pool
- Technical case 3 :Quick Resharding
- Technical case 4 :Parallel Query
- The direction of future technology development
Speakers :
Nie Yuanyuan Byte beating infrastructure MySQL Technical director
Graduated from Wuhan Huazhong University of science and technology , Yes 10 Years of experience in database kernel development , Worked for IBM、Teradata、 Huawei ,2019 Joined the byte beat infrastructure team , He is currently responsible veDB (for MySQL) Technical direction and team . Mainly focus on distributed database 、 Distributed storage technology . After adding byte beat , From nothing to participate in the construction of veDB (for MySQL) product , And a large number of on-line applications have been launched inside the byte .
Speech theme :Google Cloud Practice and Exploration on cloud native database
The development of cloud native databases is changing with each passing day ,“ turn left , Or to the right ”?Google Cloud As a global database leader , Built an increasingly complete cloud native database system , Through continuous innovation 、 lead , Help our users solve many data calculations 、 Storage 、 analysis 、 Challenges and problems faced by management , Stimulate business vitality .
Speech outline :
- Overview of cloud native databases
- Spanner Innovation brought by database
- AlloyDB stay Log is database Exploration
Speakers :
Guo Bin Google Cloud Database architect
Many years of practical experience in database technology , Proficient in mainstream relational databases and NoSQL database , Have a deep understanding of various new database technologies and rich practical experience , Especially in the past two years, I have cooperated more with game companies , The database requirements of the game company are very accurate , Drill deep . Before joining Google , I was in Elastic、MongoDB、Oracle As an architect 、 Consulting engineer and other positions .
In addition to the new generation of cloud native database, the topics planned for this conference , It also includes Open source and commercial exploration 、 Big front end 、 Low code 、 The evolution of the architecture behind the business 、 Microservices and Serverless、 Cloud native technology architecture and changes More than ten technical special sessions , From byte 、 Ali 、 tencent 、 Kwai, etc The company's industry experts with technical influence and insight are responsible for controlling the issues , At present, all the producers of the conference have been collected , The instructor lineup is about to be confirmed . In addition to a two-day immersive content experience , The rare earth developers conference also prepared rich prizes for thousands of developers , Developers who sign up for the conference will have the opportunity to participate in the lucky draw , Win big prizes , Coming soon .
边栏推荐
- 工控设备安全加密的意义和措施
- JS how to get a list of elements in a collection object
- 【Opencv450】HOG+SVM 与Hog+cascade进行行人检测
- Aidl basic use
- Getting started with the lockust series
- 运放-滞回(迟滞)比较器全流程实战计算
- Unity 使用Sqlite
- Halcon知识:三维重构的一个尝试
- Simple interactive operation of electron learning (III)
- 【mysql 07】GPG key retrieval failed: “Couldn‘t open file /etc/pki/rpm-gpg/RPM-GPG-KEY-mysql-2022“
猜你喜欢
Icml2022 | interventional contrastive learning based on meta semantic regularization
上半年暂停考试要补考?包含监理工程师、建筑师等十项考试
PWN攻防世界cgpwn2
Aidl basic use
最近公共祖先离线做法(tarjan)
MIT|256KB 内存下的设备上训练
EMC-电路保护器件-防浪涌及冲击电流用
Significance and measures of security encryption of industrial control equipment
News classification based on LSTM model
二叉树的基本操作
随机推荐
Introduction à l'ingénierie logicielle (sixième édition) notes d'examen de Zhang haifan
信标委云原生专题组组长,任重道远!
"The silk road is in its youth and looks at Fujian" is in the hot collection of works in the Fujian foreign youth short video competition
Tops, the unit of computing power of the processor, can be carried out 1 trillion times per second
分离字符串中的字母和数字并使得字母在前数组在后
Aidl basic use
【mysql 07】GPG key retrieval failed: “Couldn‘t open file /etc/pki/rpm-gpg/RPM-GPG-KEY-mysql-2022“
Case of camera opening by tour
同花顺股票开户选哪个券商好手机开户是安全么?
Halcon知识:三维重构的一个尝试
PMP证书真的有用吗?
Little p weekly Vol.11
Getting started with the lockust series
require与import的区别和使用
MySQL series transaction log redo log learning notes
新版图解网络PDF即将发布
辅音和声母的区别?(声母与辅音的区别)
打出三位数的所有水仙花数「建议收藏」
Do you want to make up for the suspended examination in the first half of the year? Including ten examinations for supervision engineers, architects, etc
微软、哥伦比亚大学|GODEL:目标导向对话的大规模预训练