Building blocks for domestic databases, stonedb integrated real-time HTAP database is officially open source!

Last night, ,StoneDB Officially open source , This article takes you to review our press conference ~

The whole open source press conference will be played back , We have uploaded to B standing , Missed students can go B Station Review ~

B Station address ：https://www.bilibili.com/video/BV1mt4y187ZG

StoneDB The official introduction ：StoneDB It's a support The ranks are mixed + Memory computing Of HTAP database . It USES the Completely independent research and development Storage and computing engine , Can be MySQL Analytical performance Improve 100 times ; Its innovative Integrated HTAP framework , Break the tradition TP Type database capability boundary , To provide users with one-stop OLTP+OLAP Solution .

One sentence summary ：StoneDB Integrated real-time HTAP Open source database .

below , Let's review the content of this open source press conference ~

Coming back is still a teenager —— Why should we make domestic open source databases

Stone atom Technology CEO- Ye Jianlin （ Self study ）

It can be noted that , We emphasized two points , One is domestic , One is open source , When it comes to why we want to build domestic open source databases , Stone atom Technology CEO Ye Jianlin said , In fact, the factors considered are diverse ：

From the background of the times , In the face of the current complex international situation , The core technology of choking neck is easily blocked by Western unilateralist radical countries , And we have been blocked by these developed countries for a round , thus it can be seen , China must adhere to independent innovation , Realize localization substitution in core technology . And database as the basic software , We must embark on the road of localization .

In terms of enterprise development , Database as the base of digital economy , It can be said to be a “ Long slope and thick snow ” Track , There is nearly 100 billion market space , In the whole development process of big data industry , There will be more and more domestic big data basic software , future OLAP It must be an incremental market , Stone atom as a global 、 Full scene database AP Service provider , We hope to make the data analysis of customers reach “ fast 、 good 、 province ”.“ Data value online , It's safer to save money and worry ” This is the company mission of Shi atom , It is also the dream of our founding team for seven years , Seven years to sharpen a sword , Our childhood dream , Still pursuing , This somehow gives us a sense of mission .

I am also very happy to announce our StoneDB Officially open source , This is a fully compatible MySQL Ecological real-time HTAP database , It is also the first batch of open source in China + Memory computing architecture HTAP database . For most medium-sized customers ,MySQL Still the mainstream choice , When these customers need the analysis function ,StoneDB The advantages are reflected ,StoneDB Analytical performance ratio MySQL fast 100 times , And the design of its architecture and operation and maintenance will also reduce the overall cost of customers 30% above ,StoneDB Our core value is to let all customers get MySQL Ecological AP Ability , The customer does not need to modify a line of business code .

You may also see that we used “ real HTAP” this sentence , We think “ real HTAP” To meet the following four core characteristics ：

1. The same database system , Instead of being spliced by multiple database systems .
2. Mixed row and column storage is used + The core technology of memory computing ： Whether it's Oracle Of Heatwave, Still like SQL Server, Are designed with this architecture .
3. The same data eliminates the work and delay of data migration between different databases .
4. Can support at the same time OLTP and OLAP Business load .

Only databases with the above four characteristics , Can really be called “HTAP” database .

that , We do HTAP Why should databases rely on MySQL Ecological ？ The reason is still because of customers and the market , One thing I have to admit is , Today, MySQL It is still one of the most popular open source databases , Not only in Statistics , Our classmates have also visited many customers , A large number of customers are using MySQL Deal with key data logic , These uses MySQL In fact, our customers' demand for real-time data analysis is growing . and HTAP It has received a lot of attention in academia and industry in the past decade , Native MySQL What we have been focusing on is to strengthen the ability of transaction processing , But there is a lack of analytical ability , This allows us to see the space for innovation and breakthrough . We think ,HTAP The real value of databases is “ Simple 、 Universal ”, Those scenarios with small amount of data, especially 10TB The following small and medium-sized customers , In fact, you only need a database system , For customers in scenarios with a large amount of data ,HTAP The performance of is actually not as good as a single OLAP database 、 Real time data warehouse or big data platform . thus , Our target customer group is also very clear .

Why should we open source stone atom StoneDB？

We believe that the core value of open source is ： Open source can quickly verify products 、 Grinding products , Let more people use 、 Benefit 、 And further feed products and communities , Jointly create and build product ecology . Open source is closely integrated with ecology , Go deeper and deeper into the underlying software , The more suitable for open source ; Software that is easier to form network effect , The more suitable for open source . Just open source as a single database , In fact, it is of little value , ad locum , On behalf of stone atom technology, I also hope to work with all friends in the database industry to expand the open source ecosystem of domestic databases .

Open source is a very important strategic direction , We are also very clear about , Just contributing kernel code is not called open source , But to form “ Three C”, That is, our open source must focus on our core code （Code）、 Around our users （Consumer）、 Around our open source community （Community）, Form a series of closed-loop development .

At present, the commercialization of open source software , Most of them are mainly sales services , Now let's look at , Behind most open source software is actually a service industry , We are also like this in the early stage , Stone atoms will be based on StoneDB Open source kernel to provide good services , To meet a series of needs of paying customers .

Here is a short story ,2012 in , I was lucky to meet the winner of the Turing prize for database Michael Stonebraker, At that time, the old man shared with us his views on the future of columnar database and C-store Some of Paper, And the famous behind him 《One Size Fits All》 The rudiment of the theory , Column database is actually HTAP An important starting point in the development process , little does one think 10 Years later today , I'm walking again HTAP On the road of exploration ,StoneDB When the database was named , Our team discussed for a long time , Finally decided on the name , In fact, there are also right Stonebraker Some respect means inside .

good , Thank you for your , My share is here .

Integrated HTAP Schema filling MySQL The analytical ability is blank

StoneDB Li Hao, the chief architect, pointed out that , real HTAP Not at all TP System and AP Simple superposition of systems , The commercial demand of today's market , requirement HTAP Can handle at the same time TP and AP load , And use fewer technology stacks , Simpler business architecture , To achieve better real-time performance .StoneDB The architecture of is a new one under such requirements HTAP database .

As the only one in China based on MySQL The open source HTAP database ,StoneDB There are many bright spots ：StoneDB Is a fully compatible MySQL Of HTAP database , Can be realized from MySQL To StoneDB Seamless switching , Let users get... At a minimum AP Ability , There is no need to modify a line of business side code . For many MySQL The user provides 【 Universal 、 compatible 】 One stop shop for AP Capacity enhancement program , comparison MySQL Improved native analysis capability 100 More than times .

In addition, its advantages include ：

Fully compatible with MySQL

StoneDB Fully compatible with MySQL, Whether it's grammar or ecology ,MySQL Users can seamlessly switch to StoneDB.

Simplify architecture and management

Many enterprises analyze business data , Will choose to pass ETL Tools will TP The data in the database is imported into AP Type database for analysis . It's not just time consuming , And the architecture is complex , Error prone . Use StoneDB No need to be complicated ETL, Realization Singe Database for OLTP and OLAP .

Real time HTAP

Support both in the same database TP and AP Dual engine , The data is in TP and AP Delay free synchronization between engines , It improves the timeliness of data analysis , Maximize the business value of your data .

Strong analytical performance

Compare with MySQL,StoneDB Provide 10-100 Times AP Ability . Hundred million level multi table Association , Quick response , There is no need to wait for the result of the decision .

Cost savings

Seamless business migration , No learning costs ,StoneDB With efficient compression algorithm , Full data compression , The highest 40 Multiple compression ratio .

Fully open source

The core code and related ecological tools are completely open source , follow GPL-2.0 Open source licenses , Self control , Rapid iterative evolution of products .

Open source address ：https://github.com/stoneatom/stonedb

StoneDB V2.0 Architecture diagram

Looking forward to the future , To further improve StoneDB performance , At the same time, in order to reduce AP The load is applied to TP Effect of load , Li Hao said , It will be launched later based on in-memory column store The new architecture of the engine . This version is based on MySQL 8.0 structure , Sure AP Full memory calculation of load . How to load data , from InnoDB Load in parallel to in-memory column store in . meanwhile , Provide monitoring capability for import behavior , New query engine based on cost , And technologies such as parallel query and vectorization will also get continuous iteration .

“ Hurry and save ” Benchmarking cases inspire the market

At this conference , Ma Jun, chief operating officer, is right StoneDB The database is CRM System 、 Smart hospital products 、 The application of three typical scenarios, such as the large screen of the intelligent park, were shared .

StoneDB In these application scenarios , It shows excellent performance ：

1. stay CRM The system is being privatized , Save users 52% Cost of ; Business throughput （DTU） promote 68%; The difficulty of technical operation and maintenance decreases 50%.

2. In the smart hospital scenario , The average execution time of complex queries decreased from seconds to milliseconds ; The fault recovery time of core data nodes ranges from minutes to seconds , While saving costs 36%.

3. In the large screen system of the smart Park ,StoneDB Realized storage + Calculation cost reduction 72%; The data analysis time is reduced from minutes to seconds .

Welcome to the database industry 、 Open source enthusiasts 、 Startups focus on StoneDB Our community website ：stonedb.io.

You are also welcome to pay attention to StoneDB Open source code warehouse ：https://github.com/stoneatom/stonedb.

Open source is the innovation of many technology enterprises 、 The rise of , The key to breaking the monopoly . As the first domestic product based on MySQL Integrated real-time HTAP Open source database ,StoneDB Will continue to iterate and upgrade , Make the product more perfect , At the same time, it will also rely on the power of the open source community , Break your own sky in the domestic database ~

Welcome to participate in the questionnaire lottery ：https://lucky.nocode.com/v2/s/8heXp5pJyjd

About StoneDB

*

StoneDB It is independently designed by stone atom technology company 、 The first domestic product developed is based on MySQL Open source created by kernel HTAP Fusion database , Can be realized with MySQL Seamless switching .StoneDB Ultra high performance 、 Real time analysis and other features , To provide users with one-stop HTAP Solution .

Add a little assistant , Join the community communication group

official account ：StoneDB

Official website ：https://stonedb.io/

Github: https://github.com/stoneatom/stonedb

Slack: https://stonedb.slack.com/join/shared_invite/zt-1ba2lpvbo-Vqq62DJcxViyxCZmp7Rimw#/shared-invite/email

*

Click to read the original text , Take part in the lottery

This article is from WeChat official account. - StoneDB（StoneDB2021）.
If there is any infringement , Please contact the [email protected] Delete .
Participation of this paper “OSC Source creation plan ”, You are welcome to join us , share .