Apache Doris becomes the top project of Apache

The world's largest Open Source Software Foundation Apache Software foundation （ hereinafter referred to as Apache） At us time 2022 year  6 month 16  Japan   announce ,Apache Doris Success comes from Apache Incubator graduation , Officially become Apache Top projects （Top-Level Project,TLP）.

Apache Doris It's based on MPP Modernization of 、 High performance 、 Real time analytical database , It is known for its speed and ease of use , It only needs sub second response time to return query results under massive data , It can not only support highly concurrent point query scenarios , It can also support complex analysis scenarios with high throughput . Based on this ,Apache Doris In multidimensional Report 、 User portrait 、 Ad hoc inquiry 、 Real time large screen and many other business areas can be well applied .

Apache Doris It was first born in Baidu's internal advertising report business Palo project ,2017 It was officially opened to the outside world in ,2018 year 7 Donated by Baidu to Apache The foundation incubates , After the Apache Under the guidance of the tutor, incubation and operation are carried out by the members of the incubator Project Management Committee .

“ We are very proud of Doris To be able to move smoothly from Apache Incubator graduation , This is an important milestone . Throughout the incubation phase , rely on Apache The guidance of ideas and the help of incubator tutors , We learned how to Apache To develop our projects and communities , Also in this process has obtained the huge growth .” Apache Doris VP Chen Mingyu said .

at present Apache Doris The community has gathered nearly 100 enterprises from different industries 300 More than contributors , And the number of monthly active contributors is close to 100 position . During incubation ,Apache Doris A total of 8 An important version , Completed including storage engine upgrade 、 Vectorization execution engine and many other important functions , And officially released 1.0 edition . It depends on the strength of these open source contributors , So that Apache Doris Achieved today's results .

meanwhile ,Apache Doris Now it has a wide range of user groups in China and even in the world , So far , Apache Doris Has surpassed in the world 500 Applied in the production environment of enterprises , Top of China's market capitalization or valuation ranking 50 Of the Internet companies , There are more than 80% For a long time Apache Doris, Including Baidu 、 Meituan 、 millet 、 JD.COM 、 Bytes to beat 、 tencent 、 Well quickly 、 NetEase 、 Microblogging 、 Sina 、360 And other famous companies . At the same time, in some traditional industries such as finance 、 energy 、 manufacture 、 Telecommunications and other fields also have a wealth of applications .

“ You can be based on Apache Doris Quickly build an easy-to-use and powerful data analysis platform , Very easy to use , The cost of learning is very low . also Apache Doris The distributed architecture is very simple , It can greatly reduce the workload of system operation and maintenance , This is also the choice of more and more users Apache Doris The key factor .”

As a mature analytical database project ,Apache Doris There are the following advantages ：

• Excellent performance ： It comes with an efficient columnar storage engine , While reducing the amount of data scanning, it also achieves ultra-high data compression ratio . meanwhile Doris It also provides a rich index structure to speed up data reading and filtering , Use the cutting function of partition and barrel ,Doris It can support ultra-high concurrency of online service business , A single node can support up to thousands of QPS. Further more ,Apache Doris Combined with vectorization execution engine to give full play to modernization CPU Parallel computing power , With the help of intelligent materialized view technology, pre aggregation acceleration can be realized , The query optimizer can perform both planning based and cost based query optimization . In many ways , Achieve the ultimate query performance .

• Simple and easy to use ： Support standards ANSI SQL grammar , Including single table aggregation 、 Sort 、 Filtering and multiple tables Join、 The subquery etc. , It also supports window functions 、Grouping Set Etc SQL grammar , At the same time, users can use UDF and UDAF And other user-defined functions to expand system functions . in addition to ,Apache Doris It's also achieved MySQL Protocol compatible , Users can access... Through various client tools Doris, And support with BI Seamless docking of tools .

• Structure simplification ： There are only two systems Frontend（FE） and Backend（BE） Two modules , among FE The node is responsible for the access requested by the user 、 Query plan resolution 、 Metadata storage and cluster management ,BE The node is responsible for data storage and query plan execution , It is a complete distributed database management system , Users do not need to install any third-party management and control components to run Apache Doris colony , And the process of deployment and upgrade is very simple . meanwhile , Any module can support horizontal expansion , The cluster can be expanded to hundreds of nodes , Supports storage of more than 10PB Very large scale data .

• Stable and reliable ： Support data multi copy storage , The cluster has a self-healing function , Its own distributed management framework can automatically manage the distribution of data copies 、 Repair and balance , When the copy is damaged, the system can automatically detect and repair it . When the node is expanded , Just one SQL The command is done , Data fragmentation will be automatically balanced among nodes , No manual intervention or operation is required . Whether it is expansion 、 Shrinkage capacity 、 Single node failure is still in the process of upgrading , There is no need to stop the system , It can normally provide stable and reliable online services .

• Rich ecological ： Provide rich data synchronization methods , Support fast loading from local 、Hadoop、Flink、Spark、Kafka、SeaTunnel And so on , It can also be accessed directly MySQL、PostgreSQL、Oracle、S3、Hive、Iceberg、Elasticsearch And other data in the system without data replication . At the same time, it is stored in Doris The data in can also be Spark、Flink Read , And it can be output to the upstream data application for demonstration and analysis .

“‍ Graduation is not the ultimate goal , It is the starting point of a new journey .” Chenmingyu said .

“ in the past , We initiated Doris Our goal is to provide more people with better data analysis tools 、 Solve their data analysis problems . Become Apache On the one hand, top projects are right Apache Doris All the past contributors of the community have been working hard , On the other hand, it also means that we are Apache Way Has established a strong 、 Prosperity, 、 Sustainable open source community . In the future, we will continue to Apache How to run the community , I believe it will attract more excellent open source contributors to participate in the community , The community will also grow further with the help of all contributors .”

“Apache Doris More challenging and meaningful work will be carried out in the future , Including the new query optimizer 、 Support for Lake warehouse integration , As well as the evolution of the infrastructure on the cloud . Welcome more open source technology enthusiasts to join us Apache Doris Our community , Grow together .”

 

Apache Doris Official website ：

http://doris.apache.orghttp://doris.apache.org

Apache Doris Github：

https://github.com/apache/incubator-dorishttps://github.com/apache/incubator-doris