Netease's open source distributed storage system curve officially became the CNCF sandbox project

| author ：OpenCurve

|  Coordinating editor ： Shen Yulan

| Design ： Zhang Chenxi

| edit ： Huxinyuan

2022 year 6 month 15 Japan , Cloud native Computing Foundation (CNCF) announce , Distributed storage system Curve Be formally accepted as CNCF The sandbox （Sandbox） project .

Curve Open source by Netease , Provide block storage and file storage capabilities , Aimed at Feed back the community with Netease distributed architecture and cloud native practice experience , Fill in high performance 、 Easy operation and maintenance 、 The blank of cloud native open source distributed storage .

Project address ：https://github.com/opencurve/curve

Curve Get into CNCF The sandbox , It means that the world's top open source foundation recognizes the evolution of Netease cloud native storage technology , Also verified that Netease Digital basic software field Deep accumulation of , And deep insight into future technology trends . By entering CNCF The sandbox ,Curve The community will attract more developers and users to participate in the co construction , Further promotion Mature application of the project in cloud native business scenarios , Thus deepening Implementation of cloud native technology .

Curve Project features

Curve The development of , Sprout in Open source Ceph The storage system It is difficult to meet the simple needs of Netease business development , The opportunity to grow up in the cloud and quickly land in various businesses .

review 2018 year , Netease has completed the comprehensive containerization of e-commerce business , Start using Kubernetes + Operator Running stateful applications , The improvement of cloud native storage infrastructure has also been put on the agenda .

Even from the present CNCF Landscape Look at , Cloud native storage projects are still far less abundant than those on the computing side and the network side , Open source is scarce （ White background in the picture ）, If you add stability 、 High performance 、 The flexibility that both public and private clouds can use 、 The basic requirements for storage systems in these cloud native scenarios are simple and easy to operate , There is basically no suitable system to choose from on the market .

This is a Curve The external driving force for healthy development .

Thanks to the Raft Technical route of consistency agreement and Innovation Framework , at present , No matter what SATA SSD Block storage , still NVMe Block storage ,Curve Read and write randomly 、 The latency performance is much better than the old open source storage system Ceph, The performance stability under abnormal conditions also has a leading degree of nearly one and a half times the relationship .

And with another CNCF Sandbox project , Use Go Container based block storage open source software written in OpenEBS comparison ,Curve Overwrite both block storage and file storage , It is more conducive to the construction of unified digital basic software , The operation and maintenance management cost is also lower .

Curve Use scenarios

Curve It can be applied to various cloud native infrastructure platforms as storage bases , Such as ：

• docking OpenStack platform by Virtual machine Provide high-performance block storage services ;

• docking Kubernetes To provide it with RWO、RWX Etc Persistent storage volumes ;

• Used as cloud storage middleware S3 Compatible object storage as a data storage engine , Provide cost-effective services for public cloud users Shared file storage ;

• docking PolarFS As a high-performance storage base for cloud native databases , It perfectly supports the storage and computing separation architecture of the cloud native database .

In view of the current domestic demand for independent and controllable digital infrastructure ,Curve We have also done a lot of targeted adaptation work , at present ,Curve Fully support domestic Kunpeng CPU + Unicorn System , The software architecture can make full use of and give full play to the domestic CPU And hardware and operating system performance . Besides ,Curve The core module, data structure and data communication protocol of the system itself Domestic independent design and development , Independently developed code 20 More than ten thousand lines , The coverage of the test code has also reached 80%.

Curve Community progress

Curve On 2020 year Official open source , It has been released for more than a year  3 Big version , It's done exceed 2500 individual commits Submit ,GitHub On Star More than 1100 individual , Except Netease internal users , NetEase cloud music 、 Netease strictly selected 、 NetEase has a way 、 NetEase Media 、 Netease is very smart 、 Netease Yunxin, etc , It has also attracted such hyperfusion Technology Co., Ltd 、 Think about technology 、 It is used by more than ten enterprises such as chuangyun Rongda .

2022 year 3 month ,Curve With excellent performance and strong ease of operation and maintenance , Become alicloud PolarDB Community Our official ecological partner , by be based on Shared-Storage Architecturally PolarDB for PostgreSQL Provide distributed shared storage sleds , Support database load to obtain the benefits of cloud native rapid elastic expansion .

thank

Curve The project can have today's development trend , It is inseparable from the efforts of every community participant . I sincerely thank The trust of every community contributor and user 、 Support and help , Thank you very much CNCF Colleagues, especially Storage TAG Guidance and support for project development . More developers and users are also welcome to participate Curve Community building , If you have any comments and suggestions , Can give us issue.

Curve The future planning

Curve Aim High performance 、 Easy operation and maintenance 、 Cloud native Our goal continues to evolve ：

• High performance ： Cloud native database 、 Cloud middleware provides ultra-high performance 、 Ultra low latency storage sleds , Help the implementation of the separation of storage and settlement architecture . At the same time, it can also provide a high-performance storage layer for file storage , Help the implementation of cost-effective architecture .

  
  

• Cloud native ： A storage and computing separation architecture that supports various cloud native applications , Support deployment to private cloud 、 Public cloud 、 Hybrid cloud environment , Provide more flexible and convenient storage systems for cloud native applications .

  
  

• Easy operation and maintenance ： It's easier to offer 、 Easier to use 、 Easy troubleshooting operation and maintenance tools and diagnostic platform .

Related reading  | Related Reading

Reprint Alibaba open source project Egg.js Caused by technical documents “ Copyright disputes ”, Look loose MIT How to use the license ？

holdover 、 Overhead 、 dragging , What is the big open source office like ？

DataBricks From open source to commercialization

Introduction to Kaiyuan society

Kaiyuan society was founded in 2014 year , It's made up of individual members who volunteer to contribute to the cause of open source , In accordance with the “ contribution 、 Consensus 、 Co governance ” Composed of principles , Always maintain vendor neutrality 、 public welfare 、 The characteristics of non-profit , It was the first to “ Open source governance 、 International connection 、 Community development 、 Open source project ” Open source community Consortium for mission . Open source community actively supports open source community 、 Enterprises and relevant government units work closely together , With “ Based on China 、 Contribute to the world ” For the vision , It aims to create a healthy and sustainable open source ecosystem , Promote China's open source community to become an active participant and contributor to the global open source system .

2017 year , The open source society has transformed into a completely composed of individual members , reference ASF And other international top open source foundations . In the last seven years , It links tens of thousands of open source people , Gathered thousands of community members and volunteers 、 Hundreds of lecturers at home and abroad , It has cooperated with nearly 100 sponsors 、 The media 、 Community partners .

This article is from WeChat official account. - Kaiyuan society KAIYUANSHE（kaiyuanshe）.
If there is any infringement , Please contact the [email protected] Delete .
Participation of this paper “OSC Source creation plan ”, You are welcome to join us , share .