CEPH Shangwen network xUP Nange that releases the power of data

Into the Q Group 11372462 Receive exclusive registration benefits !

# Said in the previous

When I was a child , I especially hope I can change " The Incredible Hulk ", Release infinite power ; When I grow up , Took part in the work , Devote oneself to IT industry , In the process of exploration and progress , I found such a reliable partner around me , It can provide us with various forms of fusion architecture for data storage , Provides the ultimate performance , And support a variety of businesses , Release data energy ; It seems to realize that when we were young, we hoped to become hulks , Dream of releasing power ; This reliable partner , It is the open source distributed storage solution from red hat Ceph！

( From the web )
In recent years , With the birth of Cloud Computing 、 Enterprise Cloud 、DevOPS、 The emergence of key terms such as digital transformation , Make the whole IT Rapid changes have taken place in the industry , As a result, the types of data storage become richer and more diverse , The amount of data has also become more huge ; What block storage 、 File store 、 Object storage includes docking with various storage services on the public cloud , in other words , The demand for distributed storage technology is increasing , At this time, what we need is a software defined storage related solution that can realize loose coupling with the storage device hardware , Be able to integrate all kinds of data storage types mentioned above , Realize a unified storage management and monitoring platform .

( From the web )
Red hat Ceph Is to focus on block based 、 The data of objects and files provides a solution of unified storage and management . Next we're going to nag Ceph The definition of 、 It occupies an absolute position in the definition direction of distributed storage software Leader status .

# What is? Ceph

Ceph Is an open source distributed storage system , For block data 、 Object etc. . Through the native API in AWS S3 perhaps OpenStack swfit API Way to visit . Based on block storage access through block protocol and iscsi Provide .
Ceph The official document address of ：
https://docs.ceph.com/en/pacific/

#Ceph The architecture of

( From the web )
Ceph Apply to different scenarios , For example, object storage is through RADOSGW To store data , Can provide Amazon AWS Medium S3 Style and red hat OpenStack In cloud platform architecture Swift The interface corresponding to the style ; Block storage , It's through RBD Map block devices to hosts or virtual machines , As a persistent block device ( disk ) Use... For association ; in addition , The file storage method provides the client Linux Kernel level and FUSE Level of access . After group ,LIBRADOS A library is a repository that can directly support native access , adopt Go、C、C++、Python And other language calls to access storage .

#Ceph The composition of

• pCeph OSDs:
  Ceph OSD Daemon （ Ceph OSD ） Its function is to store data , Processing data replication 、 recovery 、 backfill 、 Rebalance , And by checking other OSD The heartbeat of the daemons comes to Ceph Monitors Provide some monitoring information . When Ceph The storage cluster is set to have 2 When there are copies , Need at least 2 individual OSD Daemon , Cluster can reach active+clean state （Ceph The default is 3 Copies , You can adjust the number of copies ）.
• pMonitors: Ceph
  Monitor Maintain various graphs showing the cluster status , Including the monitor map 、 OSD chart 、 Home group （ PG ） chart 、 and CRUSH chart .
  Ceph Keep what happened in Monitors 、 OSD and PG Historical information of each state change on （ be called epoch ）.
• pManager: Manager ：
  Ceph Manager daemon （Cephmgr） Responsible for tracking runtime metrics and Ceph The current state of the cluster , Including storage utilization 、 Current performance indicators and system load .Ceph The manager daemon also hosts the python Module , To manage and disclose Ceph Cluster information , Including based on web Of Ceph Dashboard and Restful
  APT. High availability usually requires at least two managers .
• pMDSs: Ceph metadata server （ MDS ）
  by Ceph File system storage metadata （ in other words ,Ceph Block device and Ceph Object storage is not used MDS ）. The metadata server makes POSIX Users of file system , It's ok Ceph Under the premise of the burden caused by the storage cluster , Perform such as ls、find Etc .

#Ceph Data writing process

Above is Ceph Flow chart of storage, reading and writing of , As you can see from the diagram ,Ceph Save some objects , Every object has its own id be called oid, Then load it into a folder similar to storing objects PGs, adopt hash+ Mask operation oid In a way that produces pgid, Indicates where the object is located PG in .
Re pass CRUSH The algorithm is put into the corresponding Ceph The corresponding node in the cluster OSD, Different algorithms , Fall on OSD The location is also different , A copy is generated . You can follow the rack Rack host host As the basis of the algorithm, the distribution is different OSD.

# Said at the end

Precisely because Ceph With the function of open source and perfect storage , Many large domestic manufacturers of distributed storage are learning from Ceph Technology , Expand the function .
Take several product cases of domestic manufacturers . among , Enterprise class distributed storage products deeply convinced by domestic security manufacturers EDS, It can be seen that the storage protocols it supports are all for reference Ceph Supported functions .

The other is xsky Star and sky , Publish all types of storage , Also in Ceph Custom extension based on .

The country is " the 14th Five-Year Plan " The plan proposes to include open source in the development plan of digital economy , I believe that under the good environment of national policies supporting open source , Open source series Ceph It will certainly become half of the distributed storage solutions .UP Brother Nan, help the little friends come here first , Later, through the feedback used by the big guys , I will break down other tools in detail . Welcome to join the group 11372462, communication IT Industry development and knowledge , I feel this article is useful , You can also ask for attention CSDN Or scan the QR code , Focus on UPWEN The public, .UP Nange continues to output the purest IT Industry development and knowledge ！