当前位置:网站首页>Cloud native (32) | kubernetes introduction to platform storage system
Cloud native (32) | kubernetes introduction to platform storage system
2022-07-06 23:12:00 【Lansonli】
List of articles
Kubernetes Introduction to platform storage system
Kubernetes Introduction to platform storage system
The storage system is a professional whole system , We only use common methods to build , The specific optimization needs to be adjusted with reference to the company's own products
One 、Ceph
Official website :https://ceph.io/
1、 Basic concepts
Ceph There can be
Ceph Object storage : Key value storage , The interface is simple GET,PUT,DEL etc. . Such as seven cattle , Alibaba cloud oss etc.
Ceph Block device :AWS Of EBS, Qingyun's cloud disk drive and Alibaba cloud's Pangu system , also Ceph Of RBD(RBD yes Ceph Block storage oriented interface )
Ceph file system : It has richer interfaces than block storage , Need to consider the directory 、 File attributes, etc , Implementing a file store that supports parallelization should be the most difficult .
One Ceph The storage cluster needs
At least one Ceph The monitor 、Ceph Manager 、Ceph OSD( Object storage daemons )
Need to run Ceph File system client , You need to deploy Ceph Metadata Server.
Monitors: Ceph Monitor (
ceph-mon
) The monitor : Maintain cluster state informationMaintain the mapping of cluster state , Including monitor mapping , Manager mapping ,OSD mapping ,MDS Mapping and CRUSH mapping .
These mappings are Ceph Critical cluster state necessary for daemons to coordinate with each other .
The monitor is also responsible for managing authentication between the daemon and the client .
Typically, at least three monitors are required to achieve redundancy and high availability .
Managers: Ceph Manager Daemon (
ceph-mgr
) : Responsible for tracking runtime metrics and Ceph The current state of the clusterCeph Manager Daemon (ceph-mgr) Responsible for tracking runtime metrics and Ceph The current state of the cluster
Including storage utilization , Current performance indicators and system load .
Ceph Manager Daemons also host based on python Module , To manage and disclose Ceph Cluster information , Including based on Web Of Ceph Dashboard and REST API.
Usually , At least two managers are required to achieve high availability .
Ceph OSDs: Ceph OSD ( Object storage daemons ,
ceph-osd
) 【 Store the data 】By checking other Ceph OSD The daemon's heartbeat to store data , Dealing with data replication , recovery , Rebalance , And to Ceph Monitors and managers provide some monitoring information .
Usually at least 3 individual Ceph OSD To achieve redundancy and high availability .
MDSs: Ceph Metadata Server (MDS,
ceph-mds
ceph metadata server )Storage can represent Ceph File System Metadata ( Such as :Ceph Block device and Ceph Object storage is not used MDS).
Ceph The metadata server allows POSIX File system users execute basic commands ( Such as ls,find etc. ), Not to Ceph Storage clusters are a huge burden
Two 、Rook
1、 Basic concepts
Rook It is a storage orchestration tool for cloud native platforms
Rook Here's how it works :
Rook The structure is as follows
RGW: by Restapi Gateway
2、operator What is it?
k8s in operator+CRD(CustomResourceDefinitions【k8s Custom resource type 】), It can quickly help us deploy some stateful application clusters , Such as redis,mysql,Zookeeper etc. .
Rook Of operator It is our k8s A parser that interacts between a cluster and a storage cluster
CRD:CustomResourceDefinitions ( Custom resources ); Such as :Itdachang
operator: This can handle custom resource types
- Blog home page :https://lansonli.blog.csdn.net
- Welcome to thumb up Collection Leaving a message. Please correct any mistakes !
- This paper is written by Lansonli original , First appeared in CSDN Blog
- When you stop to rest, don't forget that others are still running , I hope you will seize the time to learn , Go all out for a better life
边栏推荐
- GPT-3当一作自己研究自己,已投稿,在线蹲一个同行评议
- CUDA exploration
- 服务器的系统怎么选者
- Devsecops software R & D security practice - release
- CSDN 上传图片取消自动加水印的方法
- MySQL实现字段分割一行转多行的示例代码
- Slide the uniapp to a certain height and fix an element to the top effect demo (organize)
- The statement that allows full table scanning does not seem to take effect set odps sql. allow. fullscan=true; I
- Modules that can be used by both the electron main process and the rendering process
- ICLR 2022 | pre training language model based on anti self attention mechanism
猜你喜欢
云原生(三十二) | Kubernetes篇之平台存储系统介绍
ICLR 2022 | 基于对抗自注意力机制的预训练语言模型
How to confirm the storage mode of the current system by program?
每人每年最高500万经费!选人不选项目,专注基础科研,科学家主导腾讯出资的「新基石」启动申报...
【全网首发】Redis系列3:高可用之主从架构的
专为决策树打造,新加坡国立大学&清华大学联合提出快速安全的联邦学习新系统
儿童睡衣(澳大利亚)AS/NZS 1249:2014办理流程
Word2vec (skip gram and cbow) - pytorch
Case recommendation: An Qing works with partners to ensure that the "smart court" is more efficient
Isomorphism + cross end, knowing applet +kbone+finclip is enough!
随机推荐
欧洲生物信息研究所2021亮点报告发布:采用AlphaFold已预测出近1百万个蛋白质
Redis 持久化机制
儿童睡衣(澳大利亚)AS/NZS 1249:2014办理流程
华为云GaussDB(for Redis)揭秘第21期:使用高斯Redis实现二级索引
C three ways to realize socket data reception
【全网首发】Redis系列3:高可用之主从架构的
Hard core observation 545 50 years ago, Apollo 15 made a feather landing experiment on the moon
Improving Multimodal Accuracy Through Modality Pre-training and Attention
Bipartite graph determination
动作捕捉用于蛇运动分析及蛇形机器人开发
What does front-end processor mean? What is the main function? What is the difference with fortress machine?
Isomorphism + cross end, knowing applet +kbone+finclip is enough!
QT信号和槽
Word2vec (skip gram and cbow) - pytorch
浅谈网络安全之文件上传
Why are some people still poor and living at the bottom of society even though they have been working hard?
Graphite document: four countermeasures to solve the problem of enterprise document information security
Custom swap function
Huawei cloud gaussdb (for redis) unveils issue 21: using Gauss redis to achieve secondary indexing
Spark Tuning (II): UDF reduces joins and judgments