当前位置:网站首页>Restore backup data on S3 compatible storage with br
Restore backup data on S3 compatible storage with br
2022-07-06 08:03:00 【Tianxiang shop】
This paper introduces how to combine S3 On compatible storage SST Restore the backup data to AWS Kubernetes In the environment TiDB colony .
The recovery method used in this article is based on TiDB Operator Of Custom Resource Definition (CRD) Realization , Bottom use BR Data recovery .BR Its full name is Backup & Restore, yes TiDB Command line tools for distributed backup and recovery , Used to deal with TiDB Cluster for data backup and recovery .
Use scenarios
When using BR take TiDB The cluster data is backed up to Amazon S3 after , If needed from Amazon S3 Will back up SST( Key value pair ) Restore files to TiDB colony , Please refer to this article to use BR Resume .
Be careful
- BR Only support TiDB v3.1 And above .
- BR The recovered data cannot be synchronized to the downstream , because BR Direct import SST file , At present, the downstream cluster has no way to obtain the upstream SST file .
This article assumes that it will be stored in Amazon S3 Specify the path on spec.s3.bucket
In the bucket spec.s3.prefix
The backup data under the folder is restored to namespace test2
Medium TiDB colony demo2
. The following is the specific operation process .
The first 1 Step : Prepare to restore the environment
Use BR take S3 Restore the backup data on the compatible storage to TiDB front , Please follow these steps to prepare the recovery environment .
Download the file backup-rbac.yaml, And execute the following command in
test2
This namespace Create what is needed for recovery RBAC Related resources :kubectl apply -f backup-rbac.yaml -n test2
Grant remote storage access .
- If the data to be recovered is Amazon S3 On , There are three ways to grant permissions , Refer to the documentation AWS Account Authorization .
- If the data to be recovered is compatible with other S3 On the storage of , for example Ceph、MinIO, have access to AccessKey and SecretKey Mode Authorization , Refer to the documentation adopt AccessKey and SecretKey to grant authorization .
If you use it TiDB Version below v4.0.8, You also need to do the following . If you use it TiDB by v4.0.8 And above , Please skip this step .
Make sure you have the recovery database
mysql.tidb
TabularSELECT
andUPDATE
jurisdiction , Used for adjusting before and after recovery GC Time .establish
restore-demo2-tidb-secret
secret For storing access TiDB Clustered root Account and key .kubectl create secret generic restore-demo2-tidb-secret --from-literal=password=${password} --namespace=test2
The first 2 Step : Restore the specified backup data to TiDB colony
According to the remote storage access authorization method selected in the previous step , You need to use the corresponding method below to restore the backup data to TiDB:
Method 1: If it passes accessKey and secretKey Method of authorization , You can create
Restore
CR Recover cluster data :kubectl apply -f resotre-aws-s3.yaml
restore-aws-s3.yaml
The contents of the document are as follows :--- apiVersion: pingcap.com/v1alpha1 kind: Restore metadata: name: demo2-restore-s3 namespace: test2 spec: br: cluster: demo2 clusterNamespace: test2 # logLevel: info # statusAddr: ${status_addr} # concurrency: 4 # rateLimit: 0 # timeAgo: ${time} # checksum: true # sendCredToTikv: true # # Only needed for TiDB Operator < v1.1.10 or TiDB < v4.0.8 # to: # host: ${tidb_host} # port: ${tidb_port} # user: ${tidb_user} # secretName: restore-demo2-tidb-secret s3: provider: aws secretName: s3-secret region: us-west-1 bucket: my-bucket prefix: my-folder
Method 2: If it passes IAM binding Pod Method of authorization , You can create
Restore
CR Recover cluster data :kubectl apply -f restore-aws-s3.yaml
restore-aws-s3.yaml
The contents of the document are as follows :--- apiVersion: pingcap.com/v1alpha1 kind: Restore metadata: name: demo2-restore-s3 namespace: test2 annotations: iam.amazonaws.com/role: arn:aws:iam::123456789012:role/user spec: br: cluster: demo2 sendCredToTikv: false clusterNamespace: test2 # logLevel: info # statusAddr: ${status_addr} # concurrency: 4 # rateLimit: 0 # timeAgo: ${time} # checksum: true # Only needed for TiDB Operator < v1.1.10 or TiDB < v4.0.8 to: host: ${tidb_host} port: ${tidb_port} user: ${tidb_user} secretName: restore-demo2-tidb-secret s3: provider: aws region: us-west-1 bucket: my-bucket prefix: my-folder
Method 3: If it passes IAM binding ServiceAccount Method of authorization , You can create
Restore
CR Recover cluster data :kubectl apply -f restore-aws-s3.yaml
restore-aws-s3.yaml
The contents of the document are as follows :--- apiVersion: pingcap.com/v1alpha1 kind: Restore metadata: name: demo2-restore-s3 namespace: test2 spec: serviceAccount: tidb-backup-manager br: cluster: demo2 sendCredToTikv: false clusterNamespace: test2 # logLevel: info # statusAddr: ${status_addr} # concurrency: 4 # rateLimit: 0 # timeAgo: ${time} # checksum: true # Only needed for TiDB Operator < v1.1.10 or TiDB < v4.0.8 to: host: ${tidb_host} port: ${tidb_port} user: ${tidb_user} secretName: restore-demo2-tidb-secret s3: provider: aws region: us-west-1 bucket: my-bucket prefix: my-folder
In the configuration restore-aws-s3.yaml
When you file , Please refer to the following information :
- About compatibility S3 Storage related configuration , Please refer to S3 Storage field introduction .
.spec.br
Some parameters in are optional , Such aslogLevel
、statusAddr
、concurrency
、rateLimit
、checksum
、timeAgo
、sendCredToTikv
. more.spec.br
Detailed explanation of fields , Please refer to BR Field is introduced .- If you use it TiDB by v4.0.8 And above ,BR Will automatically adjust
tikv_gc_life_time
Parameters , Don't need to Restore CR Middle configurationspec.to
Field . - more
Restore
CR Detailed explanation of fields , Please refer to Restore CR Field is introduced .
Create good Restore
CR after , You can view the status of the recovery through the following command :
kubectl get rt -n test2 -o wide
边栏推荐
- 数据治理:微服务架构下的数据治理
- [t31zl intelligent video application processor data]
- Oracle time display adjustment
- The State Economic Information Center "APEC industry +" Western Silicon Valley will invest 2trillion yuan in Chengdu Chongqing economic circle, which will surpass the observation of Shanghai | stable
- TiDB备份与恢复简介
- Linked list interview questions (Graphic explanation)
- 从 TiDB 集群迁移数据至另一 TiDB 集群
- 数据治理:误区梳理篇
- [Yugong series] creation of 009 unity object of U3D full stack class in February 2022
- Description of octomap averagenodecolor function
猜你喜欢
[research materials] 2021 live broadcast annual data report of e-commerce - Download attached
Learn Arduino with examples
esRally国内安装使用避坑指南-全网最新
. Net 6 learning notes: what is NET Core
[research materials] 2022 enterprise wechat Ecosystem Research Report - Download attached
Nacos Development Manual
The ECU of 21 Audi q5l 45tfsi brushes is upgraded to master special adjustment, and the horsepower is safely and stably increased to 305 horsepower
Sanzi chess (C language)
Description of octomap averagenodecolor function
How to prevent Association in cross-border e-commerce multi account operations?
随机推荐
Analysis of Top1 accuracy and top5 accuracy examples
07- [istio] istio destinationrule (purpose rule)
(lightoj - 1410) consistent verbs (thinking)
Machine learning - decision tree
MySQL view tablespace and create table statements
Database basic commands
Learn Arduino with examples
二叉树创建 & 遍历
备份与恢复 CR 介绍
Sanzi chess (C language)
数据治理:数据质量篇
On why we should program for all
"Friendship and righteousness" of the center for national economy and information technology: China's friendship wine - the "unparalleled loyalty and righteousness" of the solidarity group released th
National economic information center "APEC industry +": economic data released at the night of the Spring Festival | observation of stable strategy industry fund
Linked list interview questions (Graphic explanation)
Artcube information of "designer universe": Guangzhou implements the community designer system to achieve "great improvement" of urban quality | national economic and Information Center
[非线性控制理论]9_非线性控制理论串讲
从 SQL 文件迁移数据到 TiDB
[Yugong series] creation of 009 unity object of U3D full stack class in February 2022
Personalized online cloud database hybrid optimization system | SIGMOD 2022 selected papers interpretation