Cloud native database: the outlet of the database, you can also take off

Amazon cloud technology provides 100 Free packages for more than products . among , Computing resources Amazon EC2 First year 12 It's free for three months ,750 Hours / month ; Storage resources Amazon S3 First year 12 It's free for three months ,5GB Standard storage capacity ; Database resources Amazon RDS First year 12 It's free for three months ,750 Hours ;Amazon Dynamo DB 25GB storage capacity Free forever .

1、 About cloud native databases

The concept of cloud

Before we start, let's talk about the concept of cloud , The concept of cloud has been mighty for many years , Cloud server , Cloud database , Cloud services and so on . Set aside clouds and mist , Generally speaking, it is a remote service , But why is it called cloud ？ There are two characteristics similar to the cloud , On the one hand, the perception of service is senseless , Like clouds in the sky , On the other hand, it is indeed a remote service , Services are like the cloud , I can't touch it , Is it the cloud .

Cloud native database

The word "cloud native database" sounds like a bluff , It's better to get rid of the word "original" , It can be simply understood as cloud database , Don't consider the complex technology behind him , Only from the aspect of use , It is a set of database system placed elsewhere , It's insensitive to developers , What to do , There is no difference .

 

Where does the cloud native database come from ？ In this age of cloud services , Cloud native database comes into being with the emergence of cloud services , The bottom layer depends on some cloud services , The ECS hosts the database and is equipped with some management systems , Solve the pain points of traditional databases , Bring the advantages of database and cloud into full play .

2、 Technical comparison and analysis of traditional database and cloud native database

Traditional database

advantage

Every back-end student has been in contact with the database , When we are developing, we often install a database directly on the local computer , And then it was used directly , Isn't it easy ? Don't think about anything else , After the service goes online, the database is managed by the operation and maintenance department , This is the normal state of our development , It is also an efficient development method , After all, the database is directly local to us , We can do whatever we want , Take business as the primary objective , For example, we often use redis,mysql database , Do you care about his configuration ？ Do you care about his backup ？ Do you care about his data volume ？ Anyway, I don't care , I just work , High development efficiency , Easy to deploy .

shortcoming

The traditional database is very good for developing students , There are some problems after the service goes online , such as ： Maintenance difficult , Safety is difficult to guarantee , Difficulty in expansion , It is difficult to deal with machine faults , Delivery is troublesome .

1. Maintenance difficult

Safety of production data comes first , There is no room for error , Maintaining data security , Develop a reasonable backup strategy , The data needs to be repaired when a real problem occurs , When recovering data , It requires a lot of experience and technology , Professional operation and maintenance personnel are needed at this time DBA To operate , For some lightweight startups , Such conditions may not be met , As a result, online databases are always in danger , The cost is too high .

2. High hardware cost , Difficulty in expansion

The hardware cost of self built data center is high , In order to handle the peak business, you may buy too many hardware devices , The traditional database built by the self purchase server requires hardware procurement 、 Computer room trusteeship 、 Deploying machines and so on , Long cycle .

3. Low resource utilization

Because peak business exists , In the case of small business volume , It may cause low resource utilization , Unable to make rational use of resources , Waste of resources .

4. Difficult to handle machine failure

The self built data center is in the face of machine failure , Unable to switch services well , It takes a lot of manpower and material resources .

5. Delivery difficulties

In the traditional development mode , Delivery difficulties , We often encounter such problems , Environmental problems cannot be shielded , Cause a lot of time to deal with environmental problems .

Cloud native database technology analysis

The waves behind push the waves ahead , The cloud native database that emerged later solves the pain points of traditional databases , At the same time, it brings the advantages of cloud services into full play , Get in the car now ？ take off ！

1. High safety , Simple maintenance

The cloud native database comes with prevent DDos attack , Flow cleaning And so on . It's not easy to do it in your own home ？

Cloud native database , You can repair database security vulnerabilities by yourself , It saves the cost of technicians . Can you do it at home ？

The data security of the cloud native database is guaranteed by the manufacturer , Very professional , You can't afford it by yourself ？

2. elastic , High resource utilization

The advantage of cloud services is that you can purchase the services you need at any time , The same goes for cloud native databases , Buy whatever you want , Buy as many as you want , It is no more convenient to deploy servers than to buy one's own servers ？ It's just that wayward , It's so convenient .

First , Integrate computing resources , Pool computing resources , Use computing resources on demand through virtual machines ; secondly , Pay by volume , So that users can pay monthly, on time or even by seconds according to their usage , To save money .

3. The expansion is simple

Users can make use of the rapid deployment conditions of application software to expand their existing businesses and new businesses more simply and quickly . For example, equipment failure occurs in the cloud computing system , For users , Whether it's on the computer level , Or in the specific application will not be hindered , The dynamic expansion function of computer cloud computing can be used to effectively expand other servers . In this way, the task can be completed in an orderly way . In the case of dynamic expansion of virtualization resources , At the same time, it can effectively expand the application , Improve the operation level of computer cloud computing , Peace of mind .

4. Delivery is simple

Cloud native applications must be delivered according to standards , It can be deployed anywhere in the cloud that supports standards , This has nothing to do with location or environment , At the same time, build the dependent packages required by the application 、 Configuration files and back-end services are integrated with applications , Development of simple , Delivery is simple .

3、 The choice of cloud native database

The above describes many advantages of cloud native databases , It can be seen that this is the general trend , There is no need to work hard to build a self built data center , The key is still not done well , The cloud platform solves a thousand worries . But there are many cloud platform manufacturers , How to choose a manufacturer ？ It is necessary to combine the characteristics of each manufacturer according to its own business needs , Choose from your strengths .

Here is the leader of cloud manufacturers ： Amazon cloud , It is also used in work , Because Amazon cloud is global coverage , Can better adapt to the needs of globalization , The game goes to sea to earn a beautiful knife , It's delicious , meanwhile AWS Provide a complete and dedicated database , Savings can be realized more quickly 、 Development and innovation , Look at the below AWS Several advantages of cloud native database .

AWS Cloud native database advantages

Specifically build

Exceed 15 A specially built database engine , Including relational databases 、 Key value database 、 Document database 、 In memory database 、 Graphic database 、 Time series database 、 Wide column database and ledger database .

Scale performance

Get speed for common alternate databases 3-5 Multiple relational databases , Or provide you with a non relational database with microsecond to sub millisecond latency .

Full custody

AWS Continuously monitor your cluster to ensure that the workload is running with self-healing storage and automatic scaling , Enables you to focus on your application development efforts .

Safe and highly available

AWS Databases are built for business critical enterprise workloads , Provides high availability 、 Reliability and safety .

 

review ：AWS frigging awesome ！ Developers only need to focus on business development , The logistics part is solved by the cloud manufacturer .

4、Amazon MemoryDB for Redis

Here's an introduction AWS Of redis database , Because our game is mainly used to make leaderboards , Cross server function , The function of publishing and subscribing , Is a very important component , How do you use it in your work ？ Leave me a message .

MemoryDB of Redis Is a persistent in memory database service , Provides ultra fast performance . It is built for modern applications with a microservice architecture .

MemoryDB And Redis compatible , and Redis data structure 、API And commands to quickly build applications . Use Memory DB, All data is stored in memory , It can achieve microsecond read and write latency per millisecond and high throughput .MemoryDB It also uses multi zone transaction logs to span multiple zones (AZ) Persistent storage of data , For fast failover 、 Database recovery and node restart .

Memory DB Both in memory performance and multi availability persistence , High performance master database for microservice applications , This eliminates the need to manage cache and persistent databases separately .

MemoryDB Features include

• The consistency of the master node is strong , And ensure the final consistency of replica nodes .

• Microsecond read and one digit millisecond write latency , Up to per cluster 1.6 Billion TPS.

• Flexible and friendly Redis Data structure and API. You can easily build new applications or migrate existing ones with little modification Redis Applications .

• Use multi availability transaction log to realize data persistence , Provide fast database recovery and restart .

• Multi zone availability with automatic failover , Detect and recover from node failures .

• Easily expand horizontally by adding and removing nodes , Or by moving to a larger or smaller node type You can expand write throughput by adding shards , And expand the read throughput by adding replicas .

• Read-after-write The consistency of the master node and the final consistency of the replica node .

• MemoryDB Support encryption in transmission 、 Static encryption and by using access control lists (ACL) Authenticate users .

• Amazon S3 Automatic snapshots in , Retention time up to 35 God .

• Support Up to per cluster 500 Nodes and more than 100 TB Storage space （ Each slice has 1 Copies ）.

• Use TLS Encryption in transmission and static encryption AWS KMS The key .

• Redis User authentication and authorization to use the access control list (ACL) Authenticate users .

• Support for this item AWSGraviton2 Instance type .

• Integration with other companies AWS service , for example CloudWatch,Amazon VPC,CloudTrail, And for monitoring 、 Safe and informed Amazon SNS.

• Fully managed software patches and upgrades .

• AWS For management API Of Identity in Access Management (IAM) Integration and label based access control .

summary ： There are so many functions , I can think of it , I can't think of anything , comprehensive ！ major ！

MemoryDB Core components

Know what it is, know what it is , Here under MemoryDB Core components .

node

One node yes Memory The smallest building block for deployment , And use Amazon EC2 Instance operation . Each node runs the... Selected when creating the cluster Redis edition . A node belongs to a partition belonging to a cluster .

Each node runs the engine instance with the version you selected when you created the cluster . If necessary, the nodes in the cluster can be vertically expanded or reduced to different types . Each node in the cluster has the same node type . Support multiple types of nodes , Each type of node has a different amount of memory .

Fragmentation

Slicing is made by 1 to 6 A combination of nodes , One of them is used as the primary write node , in addition 5 Nodes are used as read-only copies .MemoryDB The cluster always has at least one shard .MemoryDB The cluster can have at most 500 A shard , Your data partitions are between shards . for example , You can choose to configure one 500 Cluster of nodes , Range 83 A shard （ A main partition and 5 Two copies shard ） and 500 A shard （ A main slice , No replica shards ） Between . Ensure that sufficient... Is available IP Address to meet growth needs . Common pitfalls include subnets in a subnet Group CIDR The range is too small , Or the subnet is shared and heavily used by other clusters .

Access control list

An access control list is a collection of one or more users . The access string follows RedisACL Rules authorize users to access Redis Commands and data .

Parameter group

Parameter groups are managed on the cluster Redis A simple way to set up at run time . Parameter is used to control memory usage 、 Project size, etc .MemoryDB Parameter groups are named collections of engine specific parameters that can be applied to a cluster , And all nodes in the cluster are configured in exactly the same way .

Just try it

It's no use talking about it , Go and experience it , It's free anyway .

1. Database free trial links and tutorials ： Try it out

2. Cloud native database online conference ： Cloud native database online conference

5、 Trend analysis of cloud database

If the public cloud manufacturer is compared to a highway company , So the highway is the public cloud platform , Cars running on the highway are like cloud native applications .

What is the future direction of cloud database ？ Personally, I think some things can be done better , For example, cloud database and distribution are combined , Lower the threshold for developers to use , The final database is further type insensitive , You don't have to worry about whether it's a relational database, a non relational database, or any other type of database , Just as a warehouse , The type of data is defined by the manufacturer , At the same time, further ensure data security , And further reduce costs , With the development of cloud service providers, some have been able to see , Some still need to be optimized , innovation .

summary

Enterprises ： In the cloud age, all services should be on the cloud , Not just because of convenience , It also saves costs , And efficient , Security .

manufacturer ： The services of cloud server manufacturers are becoming more and more complete ,aws As the pioneer of the cloud age , Has been in the leading position in cloud services , Cloud native database technology is also cutting-edge , I suggest you experience , Try it and you'll know if it smells good .

developer ： As a developer, learn to use the cloud native database early , Standing at the draught , Even a pig can take off , isn't it? ？

Fan benefits

Amazon cloud technology has created a variety of learning platforms for developers ：

1. Getting started Resource Center ： from 0 To 1 Easy to get started with cloud services , Content covered ： Cost management , Start training , Development resources .AWS introduction _AWS Getting started _AWS Cloud computing resources -AWS The cloud service

2. Architecture Center ： Amazon cloud Technology Architecture Center provides cloud platform reference architecture chart 、 Reviewed architectural solutions 、Well-Architected Best practices 、 Pattern 、 Icon, etc .AWS Architecture Center deployment description _AWS Cloud Architecture white paper -AWS The cloud service

3. Builder Library ： Learn how Amazon cloud builds and operates software .Amazon Builders' Library*all&awsf.filter-content-type=*all&awsf.filter-content-level=*all&trk=835e6894-d909-4691-aee1-3831428c04bd&sc_channel=el

4. Toolkit for developing and managing applications on Amazon cloud technology platform ：aws Download tool _aws development tool _ Download resources -AWS The cloud service

【 Exclusive benefits 】

Fukuichi ：100 Free packages for more than products . among , Computing resources Amazon EC2 First year 12 It's free for three months ,750 Hours / month ; Storage resources Amazon S3 First year 12 It's free for three months ,5GB Standard storage capacity .

https://aws.amazon.com/cn/free/?nc2=h_ql_pr_ft&all-free-tier.sort-by=item.additionalFields.SortRank&all-free-tier.sort-order=asc&awsf.Free%20Tier%20Types=*all&awsf.Free%20Tier%20Categories=*all&trk=e0213267-9c8c-4534-bf9b-ecb1c06e4ac6&sc_channel=el

Welfare II ： The latest discount gift bag ,200$ Data and analysis deduction voucher ,200$ Machine learning voucher ,200$ Micro service and application development deduction voucher . The latest offer _ Cloud server Promotion - Amazon cloud technology

Welfare three ： Solution CloudFormation One click deployment template library

Quick start to cloud service solution deployment _ Cloud service deployment -AWS The cloud service