Common cases of hybrid cloud exercises

Dedicated line active / standby switchover

framework

• user IDC Access at least two Tencent cloud leased line access points through physical leased lines , Realize high availability and load sharing of lines at the physical level .
• The dedicated line gateway is based on DSR The system design , Integrated DSR colony , As Tencent cloud and IDC Bridges and IDC The local router forms a virtual private channel , Through Tencent cloud VPC perhaps CCN Realize resource interoperability .
• DSR The cluster provides 2 A Tencent cloud boundary IP Address implementation control plane routing double active mechanism （active-active system）, such IDC The side local router passes through BGP The agreement is with two DSR The clusters have established BGP Neighborhood , Effectively guarantee DSR High availability of services in case of cluster upgrade or single cluster failure , Avoid single factor BGP The impact on the service caused by the routing convergence caused by neighbor interruption .
• At the same time DSR The cluster dynamically adjusts and eliminates abnormal service nodes through the real-time monitoring mechanism , The availability of a single cluster is guaranteed ; Large scale cluster expansion technology is adopted among clusters , Realize the horizontal expansion of user services among multiple clusters , Ensures cross cluster availability .

The goal is

The verification mainly includes the following points ：

• When a single physical dedicated line fails , The business traffic can be automatically switched to the disaster recovery dedicated line .

Experimental design

Line failover

When a physical line is detected 1 failure , The system automatically switches the flow to the physical line 2, Ensure the normal operation of the business . After troubleshooting , The flow is automatically switched back .

fault simulation

1. Confirm the drill time with the business personnel , adopt SSH, Log in to IDC The corresponding fault in is injected into the router ,shutdown Corresponding dedicated line routing port .
2. Observe whether the service request traffic is automatically switched to the router B On .
3. Restore the router A Dedicated line port of

Hybrid cloud service switching drill

framework

• To configure DNS Point to CLB,CLB The backend is bound to the corresponding cloud CVM Server resources and IDC ECS in the computer room .
• Cloud database is configured with DTS The synchronization task synchronizes data to the offline cloud database
• Through the special line VPN, Realize the intercommunication of cloud and cloud requests .
• Server resources are configured Mysql Of Proxy, To configure Proxy Probe Mysql Of HA.

The goal is

• Verify that when the cloud server appears AZ When it breaks down , By configuring CLB health examination , Automatically eliminate abnormal RS Port machine , Automatically switch traffic to the off cloud server
• Verify that the cloud database has an unreadable fault , configured CLB health examination , The delay will be high （ Health check response threshold exceeded ） Seven layer path of RS Ports are automatically culled , Forward to offline ;Mysql Of Proxy take effect , Automatically request offline cloud databases .

Experimental design

Server list AZ Downtime

Simulate a cloud server AZ Downtime . adopt Tencent cloud chaos drill platform Inject... Into the cloud server 【 Network interruption 】 Failure of , Simulate server downtime . Observe whether the business traffic is normally switched to the cloud ; Whether the network path shown in the following figure is running

Database unreadable

adopt Tencent cloud chaos drill platform Inject into the cloud database 【 The master-slave instance is unreadable 】 Failure of , Simulate database downtime . Observe whether the business flow is normal . Configured CLB Whether the health check is effective .

fault simulation

Server list AZ Downtime

1. Sign in Tencent cloud chaos drill platform , Select the fault injection type CVM, Then select the corresponding fault action 【 The Internet 】-->【 Network interruption 】, After configuring relevant parameters , Click on 【 perform 】 Start injecting fault .

2. Observe whether the business traffic is normally switched to the cloud through relevant monitoring indicators .

1. perform 【 Network interruption 】 The recovery action of , Restore the cloud server network , Observe whether the business traffic is switched back normally .

Database unreadable

1. Sign in Tencent cloud chaos drill platform , Select the fault injection type CDB, Then select the corresponding fault action 【 Both primary and read-only instances are unavailable 】, After configuring relevant parameters , Click on 【 perform 】 Start injecting fault .

2. Observe whether the database request is normally switched to the cloud through relevant monitoring indicators .

1. perform 【 Both primary and read-only instances are unavailable 】 The recovery action of , Restore the cloud server network , Observe whether the business traffic is switched back normally .
2. Reconfigure bidirectional DTS.

Reference material ：

• Cloud leased line high availability hybrid cloud network best practices
• Build a two-way synchronous data structure
• CLB Hybrid cloud deployment