Actual cases and optimization solutions of cloud native architecture

Preface

With the popularity of cloud computing and the wide application of cloud native , More and more practitioners 、 Decision makers are clearly aware of 「 Yunyuan biochemical will become a key element of enterprise technological innovation , It is also the shortest path to complete the digital transformation of enterprises 」. therefore , Internet enterprises with forward-looking thinking have been rooted in the cloud since the birth of applications , Prudent new retail 、 The government 、 Finance 、 Enterprises and institutions in medical and other fields are also gradually migrating business applications to the cloud , Deep use of cloud native technology and cloud native architecture . Face architecture design 、 Different business scenarios from development mode to deployment, operation and maintenance , Applications based on cloud native architecture usually carry out technology life cycle design according to the technical characteristics of cloud , Maximize the flexibility of cloud platform 、 Distributed 、 self-help 、 On demand and other product advantages . With the help of the following typical practice cases , Let's take a look at how enterprises use cloud native architecture to solve the long lead time 、 Low resource utilization and practical business problems .

Case a ： Shentong express core business system Yunyuan biochemical cloud case

Background and challenges

As one of the fastest growing logistics enterprises , Shentong express has been actively exploring the road of technological innovation enabling business growth , In order to achieve the purpose of reducing cost and increasing efficiency . at present , The daily order processing volume of Shentong express has reached tens of millions , Billion level logistics track processing capacity , Data generated every day has reached TB Level , Use 1300+ A computing node to process business in real time .

In the past, the core business applications of Shentong express operated in IDC Computer room , The original IDC The system helps Shentong survive the early period of rapid business development . But with the exponential growth of business volume , Business forms are becoming more diversified . The original system has exposed many problems , Tradition IOE framework 、 The architecture of each system is not standardized 、 stability 、 R & D efficiency limits the possibility of rapid business development . Software delivery cycle is too long , It is difficult to realize the special requirements for resources 、 Business problems such as difficulty in ensuring system stability are gradually exposed .

After many requirements communication and technical verification with Alibaba cloud , Shentong finally determined Alibaba cloud as the only partner , Adopt cloud native technology and architecture to realize the relocation of core businesses to Alibaba cloud .2019 Since, the business has gradually changed from IDC Migrate to alicloud . at present , The core business system has completed traffic acceptance on Alibaba cloud , Provide stable and efficient computing power for Shentong .

Native cloud solutions

The original architecture of Shentong core business system is based on Vmware+Oracle Database to build . With the relocation to alicloud , The overall transformation of the architecture is based on
Kubernetes Cloud native architecture system of . among , The key point of the whole application service architecture reconstruction is to introduce cloud native database and complete the application container based microservice transformation .

• Introduce cloud native database

By introducing OLTP Follow OLAP Type database , Split online data and offline analysis logic into two databases , Change previous complete dependence Oracle Current situation of database . Meet the requirements of processing historical data query Oracle The actual business needs that the database cannot support .

• Apply containerization

With the introduction of containerization Technology , Through the application of containerization, the problem of inconsistent environment is effectively solved , Ensure that the application is under development 、 test 、 Consistency of production environment . Compare with virtual machine , Containerization provides double improvement of efficiency and speed , Make the application more suitable for the micro service scenario , Effectively improve the efficiency of production and Research .

• Micro service transformation

In the past, many businesses were based on Oracle Stored procedures and triggers to complete , Service dependency between systems also needs Oracle database
OGG Synchronization complete . The problem caused by this is that the system maintenance is difficult and the stability is poor . By introducing Kubernetes Service discovery of , To form a
Microservice solutions , Split the business by business domain , Make the whole system easier to maintain .

Comprehensively consider the actual business needs and technical characteristics of Shentong , Finally, I chose 「 Alibaba cloud ACK+ Dragon + Cloud database 」 Cloud native solutions for , So as to realize the migration of core applications to Alibaba cloud .

Architecture description

infrastructure , All computing resources are from Alibaba cloud's DPCA bare metal server . Compared with the general cloud server （ECS）,Kubernetes With DPCA server, you can get better performance and more reasonable resource utilization . And the resources on the cloud are taken on demand , It is very important for Shentong, which has short-term and large flow business scenarios such as large promotion activities . Compared with the offline self built machine room 、 Standing machines , Cloud resources are available on demand . After the promotion activity , Resources on the cloud can be released after they are used , Lower management and procurement costs , Corresponding efficiency .

Traffic access , Alibaba cloud provides two sets of traffic access , One is for public network requests , The other is service internal calls . Domain name resolution using cloud DNS
And PrivateZone. With the help of Kubernetes Of Ingress Ability to realize unified domain name forwarding , To save the public network SLB The number of , Improve the efficiency of operation and maintenance management .

Platform level

be based on Kubernetes Cloud native PaaS The advantages of the platform are obvious .

Get through DevOps closed loop , Unified testing , Integrate , Advance 、 Production environment ;

Natural resource isolation , The utilization rate of machine resources is high ;

Traffic access can realize fine management ;

Integrated logs 、 Link diagnosis 、Metrics platform ;

Unified ApiServer Interfaces and extensions , Born to support multi cloud and hybrid cloud deployment .

Application service layer

Every app is in Kubernetes Create a separate one above Namespace, Resource isolation between applications . By defining the configuration of each application Yaml Templates , When the application is deployed, you can quickly complete the version upgrade by directly editing the image version , When rollback is required, start the fast rollback of the historical version of the image locally .

Mocha ITOM

on-line Kubernetes The cluster adopts Alibaba cloud managed container service , No operation and maintenance Master Node work , Just make Worker Node online and offline process can be . At the same time, all business systems pass Alibaba cloud PaaS The platform completes the business log search , According to the business requirements, we will launch the expansion task , The system automatically completes the expansion operation , Reduced direct operation Kubernetes Business risks brought by clusters .

Application benefits

Cost ： Using the public cloud as a computing platform , It can make enterprises do not have to meet the needs of sudden business growth , And a large amount of capital cost is invested in the purchase of servers and expansion cabinets . Pay as you go on the public cloud , For some innovative businesses, it is very convenient to do technical research . Release when used up , Pay as you go . In addition, cloud products are managed in the cloud without operation and maintenance , Effectively save labor operation and maintenance costs , Let enterprises focus more on their core business .
In terms of stability ： First , Cloud products provide at least 5 individual 9 The above SLA Service ensures system stability , The stability of self built system is far from that . secondly , Some open source software may have functions bug, Cause hidden trouble . Last , In terms of data security, cloud data can be easily backed up in different places , The archive storage products under Alibaba cloud's data storage system are highly reliable 、 Low cost 、 Security 、 Unlimited storage and so on , Make enterprise data more secure .

efficiency ： With the help of deep integration with cloud products , R & D personnel can complete one-stop R & D 、 Operational work . From business requirement approval to branch development , Then to test environment function regression verification , Finally, it will be deployed to pre issuance verification and online , The time of the whole continuous integration process can be reduced to minutes . In terms of troubleshooting , The R & D personnel directly select the application they are responsible for , And through integrated SLS The log console quickly retrieves the exception log of the program to locate the problem , It eliminates the trouble of logging in to the machine and checking the log .

Empowering business ： Alibaba cloud provides more than 300 More than kinds of cloud components , Component coverage calculation 、AI、 big data 、IOT And many other areas . R & D personnel use it out of the box , Effectively save the technical cost brought by business innovation .

Case 2 ： Perfect diary e-commerce business case

Background and challenges

As a bright star in the beauty industry , Perfect diary （Perfect Diary） Less than two years after the launch, it has become the top of tmall's cosmetics sales , By 2020 year 4 month , brand SKU exceed 700 individual , The number of fans in the whole network exceeds 2500 ten thousand , Monthly exposure 10 Billion +.

With the rapid development of the company's business , Technology operation and maintenance is facing very severe challenges . With “ double 11” E-commerce promotion 、“ double 12” Shopping Festival 、 Applet 、 Online live broadcast with goods shows an explosive growth trend , How to ensure the stable and smooth operation of the micro mall system has become the primary problem faced by the perfect diary . among , Some of the more prominent challenges include the following ：

System development iteration is fast , There are many online problems , Locating problems takes a long time ;

Frequent promotion , The pressure of system stability guarantee is very high , Third party interfaces and some slow SQL There is a risk of serious online failure ;

Pressure measurement and system capacity evaluation are relatively frequent , Lack of normalization mechanism support ;

The resources required for system promotion are quite different from daily resources , Need to expand and shrink frequently .

Native cloud solutions

Perfect diary has conducted in-depth communication and discussion with Alibaba cloud on the problems faced and future business planning . Solve business problems through Alibaba cloud native application stability solutions . Introducing alicloud container services ACK、Spring Cloud Alibaba、PTS、AHAS、 Link tracking and other supporting products , Container transformation and deployment of the application , Optimize supporting tests 、 Capacity assessment 、 Expansion and other R & D links , Improve the efficiency of production and research .

The key point of the scheme is ：

• Deploy by containerization , Take advantage of the fast elasticity of Alibaba cloud container services to cope with the rapid expansion of resources in the event of large promotion .

• Access link tracking products in advance , It is used to track complex service calls in distributed environment , Locate the abnormal service , Help customers quickly locate and repair problems in testing and production , Reduce impact on business .

• Use Alibaba cloud performance testing service （PTS） Carry out pressure test , Use the second flow to pull up 、 Real geographical location, traffic and other functions , Pressure test with the most real Internet traffic , Ensure the stable operation after the business goes online .

• Collect pressure measurement data , Analyze the strong and weak dependencies of the system 、 Key bottlenecks , For key business interfaces 、 Key third party calls 、 Database slow call 、 Current limiting protection for the overall load of the system .

• Cooperate with Alibaba cloud service team , Before the big promotion ECS/RDS/ Expansion of safety and other products 、 Link grooming 、 cache / Connection pool preheating 、 Monitor the production of large screen 、 Back end resource guarantee drill, etc , Help promote the smooth progress of .

Application revenue

High availability ： Take advantage of application high availability service products （AHAS） Current limiting degradation and system protection function of , Protect the key resources of the system , The water level of the whole system shall be thoroughly investigated , Promote the smooth development of , Ensure a smooth user experience .

Capacity assessment ： Use performance testing services （PTS） And real-time business monitoring （ARMS） Evaluate the single machine capacity and overall capacity of the system , Study and judge in advance the business limit that can be carried by a single machine and the whole , To ensure that reasonable resource planning and cost forecasting can be made for the demand of business promotion in the future .

Big promotion guarantee mechanism ： Through several cooperative exercises with Alibaba cloud service team , Establish the standard process and emergency mechanism of large-scale promotion and guarantee , Achieve the goal of promoting the normalization of social security .

Customer voice

“ Use ACK Container services can help us quickly pull up the test environment , utilize PTS Real time high concurrent flow pressure measurement to confirm the system water level , combination
ARMS monitor , Diagnose the performance bottleneck in the pressure test process , Finally through AHAS Conduct real-time current limiting and degradation for sudden traffic and unexpected scenes , With the support of Alibaba cloud team , It ensures the system stability and availability of every promotion activity , Simultaneous utilization ACK Rapid elastic expansion and contraction of container , Save server costs 50% above .”—— The person in charge of the perfect diary Technology Center

Case three ： Special step business case （ retail 、 Public cloud ）

Background and challenges

Founded on 2001 Special step in , As one of the leading sporting goods enterprises in China , Number of stores 6230 home .2016 year , Specially launched the third strategic upgrade of the Group , Create a consumer experience centered “3+”( Internet +、 sports + And the product +) The strategic goal of , Embrace Cloud Computing 、 Big data and other new technologies , Achieve business leadership and technological innovation , Support the steady progress of enterprise strategic change . Driven by the group strategy , Alibaba cloud middleware team was invited to talk to the special step IT Conducted in-depth research on informatization , Explore some challenges that hinder the implementation of the special step strategy ：

• The business suite cannot meet the diversified development requirements of Tebu business , For example, related business processes and organizational adjustments involved in multi brand split and reorganization . For Tebu , Traditional application systems are tightly coupled , The division and reorganization of business means that relevant systems must be re deployed .

• IT The burden of history is serious , There are many internal chimney systems . Through research , Alibaba cloud has found up to 63 special chimney systems , only IT There are more than 30 suppliers . Facing the sales involved in online and offline business integration 、 logistics 、 production 、 purchase 、 order-placing meeting 、 Design and other different links and scenes , Want to achieve Omni channel integration , We need to get through dozens of systems .

• High inventory 、 The problem of high stock shortage has always been a deadlock in the garment industry , Tebu is also troubled by these problems . The data cannot be online in real time due to the fragmentation of the system , And limited by traditional monomers SQLServer Database concurrency limit ,6000 The data of multiple stores can only be T+1 The method is returned to the headquarters , It directly affects the efficient collaborative turnover of inventory .

• IT The waste of construction cost is serious , Traditional business suite brings “ Chimney type ” The drawbacks of the system , It leads to repeated construction of many functions 、 Duplicate data model and unnecessary duplicate maintenance work .

Native cloud solutions

According to the strategic needs of special business transformation, Alibaba cloud , Customized Omni channel business midrange solution based on cloud native architecture , Merge common functions of different channels in the cloud 、 Standardization 、 share , Derive globally shared commodity centers 、 Channel center 、 Stock Center 、 Order center 、 Marketing center 、 User center 、 Settlement Center . No matter which line of business 、 Which channel 、 Which new product was born or adjusted ,IT Organizations can meet business needs , Rapid response based on the existing modules of the shared service center , Break the inefficient “ Chimney type ” Application construction mode . All channel businesses follow the principle of Internet architecture , Plan the online and offline loosely coupled cloud platform architecture , Not only completely get rid of tradition IT Slow down the business and achieve flexible support for rapid business innovation , Integrate Omni channel data financing on the shared service center platform , Make decisions for data 、 Precision marketing 、 Unified user experience has laid a good foundation for products and data , Let Tebu really embark on “ Internet +” The fast lane .

2017 year 1 In June, special step and Alibaba cloud launched the construction of Omni channel middle platform , Time consuming 6 Complete the demand survey in three months 、 Midfield design 、 R & D implementation 、 Delivery and deployment including test and verification , after 4 The whole country will be realized in next month 42 branches 、6000+ All stores were successfully launched . The following is the overall planning diagram of Tebu's Omni channel business ,

The following is the technical architecture diagram of cloud native middleware

Key points of Architecture ：

• Application side ： The new technology architecture comprehensively carries the relevant applications for different business departments , Including stores POS、 Online retailers OMS、 Distributors manage supply, marketing and inventory DRP、 Member customer management CRM. Besides , There will also be some intelligent analysis applications in Omni channel management , For example, inventory balance , At the same time, some configuration management of the omni channel can be simplified through the omni channel operation platform . All involve the general business capabilities of the enterprise, such as commodities 、 Orders, etc , You can directly call the capabilities of the Sharing Center , Let the app “ Lighter ”.

• Sharing Center ： Omni channel management involves participating in commodity categories 、 Order sourcing 、 Shared inventory 、 Business scenarios such as settlement rules , It also involves member information and marketing activities related to omnichannel . All these general business capabilities are deposited in the sharing center , Output real-time data to different business units / On-line / Unified / The ability to reuse . Directly send all the special orders / goods / Members and other information fusion 、 Precipitate together , Fundamentally eliminate data islands .

• Technical level ： In order to meet the elasticity 、 High availability 、 High performance and other requirements , adopt Kubernetes/EDAS/MQ/ARMS/PTS Wait in the middle of the cloud

• Products , At present, the special step core transaction link concurrency can support 10w/tps It also supports wireless capacity expansion and improves concurrency . Ali has been used for many years 11 Tested technology platform , stability / Efficiency has been guaranteed by high standards , Enable developers to focus more on business logic implementation , There's no more worries .

• infrastructure ： The underlying computing 、 Storage 、 Network, etc IaaS Layer resources .

• Background system ： Customer's internal background system , such as SAP、 Production system 、HR/OA etc. .

Application revenue

Zhongtai of Omni channel business has brought obvious changes to the upgrading of Tebu's core strategy , Gradually achieved IT Driving business innovation .

After the transformation of the middle stage ,POS The system is upgraded from offline to online . Including the cashier 、 stock 、 members 、 Including marketing POS The core business of the system is all provided by the business center , From weak control to strong group control , There is a real connection between the group and consumers , It has laid a solid foundation for the refined management of consumers .

The emergence of the middle stage , The global inventory sharing of front-end channels is realized , The inventory business is processed in real time by the inventory center . With the help of global inventory visualization , Transaction order status information flows in real time through all channels , The headquarters can directly guide the sales of offline stores according to the real-time operation data , Realize rapid cross store commodity provocation . After the middle stage goes online , The selling out rate has increased 8%, The shortage rate is reduced 12%, Increased turnover 20%, Enable front-line business .

IT Informatization drives business innovation , Merge and share similar functions of different channels in the cloud through the shared service center , Break the inefficient “ Chimney type ” application
The way of construction , Absorb the Internet DDD Domain Driven Design principles , Design online and offline loosely coupled cloud platform architecture , Not only completely get rid of tradition IT The stubborn disease that slows down the business and flexibly supports the rapid innovation of the business . Omni channel data financing is integrated on the platform of shared service center , Precipitate and build the core data assets of Tebu , Cultivate the most scarce “ be proficient in professional work , Know technology ” Innovative talents , Make it in enterprise business innovation 、 Play a central role in market competition . end 2019 Beginning of the year , The business department is right about IT Department recognition continues to rise , At present, almost all the omni channel business support systems are built independently ,80% The foreground applications have all been running on the middle stage , Truly realize technology driven enterprise business innovation .

That's all for sharing this article , If you are interested in cloud native architecture , Xiaobian also collated some cloud native data , WeChat official account “ Lao zhoula IT”