Cloud practice of key business migration of Internet of things by well-known Internet housing rental service companies

Introduction

A well-known Internet house rental service company in China

Based on its own IOT platform products and services , It's close 50 Ten thousand owners 、300 Million customers provide services , Manage listings over 100 Ten thousand rooms .

By creating a cover To C and To B Quality residential products 、 Smart life services 、 Smart home decoration 、 Smart community organizations operate in four sectors , Gradually realize the online of the whole chain in the field of urban living 、 Data based 、 Intelligent platform capability .

To realize intelligent service capability , The company relies on the Internet of things platform to carry the intelligent door lock on the device side 、 Smart home （ Other equipment types ） And other intelligent devices .

In the early stage of platform construction , The company chose the distributed Internet of things message middleware EMQX The open source version supports the connection between the device side and the application layer MQTT Message access and message routing .

With the continuous expansion of business scale , Platform development begins to face new challenges .

Internet of things access bottleneck under the rapid development of business

To 2021 Mid year , The company's Internet of things platform has

Cumulative access MQTT Equipment over 50 Ten thousand units , The peak number of concurrent connections exceeds 10 ten thousand , Carrying the company 80% The business of .

With the rapid development of business , in the light of EMQX The operation and maintenance of the access layer also faces the following challenges ：

• Reliability requirements are improved ：
  Due to the platform equipment access volume and support, more and more applications , The business side puts forward higher requirements for the reliability and operability of the overall platform , therefore EMQX Operation and maintenance of the cluster SLA Also need to reach 99.99%.

• Cross version upgrade ：
  Because the previous platform used relatively old EMQX 2.x Build version , Some existing problems need to be upgraded to EMQX Only the latest version can solve . Now, EMQX The latest version has been upgraded to 4.x, For cross version upgrades , In particular, it is required that the business operation is not affected , It is difficult for the operation and maintenance team .

• Automatic horizontal expansion ：
  Considering that the business undertaken by the follow-up platform continues to increase , The operation and maintenance team also needs to expand the capacity of subsequent equipment access and business applications EMQX The cluster has the ability of relatively automatic horizontal expansion , To meet the demand of rapid on-demand capacity expansion in the process of continuous business expansion .

• Operation and maintenance monitoring is improved ：
  EMQX The open source version provides operation and maintenance monitoring API Co., LTD. , The operation and maintenance team needs more performance monitoring indicators to respond in advance to possible system risks . On the one hand, it requires EMQX The product provides more monitoring data , On the other hand, the operation and maintenance team is also required to improve the threshold judgment and response ability of operation and maintenance monitoring .

Combined with the above factors , Company consideration

use EMQ Provide commercial products and services to quickly improve the performance and capabilities of the current platform , Support business development .

Full custody MQTT Message services support business upgrading

EMQX At present, there are two modes of commercial products ：

Privately deployed EMQX Enterprise

and

Fully hosted public cloud services EMQX Cloud.

• EMQX Enterprise Installation, deployment, system migration, and 7*24 Technical support services for . But because the software is deployed in the customer's private environment ,EMQ Generally, the team cannot directly carry out the daily operation and maintenance services of middleware .

• EMQX Cloud You can provide full hosting based on the public cloud infrastructure MQTT Message access service , At the same time, the technical service team helps the customer 7*24 Daily operation and maintenance management , Free customers from worries .

 

meanwhile , Combine the company's R & D and operation and maintenance teams to upgrade the product version 、 Requirements for improvement of operation and maintenance monitoring ,EMQX Cloud It also has the following

advantage

：

• EMQX Cloud As fully managed MQTT Access services , Customers can choose to deploy in the business opportunity room of mainstream cloud factories at home and abroad , adopt VPC Through peer-to-peer connection EMQX Cloud Where the cluster is located VPC With the user's business application VPC, Data connection through intranet ,
  It can not only save traffic, but also ensure data transmission stability and bandwidth
  ;

• 7*24 24-hour round the clock operation and maintenance support services , It can provide users with 99.99% Of SLA.
  EMQX Cloud It contains rich cluster operation and maintenance monitoring indicators and early warning capabilities
  , The customer can be informed to make adjustment in time before the risk occurs .

• EMQX Cloud Design based on cloud native architecture , Provide automatic installation 、 Automatic cluster lifecycle management and elastic scalability .
  coordination EMQX Hot update and hot configuration capability , The fastest cluster expansion and version upgrade can be realized , Minimize the impact of upgrading and capacity expansion on the business .

be based on EMQX Cloud Provided by the

convenience

And

High availability guarantee

, After careful scheme comparison and consideration, the team of the company , Finally decided to adopt EMQX Cloud Services gradually replace EMQX Open source architecture .

Realize smooth system migration in a short time

In order to ensure the smooth operation of the business from the company's self operation and maintenance EMQX The open source cluster is migrated to EMQX Cloud In service ,EMQ The team provided complete testing and migration services through the whole process .

1.  Deployment plan development ：

According to the existing business and the demand for equipment access and data throughput in the short term ,EMQ The team has customized the deployment configuration and migration scheme , And sent a proprietary technology team to maintain continuous docking and communication with its development, operation and maintenance team .

2.  Deployment environment function test ：

Before the formal service migration ,EMQX Cloud The team deployed the corresponding test environment according to the deployment scheme , The customer's R & D and operation and maintenance team selected a small number of non production environment equipment for docking EMQX Cloud service .

The test content includes the public network IP And domain name settings 、SSL Security certificate generation and import 、 Device configuration update 、 Device to connect 、 Application docking 、 Equipment data acquisition and equipment control test, etc . After passing the complete business test , The basic function verification of equipment and business application docking is completed .

3.  Performance testing ：

Before the formal migration , According to the customer's requirements for the number of device connections and data throughput of the platform ,EMQ Team vs EMQX Cloud The deployment instance is tested for simulation performance . adopt EMQ Provided XMeter Large concurrency performance test platform , Simulate the user's device connection and message throughput on the production environment for performance testing .

Through the test, it is verified that the concurrent connection and throughput meet the needs of customers , It also limits the capacity of subsequent clusters 、 Monitoring threshold 、 The expansion plan has been customized ,

Provide reliable performance baseline data for the stable operation of subsequent platforms .

4.  Grayscale migration ：

Because the company has a large number of production environment equipment , To ensure that the migration process is stable and controllable , The overall migration process adopts the way of gray-scale migration .

The equipment end is based on different business types , Batch update migration to EMQX Cloud In service ; The business application side adopts the grayscale publishing method , The gray-scale publishing capability based on the background microservice architecture enables the migration to EMQX Cloud The new device is connected to the newly configured application service , The devices that have not been migrated are still connected to the original service .

The entire migration process is conducted on a weekly basis 10% The number of devices will be migrated . Every time some devices are migrated, they will run for a period of time , And monitor the operation of the system at any time , After confirming that the system operates stably for a period of time, the next batch of equipment will be migrated .

from 2021 year 12 Month to 2022 Beginning of the year , After multiple batches of migration , Basically completed most of the equipment and EMQX Cloud Docking work of .

Project progress and benefits

since 2022 Since the completion of equipment migration and docking at the beginning of the year ,

In the current production environment EMQX Cloud The total device connection of the deployment instance has been nearly 20 ten thousand , The peak number of concurrent online clients exceeds 13 ten thousand , The average message throughput exceeds 16K TPS.

The platform has been running stably for more than three months , There was no problem in the business during the period .

because MQTT The device access service is provided by EMQX Cloud Full custody ,

It is estimated that... Can be saved every year 2-3 people / Years of operation and maintenance work

, It saves a lot of operation and maintenance labor costs for the company's R & D and operation and maintenance team , You can focus more on other services and new business development . follow-up EMQ Yingyun technology will also continue to escort the business development of customers through professional and efficient products and services .