One article explains in detail the exploration and practice of eventmesh landing on Huawei cloud

This paper is compiled from 51CTO Open source basic software learning season live broadcast open class 《​ ​EventMesh How to solve SaaS Standardization of composite application integration ​​》, More wonderful content and open class videos , Click the link to jump to view .

Gartner 2020 The survey shows that ： To 2024 year ,30% Of e-commerce enterprises will adopt combined application innovation （PBC）.

about PBC,Gartner That's how it's defined ：PBC Are multiple data models with clear business capabilities 、 Microservices 、API Application and event channel integration . It is business driven , Able to fulfill business requirements independently , No need for external dependence . Multiple PBC Enterprise solutions can be built in building blocks , Present a complete and unified user experience .

The following figures are single PBC、 Combine PBC And multiple combinations PBC Schematic diagram .

PBC It is especially suitable for e-commerce business scenarios , Its value includes ：

• Business driven SaaS application , Truly solve every business problem
• Do not lock in a single supplier , Purchase and develop the best application services
• Low code integrated application , Agile online , Efficient iteration
• Encapsulate the underlying technology , Shielding technology to achieve , Easier to update technology

PBC Challenges include ：

• There is no unified standard for application integration
• Application protocol diversification ：HTTP, TCP, MQTT, AMQP wait
• Application data model diversification ：OpenAPI, AsyncAPI

Let's focus on today's topic ——Apache EventMesh, It is a cloud native event driven distributed application runtime , Can provide lightweight 、 Multilingual client , Support multiple communication protocols , Is a plug-in architecture , It can connect with other back-end services .

The picture below is EventMesh The overall structure of , Support TCP、HTTP、gRPC Other protocols , Can also support Java、Python、C、Go Wait for multilingual clients . Vertically and horizontally , Through plug-in, various back-end services required by developers can be connected .

EventMesh How does it work ？ It is an event driven middleware , There are two roles involved ： Event producer 、 Event consumer . Event producers send events to EventMesh,EventMesh Store events , This event store can support RocketMQ、Kafka.

The functions of middleware include ：

• Multithread concurrent and asynchronous invocation based on thread pool , Increase request concurrency
• Performance requirements for event production and consumption , Configure thread pool parameters independently
• Event consumption adopts load balancing and retry mechanism , Ensure successful event consumption
• Verify the event 、 Filter 、 Routing and transformation , Support advanced event handling capabilities
• As an event bus , Support a variety of low-level event storage through plug-in

EventMesh Yes SaaS How do composite application scenarios work ？SaaS The biggest problem of composite application is integration standardization , and EventMesh Nature can solve this problem .EventMesh adopt gRPC Support for multiple languages SDK, Integrate TCP and HTTP agreement .gRPC Google open source is based on HTTP/2 A high performance RPC frame , Support Client and Server Two way asynchronous communication .gRPC The data model is unified , Unified use Protobuf Definition API Interface data model , Unified by CloudEvents Define the event model .

stay EventMesh Of gRPC In the frame , We support gRPC Event usage scenarios include ： Event sending and batch event sending 、 Event broadcast 、 Event request and response 、 Event subscription and push .

stay gRPC Of Protobuf In event model , Each event is preceded by SimpleMessage Data model rendering , The entity content of the event is placed in content In the field ,CloudEvents It is a popular event model in the industry .

gRPC Integrated EventMesh TCP and HTTP agreement , Make the runtime and client more lightweight .

Since last year , Huawei cloud began to conduct extensive research , We hope to build a serverless event bus on the cloud . At this time we found that EventMesh The concept of Huawei cloud is very similar to Huawei cloud , Strong ability . So we hope EventMesh Continue to be bigger , It can be implemented in Huawei cloud —— This is the event grid (EventGrid) Birth background , It is a new generation of serverless event bus launched by Huawei cloud Middleware in the cloud native era .

EventGrid With EventMesh As a runtime engine , Added Huawei's own features , Includes visual dashboards 、 Advanced event filtering 、 Event query tracking 、 Dead letter storage, etc , These are all our self-developed products . Whole EventGrid Connect Huawei cloud services in an event driven manner 、 Microservice applications and SaaS application . Its value to us is , It is hoped that this service can create more application scenarios for Huawei cloud , Enrich the developer ecology of Huawei cloud .

EventGrid The whole architecture diagram follows EventMesh Is very similar ：

EventGrid What are the scenarios in Huawei cloud ？

such as ERP scene , When a new employee is hired ,HR The system generates a new employee registration event , adopt EventGrid Push new employee welcome email , notice IT The system is equipped with new computer equipment , Send the new employee information of the finance department .

For example, e-commerce scene , Warehouse goods receipt Events 、 The incident of store customers entering the store passed EventGrid Real time flow to online analysis system , Let us know the current stock of goods in the store and customers' purchase preferences , And push relevant advertisements to the store guide . After the customer pays online , Order information is sent to EventGrid, And trigger the third party logistics company to deliver goods to the door . Customers can view the transportation status in real time through logistics events .

EventGrid Huawei is building a digital integration center (Digital Integration Hub) An important part of . It undertakes ROMA Connect Event flow of the integration platform , Complete multicloud through messages and events 、 Cross cloud application integration and SaaS Integration of partner application services . Its event driven architecture platform is also the key to the success of Huawei cloud .

EventGrid The official source of events has exceeded 50 individual , Including intelligent edge platform 、 Data access services 、 Container image service, etc , The main thing is Beta Version stage , Serve Huawei cloud . Of course, you can also create custom event sources .

In Huawei cloud , By adopting EventMesh, We can implement visual event subscription , Support multiple event targets ; Besides , Event source supports event filtering ; in addition , Event targets also support event transformation .

expectation EventMesh The future of , There are two points , First of all EventMesh The workflow of the , We hope ：

• Using event driven architecture makes workflow orchestration simple and clear
• Applications only need to subscribe to events of interest , Send the event to the other party's topic
• It is suitable for transaction processing scenarios between microservices (Saga)
• You can access functions , Create function workflow (Serverless Workflow)

The second is EventMesh Federal governance ：

• Breaking the data silos , Integrated multicloud 、 Cross region data and events
• Achieve cross regional disaster tolerance ,EventMesh Inter event forwarding
• Through real-time analysis and big data collection , And platform independent connectivity and support for open standards , Realize cross region 、 Cross enterprise event federal governance
• Transition from data Anarchy to joint governance and mature enterprise data strategies
• utilize an instrument , Change policy validity into code , Visualization 、 Can be viewed 、 Adjustable

​ ​ Want to know more about open source , Please visit ：​​

​ ​51CTO Open source basic software community ​​

​ ​https://ost.51cto.com/#bkwz​​