Chengying, kangaroo cloud one-stop fully automated operation and maintenance steward, is officially open source

Original address ：

The exchange is divided into two parts , Wild geese fall and forget to return —— Kangaroo cloud one-stop fully automated operation and maintenance manager ChengYing（ Undertaker ） Official open source

 

Technical communication ：30537511（ Nail group ）

We are excited to announce a good news

DTstackCon New blood

Kangaroo cloud one-stop fully automated full life cycle operation and maintenance manager

ChengYing（ Undertaker ）

Official open source

Project address

Github Open source address ：

https://github.com/DTStack/chengying

Gitee Open source address ：

https://gitee.com/dtstack_dev_0/chengying

Official documents ：

https://dtstack.github.io/chengying-web/

This is the ChunJun（ Chun Jun ）、Taier（ name of a famous sword ） after , Kangaroo cloud data stack is the third open source sword of big data sword family , It is another milestone in the history of kangaroo cloud open source project , It represents the determination and efforts of several open source technology teams for open source .

One 、 Jiao branch bearing shadow

ChengYing（ Undertaker ）—— It inherits the concept of the famous sword family of the kangaroo cloud open source project , Taken from the shadow sword of the top ten famous swords .

ChengYing logo

It was cast in Shang Dynasty , When it comes out of the furnace, two sword lights fly out , Like a dragon , Yes “ Sub contractor , Wild geese fall and forget to return ” Words , Hence the name Chengying . Chengying wears a sword for the emperor of Shang , Later, it was collected by Kongzhou, a famous sword collector in the state of Wei in the spring and Autumn period , It is said that its shadow is invisible , Move randomly for Qi , It stands for the meaning of guarding every moment , just as ChengYing As a kangaroo cloud number stack Operation and maintenance manager , Providing big data products One stop deployment 、 Operation and maintenance 、 Monitoring service , Provide customers with safe and stable product deployment and monitoring .

Two 、 edge Qi bearing shadow

ChengYing Born out of kangaroo cloud data stack, it is a one-stop operation and maintenance manager EasyManager, stay ChengYing Before the official open source , The open source technology team first opened a remote unified management host last year Agent Systems designed for the life cycle ——EasyAgent, As EasyManager Key components of , Can realize the installation of stack service 、 upgrade 、 uninstall 、 Start stop and configuration management .

stay EasyAgent After open source , It has been widely supported by the students in the community , At the same time, the community is concerned about EasyManager The voice of open source is getting louder and louder , People who hold the kangaroo technology “ From open source , Give back to open source ” Our consistent original intention , Several stacks of open source technology teams decided to EasyManager That is to say ChengYing Open source , and EasyAgent As ChengYing Agent Meet you again .

Through unremitting efforts , What was once conceived has finally come true today .ChengYing（ Undertaker ） As a one-stop fully automated full life cycle operation and maintenance manager , Provide one-stop deployment of big data products 、 Operation and maintenance 、 Monitoring service , It enables product deployment 、 Product upgrades 、 Version rollback 、 Expansion and contraction nodes 、 Log diagnosis 、 Cluster monitoring 、 Real time alarm and other functions , Committed to maximizing O & M cost savings , Reduce the online failure rate and the difficulty of operation and maintenance , Provide customers with safe and stable product deployment and monitoring .

3、 ... and 、 shape since bearing shadow

ChengYing Of logo The design follows the concept of ten famous swords , Combined with the characteristics of the project itself , In letters “Y” Design the main element for , Combine the sharpness and sharpness of the sword to design , Use solid triangles to reflect the product “ Stable ” Characteristics of , The inverted triangle represents the product “ brace ” Characteristics of , And choosing a darker blue also reflects our “ Behind the scenes ” Characteristics .

LOGO The main body is written in letters “Y” And hexagonal geometry , It's complete 、 There are combinations 、 There is a distribution 、 It conveys that the core concept of the project is a fully automated life cycle operation and maintenance manager , Its functions are diverse and stable .

Four 、 front Out bearing shadow

ChengYing As a one-stop fully automated and full life cycle operation and maintenance manager , It has the following six characteristics ：

1► Automated Deployment

ChengYing The product installation package is produced through standardized steps and parameter conventions , Release... In the package Schema All services in the installation package are configured in the file , Including the configuration parameters of each service 、 Health check parameters , Dependencies between services, etc . The product can be deployed according to Schema One click fully automated deployment is realized by the relevant configurations in .

2► Interface cluster operation and maintenance

Hadoop colony 、 The node expansion and reduction involved in the daily operation and maintenance of the big data platform 、 Component stop start 、 Service rolling restart 、 Service parameter modification 、 Various operation and maintenance operations such as version upgrade and rollback , Through logic 、 Process oriented product interface presentation , It is convenient for operation and monitoring personnel , Improve operation and maintenance efficiency .

3► Instrument cluster monitoring

By integrating open source prometheus and grafana, Implement the cluster 、 service 、 Core parameter monitoring of nodes , And display the data through the flexible and visual instrument panel . contain CPU Occupancy rate ,RAM Usage rate 、 disk space 、I/O Read / write rate and other core parameters are monitored , Master the cluster in real time 、 service 、 The running state of the node , Reduce the O & M failure rate . meanwhile , Support user built dashboards and monitoring items , Implement custom monitoring items .

4► Real time alarm

It supports real-time monitoring of the running indicators of each component service in the cluster , Such as CPU、 Memory 、 disk 、 Reading and writing IO etc. , And support SMS 、 nailing 、 Mail alarm channel configuration , Integrate a variety of third-party message plug-ins . When an exception occurs in the cluster service , Alarm conditions can be triggered , The system will notify the recipient in time .

5► Strong expansibility

Through self-study ChengYing Agent Server Abstract out seven REST Interface , install 、 start-up 、 stop it 、 to update 、 Configuration modification 、 uninstall 、 Execution, etc. interact with the upper application , Can make agent Categories and functions can be easily and infinitely expanded .

6► Safe and stable

Data security 、 Product safety is a key consideration for big data products .ChengYing Filter out in product design rm、drop And so on , Prevent MIS operation of the database , Execute relevant commands in a safer way . At the same time, it provides rolling restart of services 、 Power off and restart of the product , Solve the scenario that the service does not stop running during O & M and save O & M time .

►ChengYing Operation page

Four 、 bearing shadow Overlapping generation

ChengYing It is a one-stop deployment for big data products 、 Operation and maintenance 、 Standard products monitored , It can be used for enterprises to quickly build their own big data platform , Based on the functions already implemented in the existing version , future ChengYing Will plan ：

1) Service Orchestration ： Support automatic orchestration based on host role and service type , Reduce labor costs ;

2) Deployment way ： Support customized deployment package pipeline sequence ;

3) Safety certification ： Support cluster startup Kerberos authentication , Bill generation and download ;

4) Monitoring alarm ： Support based on PromQL Custom alarm settings for , Rich alarm types ;

5) Butt joint the outside ： Support external connection LDAP Connect ;

6) operating system ： Support ubuntu System host access .

6、 ... and 、 Wild goose fall forget return

Today we open source ChengYing, We know that open source is not the end , And it's just the beginning . from 2018 In, we started our first open source project ,4 Over the years, we have successively opened source ChunJun（ primary FlinkX）、FlinkStreamSQL、jlogstash、EasyAgent、Doraemon、Molecule、Taier Projects such as , During this period, we have been exploring technological breakthroughs , Share the latest technological achievements with you , I also get a lot of help from many community students , Grow up with everyone in an atmosphere of mutual assistance and sharing .

future , We will continue to uphold “ From open source Give back to open source ” At first , Continue to launch ChengYing Follow up version , At the same time, we welcome more companies and individuals to participate in the developer team , Give Way ChengYing The community is more robust 、 Healthy development , Let more people enjoy the technology dividends brought by open source ！