Unified scheduling and management of dataX tasks through web ETL

DataX It is a powerful data integration platform , But none WEB The management interface makes DataX There are many problems in task management and scheduling , It is difficult to manage and maintain when there are many tasks , At the same time, the cost of using and learning is relatively high . Today, let's introduce RestCloud ETL How to manage and dispatch quickly DataX Mission , through Web The interface is convenient for scheduling DataX The task of , enhance DataX Management and alarm capabilities .

  First log in Restcloud ETL platform

  After creating a new process in the application , Open the design process to find DataX The scheduler component is dragged into the canvas

（ Running on the current server ）

  You can directly specify... On the current server DataX The task file runs . Good configuration DataX Directory address of 、 The name of the task and the parameters required for the run-time are sufficient . You can also dynamically configure the runtime JVM Parameters .

（ Remote server running ）

It's fine too Directly specify the... Running on the remote server DataX Task file . Just configure the server information .

As shown in the above figure, click Run after saving the information of the node DataX The task of .

 （DataX Task run log ）

Through the task log, you can clearly see DataX Task execution and error messages , There is no need to go to the server to find the corresponding log .

 （ Process monitoring diagram ）

The number of successful and failed intelligent analysis tasks , stay WEB The interface is clear .

  After the task is OK, you can arrange a scheduled execution time for the process .

 （ Alert information configuration ）

If an error is reported, you can set a pin message or enterprise wechat message in the event to notify the operation and maintenance personnel , Deal with problematic tasks immediately , That's it DataX The problem that the task fails to be notified .

Passed above RestCloud ETL Just finished quickly DataX Unified scheduling of tasks .