Introduction to distributed scheduling xxl-job features

Recent home office , For distributed scheduling XXL-JOB Understand and learn about open source components , Later, we will continue to share articles on distributed scheduling , For beginners, you can learn and understand how to use distributed scheduling , For students who are already using distributed scheduling , You can think about your use , Are there any problems , How to solve it by yourself , Welcome to discuss .

Today's topic is ： Distributed scheduling XXL-JOB Characteristics of

Why share its features , The main reasons are as follows ：

1、 When selecting technology , You need to know what your pain points or needs are ？

2、 Among many technical components , What are their characteristics , It is not only necessary to consider the development access cost , We also need to consider the maintenance cost at the later stage of operation and maintenance , The most important thing is to be highly available 、 Telescopic 、 Scalable 、 Support distributed

Distributed scheduling is described below XXL-JOB Characteristics of ：

1、 Simple ： Supported by Web Page face task 、 Actuator, etc CRUD, It's easy to operate , Quick start （ Those who have seen the source code should know xxl-job The interface is freemarker）

2、 dynamic ： Support in xxl-job Modify the task status in the background management interface of （ start-up / stop it ） And terminate the running task , Immediate effect .

3、 Dispatching center HA（ Central ）： The dispatching center adopts central design , Self research scheduling components and support cluster deployment , Ensure the dispatching center HA.（HA Indicates high availability ）

4、 actuator HA（ Distributed ）： Task distributed execution , Cluster executor support , It can guarantee the execution of tasks HA.（ actuator ： Is that you rely on xxl-job-core Business applications for ）

5、 Registry Center ： The actuator automatically registers tasks periodically , The dispatching center will automatically discover the registered tasks and trigger the execution , meanwhile , Support manual input of actuator address on the screen .

6、 Elastic expansion and contraction ： Once a new actuator machine goes online or offline , The task will be reassigned the next time it is scheduled .

7、 Trigger strategy ： It provides rich task triggering strategies , Among them is Cron Trigger 、 Fixed interval trigger 、 Fixed delay trigger 、API Trigger 、 Manual trigger 、 The parent-child task triggers

8、 Schedule expiration policy ： The compensation processing strategy of missing scheduling time in dispatching center , Some of them ignore 、 Immediate compensation triggers a wait .

9、 Blocking strategy ： The processing strategy when the scheduling is too intensive for the executor to process , Strategies include ： Stand alone serial （ Default ）、 Discard subsequent scheduling 、 Coverage before scheduling

10、 Task timeout control ： Support custom task timeout , When the task runs out of time, it will interrupt the task

11、 Task failed retry ： Support custom task failure retries , When the task fails, it will actively retry according to the preset number of failed retries , The fragmentation task supports the failure retry of fragmentation granularity .

12、 Task failure alert ： By default, email failure alarm is provided , At the same time, the extension interface is reserved , Can easily expand SMS 、 Nail and other alarm methods

13、 Routing strategy ： The executor cluster deployment provides rich routing strategies , Including the first 、 the last one 、 Training in rotation 、 Random 、 Uniformity HASH、 The least used 、 Most recently unused 、 Fail over 、 Busy transfer, etc .

14、 The task of broadcasting by film ： When the executor cluster is deployed , When the task routing strategy selects fragment broadcasting , A task scheduling will broadcast and trigger all executors in the cluster to execute a task , You can develop sharding tasks according to sharding parameters ;

15、 Dynamic segmentation ： The task of sharding broadcast is to shard in the dimension of actuator , Support dynamic expansion of actuator cluster to dynamically increase the number of slices , Cooperate in business processing ; The task processing ability and speed can be significantly improved when large data volume business operations are carried out .

16、 Fail over ： The task routing strategy is selected in the case of failover , If a machine in the actuator cluster fails , It will automatically Failover Switch to a normal actuator to send scheduling requests

17、 Task progress monitoring ： Support real-time monitoring of task progress

18、Rolling Real time log ： Support online viewing of scheduling results , And support with Rolling Mode to view the complete execution log output by the actuator in real time

19、GLUE： Provide Web IDE, Support online development of task logic code , Dynamic release , Real time compilation takes effect , Omit the process of deploying online . Support 30 The historical versions of versions go back .

20、 Script task ： Support with GLUE Pattern development and running script tasks , Include Shell、Python、NodeJS、PHP、PowerShell And so on

21、 Command line task ： Native provides common command line tasks Handler（Bean Mission ,CommandJobHandler）, The business party only needs to provide orders

22、 The task depends on ： Support configuration of subtask dependency , When the execution of a character is completed and successful, it will actively trigger the execution of a subtask , Multiple subtasks are separated by commas .

23、 Uniformity ： The dispatch center passes DB Locks ensure the consistency of cluster distributed scheduling , One schedule will only trigger one execution

24、 Custom task parameters ： Support online configuration of scheduling task input parameters , Immediate effect

25、 Scheduling thread pool ： Scheduling system multithreading trigger scheduling run , Make sure the schedule is executed accurately , Not blocked

26、 Data encryption ： The communication between the dispatching center and the actuator is encrypted , Improve the security of scheduling information

27、 Mail alarm ： Support email alarm when task fails , Support the configuration of multi mail address group sending alarm mail

28、 push maven The central warehouse ： Will push the latest stable version to maven The central warehouse , It is convenient for users to access and use

29、 Run report ： Support real-time viewing of operation data , Such as the number of tasks 、 Scheduling times 、 Number of actuators, etc ; Scheduling reports, such as scheduling date distribution 、 Dispatch success distribution diagram, etc

30、 The asynchronous ： Task scheduling process full asynchronous design and implementation , For example, asynchronous scheduling 、 Run asynchronously 、 Asynchronous callback, etc , It can effectively reduce the peak flow of intensive dispatching , Theoretically, it supports the operation of any long-term task

31、 Cross language ： Scheduling center has nothing to do with the language provided by the actuator RESTful API service , Any third-party language can connect with the dispatching center or implement the actuator . besides , It also provides “ Multitasking mode ” and “httpJobHandler” And other cross language solutions

32、 internationalization ： The dispatching center supports internationalization settings , Provide Chinese 、 English is an alternative language , The default is Chinese

33、 Containerization ： Provide official docker Mirror image , And update the push in real time dockerhub, Further realize the product out of the box

34、 Thread pool isolation ： Schedule the thread pool for isolation splitting , Slow task auto degradation entry “Slow” Thread pool , Avoid running out of scheduling threads , Improve system stability

35、 User management ： Support online management system users , There are administrators 、 There are two roles for ordinary users

36、 Access control ： The dimension of the executor controls permissions , Administrators have full permissions , Ordinary users need to assign actuator permissions before allowing related operations .

By introducing distributed scheduling XXL-JOB Characteristics of , I hope it will be helpful for you in model selection or feature understanding , I also thank the open source authors for their contributions