Release of dolphin scheduler video tutorial in Shangsi Valley

DolphinScheduler It's a distribution 、 Extensible visualization DAG Workflow task scheduling platform , Committed to solving the complex dependencies in the data processing process , Make scheduling system use out of the box in data processing flow .

This set of tutorials is organized by the big data teaching and research team of shangsilicon Valley and DolphinScheduler The development team jointly launched , be based on DolphinScheduler 2.0.5 edition , Continue the consistent style of Shang Silicon Valley video tutorials , Multi angle research on version compatibility with other big data frameworks , The deployment and installation process of the manager is given , And configure the workflow 、 Dependency settings 、 The parameter settings are explained in detail .

The tutorial is about the infrastructure of the framework , Introduce the main role of the role , Demonstrate common uses beyond , They also made advanced explanations , This paper discusses the relevant skills of work circulation , Depending on how resources are referenced , How to complete email alarm , And how to re run the workflow when it fails . It can be called nanny level explanation , From installation to optimization , All the operations are done at once , Take you easy to master DolphinScheduler！

Tutorial directory

01. Tutorial introduction

02. Core architecture

03. Deploy - Deployment mode description

04. Deploy - Software and hardware environment requirements

05. Deploy - Cluster planning

06. Deploy - preparation

07. Deploy - Create a metabase

08. Deploy - Configure one click deployment script

09. Deploy - Initialize database

10. Deploy - One key deployment

11. Deploy - summary

12. Based on using - summary

13. Based on using - Security Center （ On ）

14. Based on using - Security Center （ Next ）

15. Based on using - project management

16. Based on using - Workflow definition

17. Based on using - Run the workflow

18. Based on using - Run the workflow regularly

19. Work spread - Local parameters & Global parameter

20. Work spread - Upstream and downstream parameter transmission

21. Work spread - Parameter priority

22. Work spread - Built in parameters

23. Work spread - Resource Center

24. Warning notice - Prepare the mailbox

25. Warning notice - Alarm group & Alarm instance configuration

26. Warning notice - test

27. Workflow failed and rerun .