Apache dolphin scheduler version 3.0.0-beta-1 was released, and flinksql and Zeppelin task types were added

Reading guide ： In recent days, ,Apache Dolphin Scheduler In the 3.0.0-beta-1 The official release of the version . The new version is mainly aimed at 3.0.0-alpha The code and documentation have been repaired , Some functions are introduced , Such as support FlinkSQL Task type , newly added Zeppelin Task type , newly added Kubernetes namespace management function , And by bash Parameter transfer function, etc , See below for specific updates .

01 new function

Support FlinkSQL Task type

In this version , We expanded Flink Task type , Enable it to run Flink SQL Mission , Its use sql-client.sh Submit tasks .

More details ：

flink sql client](https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sqlclient/)

Corresponding PR：9840

【 link 】

https://github.com/apache/dolphinscheduler/pull/9840

newly added Zeppelin Task type

In this version , We added Zeppelin Task type , Used to create and execute Zeppelin Types of tasks .Worker When performing this task , Will pass Zeppelin Cient API Trigger Zeppelin Notebook The paragraph .

PR：9810

【 link 】

https://github.com/apache/dolphinscheduler/pull/9810

newly added Kubernetes namespace management

This version adds kubernetes namespace management function , Allow users to Apache DolphinScheduler In the management Kubernetes Of namespace.

PR：9303

【 link 】：

https://github.com/apache/dolphinscheduler/pull/9303

New pass shell Component to get local parameters

The new version also adds the pass bash The function of parameter transmission , If you want to use... In downstream tasks bash Variables instead of constant values export Parameters , You can go through setValue and Bash Variable implementation , It's more flexible , It allows you to dynamically access existing local or HTTP resources Get and set variables .

You can use a similar syntax ：

PR：9586

【 link 】

https://github.com/apache/dolphinscheduler/pull/9586

Allow users to upload files without suffixes

Previously, the content center could only upload files with suffixes , stay 3.0.0-beta-1 After version , We support users to upload files without suffixes .

02 Bug Fix

• 3.0.0-alpha Problems in various deployment methods

• The page reports an error when the task group is empty

• treemap View depth error

• The alarm information is not clear ： When the alarm group is empty, the error message is not clear , When there is an exception in the batch deletion workflow, the error message is not clear , Error prompt for wrong length of tenant content , Delete

• Parameter verification problem ： Parameter verification of data source center , Prompt for inconsistent passwords when changing passwords , Verify before alarm alert script

• Python api： Cannot set release state problem , The local parameter has a value but the verification fails

• token Query does not follow time zone

• Repair HTTPS and HTTP String recognition problem

• Repair alert server Health monitoring failure

• Repair condition Task branch failure problem

• Repair docker Images do not support multi platform issues

• Fix the problem that the workflow with task group priority cannot write the database correctly when it is created

• master Task failure

• Fix the problem that serial waiting does not work

• Time zone problem ： Scheduling time zone error , Log add time zone support

• Rerun 、 Failed to pause workflow instance

• Resource Center instantiation failed

03 Document revision

• Correct the deployment document

• Repair 、 Update the part using the document ：WebexTeams Chinese document , Local parameters 、 Global parameter document ,Kubernetes FAQ file ,Spark Notes documentation ,DataX Using document , Delete Flink API file , Repair open-api Error of , Fix wrong documents in data quality ; newly added stand-alone Switch database documents ; newly added shell Medium judgement Yarn Running status document ; Add and update system screenshot

• Correct some development documents ： Identify supported operating systems , Repair the development environment setup document , Add your own build docker Mirror documents

04 Specific modification

Can be in ：https://github.com/apache/dolphinscheduler/releases/tag/3.0.0-beta-1 Find all modification records in .

05 thank 3.0.0-beta-1 Version contributors

Amy0104, BaoLiang, caishunfeng, calvin, chuxing, czeming, Dannila, Devosend, Eric Gao, exmy, gaojun2048, guoshupei, HeChuan, hstdream, jiachuan.zhu, Jiajie Zhong, JinYong Li, Kerwin, kezhenxu94, labbomb, leiwingqueen, lidongdai, litiliu, LongJGun, longtb, Lyle Shaw, mans2singh, mazhong, Mr.An, naziD, nobolity, Paul Zhang, PJ Fanning, qianli2022, QuakeWang, rockfang, songjianet, sparklezzz, sq-q, Town, Tq, WangJPLeo, wangyang, worry, wqxs, xiangzihao, yimaixinchen, youzipi, zhuxt2015, zixi0825, Chen Jiaming , Chen Shuang , Wang Yang