Open source project - taier1.2 release, new workflow, tenant binding simplification and other functions

2022 year 7 month 26 Japan ,Taier1.2 Official release ！

This release updates the function ：

• New workflow

• newly added OceanBase SQL

• newly added Flink jar Mission

• Data synchronization 、 Real time collection supports dirty data management

• Hive UDF

• Console UI upgrade

• Tenant binding simplification

The new version of the usage document has been pushed in the community , You can download it at any time , Welcome to experience the functions of the new version （ Like our project, welcome to order Star）, Experience address ：

Github:

https://github.com/DTStack/Taier

Gitee：

https://gitee.com/dtstack_dev_0/taier

Community ：

https://dtstack.github.io/Taier/

Taier1.2 Version introduction

Taier It is a big data distributed visualization DAG Task scheduling system , Aimed at reducing ETL Development costs 、 Improve the stability of big data platform , Big data developers can Taier Develop business logic directly , Instead of caring about the complex dependencies of tasks and the architecture implementation of the underlying big data platform , Focus more on the business .

Taier Born in kangaroo cloud number stack , The technical implementation comes from several stacks of distributed scheduling engines DAGScheduleX, It is one of the important infrastructures of several stacks of products , Be responsible for scheduling and running all task instances of big data platform .

2022 year 2 month 22 Japan ,Taier Officially open source and release 1.0 edition .

2022 year 5 month 8 Japan ,Taier1.1 Version release , Update right Flink Upgrade your support to Flink1.12, Support multiple flow type tasks and other functions .

2022 year 7 month 26 Japan ,Taier1.2 Version release , This release focuses on adding workflow functions , Realize configurable orchestration business ; Tenants simplify binding , Different types of computing components have no forced dependency and other functions .

Taier1.2 Detailed explanation of new functions

1. New workflow

Drag the task node to the drawing board through visual operation , Manually connect upstream and downstream tasks to form dependencies , To form a DAG The workflow of the . At the same time, any type of tasks can be dragged through the workflow , Directly realize the configurable orchestration business

2. newly added OceanBase SQL

newly added OceanBaseSQL Mission , Support OceanBaseSQL Task scheduling and operation and maintenance display .

3. newly added Flink jar Mission

Support uploading customized development Flink jar Mission , adopt Taier Submit operation and monitoring .

4. Data synchronization 、 Real time collection supports dirty data management

Data synchronization 、 Real time collection supports dirty data management , You can configure the amount limit and storage method of dirty data , It can be saved to the database for real-time viewing .

5.Hive UDF

Hive SQL Support udf Function development configuration .

6. Console UI upgrade

Console interaction and page new upgrade , Display component configuration information through tree structure , At the same time, it supports extending custom components for configuration .

7. Tenant binding simplification

Cluster and tenant binding simplification , Remove the tenant docking cluster schema Forced binding relationship , There is no mandatory dependency for different types of computing components ; Optimize the logic of task development process , Support custom extended task types .

The future planning

Taier Since this year, 2 Since the open source in January , Iterations updated Taier1.1、Taier1.2 Two versions , at present Taier1.3 The version of is already under planning , In the new version, we will focus on solving the following problems ：

• Support Flink Standalone Do not rely on Hadoop You can also use Flink Related functions , Reduce the environmental cost of getting started

• Adaptive developer Window Environmental Science , Support Window Task submission process in environment

• DatouSourceX Version update , Add more data source type support

In addition to constantly maintaining iterative updates ,Taier Will continue to maintain a monthly live broadcast of open source technology , help Taier Developers better use products , Welcome interested partners to join our communication community （ nailing qun：30537511）, Communicate together Taier Technical problems and difficulties , and Taier Make progress together ！

The source of the original ：VX official account “ Several stack Study Club ” Kangaroo cloud open source framework nail technology exchange group （30537511）, Students interested in big data open source projects are welcome to join us to exchange the latest technical information , Open source project library address ：https://github.com/DTStack