当前位置:网站首页>dolphinscheduler3. X local startup
dolphinscheduler3. X local startup
2022-07-07 06:32:00 【HuntFalcon】
One 、 Basic software installation ( Please install the necessary items by yourself )
- PostgreSQL (8.2.15+) or MySQL (5.7 series ) : Choose one of the two
- JDK (1.8+) : Must install
- ZooKeeper (3.4.6+) : Must install
stay ZooKeeper Create a new zkData、zkLog Folder
take conf In the catalog zoo_sample.cfg file , A copy of , Rename it to zoo.cfg, Modify the data and log configuration , Such as :
dataDir=/data/zookeeper/data ## Use absolute path here
dataLogDir=/data/zookeeper/datalog
function ./bin/zkServer.sh
- Hadoop (2.6+) or MinIO : Optional packaging , If you need to use the resource upload function , For a single machine, you can choose the local file directory as the upload folder ( This operation does not require deployment Hadoop); Of course, you can also choose to upload to Hadoop or MinIO On the cluster
- Maven: v3.5+, Alibaba cloud warehouse address is enough
- Node: v16.13+ (dolphinScheduler Version below 3.0, Please install node v12.20+)
Two 、 Download source code to local
https://github.com/apache/dolphinscheduler.git
3、 ... and 、 Switch to the specified branch , for example 3.0.0-xxx
Four 、 Switch to dolphinscheduler-ui Execute under directory npm install
The prompt after success is as follows :
5、 ... and 、 Skip test compilation
The prompt after successful compilation is as follows
6、 ... and 、 Execute database script
-- Before executing the script , Create database
CREATE DATABASE `dolphinscheduler`;
7、 ... and 、 Parent pom Medium mysql rely on scope notes
Refresh pom rely on
8、 ... and 、 modify dolphinscheduler-master and dolphinscheduler-worker as well as dolphinscheduler-api To configure , Change to your local database configuration
driver-class-name: com.mysql.cj.jdbc.Driver
url: jdbc:mysql://127.0.0.1:3306/dolphinscheduler?useUnicode=true&characterEncoding=utf8&zeroDateTimeBehavior=convertToNull&useSSL=true&serverTimezone=GMT%2B8
Nine 、 Start a local ZooKeeper
Ten 、 Start the program
(1) Start the front end npm run dev
(2) start-up MasterServer
(3) start-up WorkerServer
(4) start-up ApiApplicationServer
11、 ... and 、 Access front page
admin dolphinscheduler123
========================================================================
Twelve 、 If the scheduling task needs to be started locally, it needs to be modified Hadoop Some configuration of
(1)dolphinscheduler-dao Put the module down core-site.xml and hdfs-site.xml
(2) modify dolphinscheduler-common Under the module of common.properties To configure
The parameters to be modified are
# According to the location of the post software on the server
data.basedir.path=/data/software/dolphins3
# modify by HDFS File server storage mode
resource.storage.type=HDFS
# hdfs The file server stores the location of resources uploaded by the scheduling system resource.upload.path=/data/dolphinscheduler3# hdfs Cluster communication url
fs.defaultFS=hdfs://xxx.xxx.xxx.xxx:8020
# yarn Explorer ips
yarn.resourcemanager.ha.rm.ids=xxx.xxx.xxx.xxx
After configuration, you can create new files and upload resources
13、 ... and 、 Source packing , For server deployment
# pack
mvn -Dmaven.test.skip=true clean package install -Prelease
边栏推荐
- ICML 2022 | explore the best architecture and training method of language model
- 博士申请 | 上海交通大学自然科学研究院洪亮教授招收深度学习方向博士生
- Which foreign language periodicals are famous in geology?
- Rk3399 platform development series explanation (WiFi) 5.52. Introduction to WiFi framework composition
- 屏幕程序用串口无法调试情况
- 2022Android面试必备知识点,一文全面总结
- Matlab / envi principal component analysis implementation and result analysis
- 程序员的日常 | 每日趣闻
- JMeter's own functions are not enough? Why don't you develop one yourself
- 进程间通信之共享内存
猜你喜欢
博士申请 | 上海交通大学自然科学研究院洪亮教授招收深度学习方向博士生
Developers don't miss it! Oar hacker marathon phase III chain oar track registration opens
Haqi projection Black Horse posture, avec seulement six mois de forte pénétration du marché des projecteurs de 1000 yuans!
JMeter function assistant - random value, random string, fixed value random extraction
程序员的日常 | 每日趣闻
Overview of FlexRay communication protocol
力扣62 不同路径(从矩阵左上到右下的所有路径数量) (动态规划)
Ant manor safety helmet 7.8 ant manor answer
Common problems of caching in high concurrency scenarios
FlexRay通信协议概述
随机推荐
骑士战胜魔王(背包&dp)
JVM in-depth
ceres-solver和g2o性能比较
Rk3399 platform development series explanation (WiFi) 5.53, hostapd (WiFi AP mode) configuration file description
基于ADAU1452的DSP及DAC音频失真分析
Jmeter自带函数不够用?不如自己动手开发一个
Markdown 并排显示图片
Find duplicate email addresses
C interview encryption program: input plaintext by keyboard, convert it into ciphertext through encryption program and output it to the screen.
PostgreSQL database timescaledb function time_ bucket_ Gapfill() error resolution and license replacement
uniapp开发小程序如何使用微信云托管或云函数进行云开发
Redis (II) - redis General Command
C面试24. (指针)定义一个含有20个元素的double型数组a
请问如何查一篇外文文献的DOI号?
软件测试到了35岁,真的就干不动了吗?
string(讲解)
jmeter 函数助手 — — 随机值、随机字符串、 固定值随机提取
Redisl garbled code and expiration time configuration
[SOC FPGA] custom IP PWM breathing lamp
Handling hardfault in RT thread