当前位置:网站首页>dolphinscheduler3. X local startup
dolphinscheduler3. X local startup
2022-07-07 06:32:00 【HuntFalcon】
One 、 Basic software installation ( Please install the necessary items by yourself )
- PostgreSQL (8.2.15+) or MySQL (5.7 series ) : Choose one of the two
- JDK (1.8+) : Must install
- ZooKeeper (3.4.6+) : Must install
stay ZooKeeper Create a new zkData、zkLog Folder
take conf In the catalog zoo_sample.cfg file , A copy of , Rename it to zoo.cfg, Modify the data and log configuration , Such as :
dataDir=/data/zookeeper/data ## Use absolute path here
dataLogDir=/data/zookeeper/datalog
function ./bin/zkServer.sh
- Hadoop (2.6+) or MinIO : Optional packaging , If you need to use the resource upload function , For a single machine, you can choose the local file directory as the upload folder ( This operation does not require deployment Hadoop); Of course, you can also choose to upload to Hadoop or MinIO On the cluster
- Maven: v3.5+, Alibaba cloud warehouse address is enough
- Node: v16.13+ (dolphinScheduler Version below 3.0, Please install node v12.20+)
Two 、 Download source code to local
https://github.com/apache/dolphinscheduler.git
3、 ... and 、 Switch to the specified branch , for example 3.0.0-xxx
Four 、 Switch to dolphinscheduler-ui Execute under directory npm install
The prompt after success is as follows :
5、 ... and 、 Skip test compilation
The prompt after successful compilation is as follows
6、 ... and 、 Execute database script
-- Before executing the script , Create database
CREATE DATABASE `dolphinscheduler`;
7、 ... and 、 Parent pom Medium mysql rely on scope notes
Refresh pom rely on
8、 ... and 、 modify dolphinscheduler-master and dolphinscheduler-worker as well as dolphinscheduler-api To configure , Change to your local database configuration
driver-class-name: com.mysql.cj.jdbc.Driver
url: jdbc:mysql://127.0.0.1:3306/dolphinscheduler?useUnicode=true&characterEncoding=utf8&zeroDateTimeBehavior=convertToNull&useSSL=true&serverTimezone=GMT%2B8
Nine 、 Start a local ZooKeeper
Ten 、 Start the program
(1) Start the front end npm run dev
(2) start-up MasterServer
(3) start-up WorkerServer
(4) start-up ApiApplicationServer
11、 ... and 、 Access front page
admin dolphinscheduler123
========================================================================
Twelve 、 If the scheduling task needs to be started locally, it needs to be modified Hadoop Some configuration of
(1)dolphinscheduler-dao Put the module down core-site.xml and hdfs-site.xml
(2) modify dolphinscheduler-common Under the module of common.properties To configure
The parameters to be modified are
# According to the location of the post software on the server
data.basedir.path=/data/software/dolphins3
# modify by HDFS File server storage mode
resource.storage.type=HDFS
# hdfs The file server stores the location of resources uploaded by the scheduling system resource.upload.path=/data/dolphinscheduler3# hdfs Cluster communication url
fs.defaultFS=hdfs://xxx.xxx.xxx.xxx:8020
# yarn Explorer ips
yarn.resourcemanager.ha.rm.ids=xxx.xxx.xxx.xxx
After configuration, you can create new files and upload resources
13、 ... and 、 Source packing , For server deployment
# pack
mvn -Dmaven.test.skip=true clean package install -Prelease
边栏推荐
- Three updates to build applications for different types of devices | 2022 i/o key review
- 安装VMmare时候提示hyper-v / device defender 侧通道安全性
- UIC(组态UI工程)公版文件库新增7款行业素材
- VIM mapping large K
- matlab / ENVI 主成分分析实现及结果分析
- 一段程序让你明白什么静态内部类,局部内部类,匿名内部类
- Ant manor safety helmet 7.8 ant manor answer
- Shared memory for interprocess communication
- jmeter 函数助手 — — 随机值、随机字符串、 固定值随机提取
- Crudini profile editing tool
猜你喜欢
Go straight to the 2022ecdc fluorite cloud Developer Conference: work with thousands of industries to accelerate intelligent upgrading
2022 Android interview essential knowledge points, a comprehensive summary
你不知道的互联网公司招聘黑话大全
When we talk about immutable infrastructure, what are we talking about
string(讲解)
3531. Huffman tree
哈趣投影黑马之姿,仅用半年强势突围千元投影仪市场!
Find duplicate email addresses
A program lets you understand what static inner classes, local inner classes, and anonymous inner classes are
jmeter 函数助手 — — 随机值、随机字符串、 固定值随机提取
随机推荐
ICML 2022 | explore the best architecture and training method of language model
2022Android面试必备知识点,一文全面总结
[start from scratch] detailed process of deploying yolov5 in win10 system (CPU, no GPU)
Force deduction 62 different paths (the number of all paths from the upper left to the lower right of the matrix) (dynamic planning)
Shared memory for interprocess communication
Party A's requirements for those who have lost 800 yuan
POI导出Excel:设置字体、颜色、行高自适应、列宽自适应、锁住单元格、合并单元格...
laravel 使用腾讯云 COS5全教程
Software testing knowledge reserve: how much do you know about the basic knowledge of "login security"?
【从零开始】win10系统部署Yolov5详细过程(CPU,无GPU)
Common problems of caching in high concurrency scenarios
Postgresql源码(60)事务系统总结
[Shell]常用shell命令及测试判断语句总结
Experience of Niuke SQL
哈趣投影黑馬之姿,僅用半年强勢突圍千元投影儀市場!
Laravel uses Tencent cloud cos5 full tutorial
线性代数(一)
Etcd database source code analysis -- starting from the start function of raftnode
缓存在高并发场景下的常见问题
Ant manor safety helmet 7.8 ant manor answer