当前位置:网站首页>dolphinscheduler3. X local startup
dolphinscheduler3. X local startup
2022-07-07 06:32:00 【HuntFalcon】
One 、 Basic software installation ( Please install the necessary items by yourself )
- PostgreSQL (8.2.15+) or MySQL (5.7 series ) : Choose one of the two
- JDK (1.8+) : Must install
- ZooKeeper (3.4.6+) : Must install
stay ZooKeeper Create a new zkData、zkLog Folder
take conf In the catalog zoo_sample.cfg file , A copy of , Rename it to zoo.cfg, Modify the data and log configuration , Such as :
dataDir=/data/zookeeper/data ## Use absolute path here
dataLogDir=/data/zookeeper/datalog
function ./bin/zkServer.sh
- Hadoop (2.6+) or MinIO : Optional packaging , If you need to use the resource upload function , For a single machine, you can choose the local file directory as the upload folder ( This operation does not require deployment Hadoop); Of course, you can also choose to upload to Hadoop or MinIO On the cluster
- Maven: v3.5+, Alibaba cloud warehouse address is enough
- Node: v16.13+ (dolphinScheduler Version below 3.0, Please install node v12.20+)
Two 、 Download source code to local
https://github.com/apache/dolphinscheduler.git
3、 ... and 、 Switch to the specified branch , for example 3.0.0-xxx
Four 、 Switch to dolphinscheduler-ui Execute under directory npm install
The prompt after success is as follows :
5、 ... and 、 Skip test compilation
The prompt after successful compilation is as follows
6、 ... and 、 Execute database script
-- Before executing the script , Create database
CREATE DATABASE `dolphinscheduler`;
7、 ... and 、 Parent pom Medium mysql rely on scope notes
Refresh pom rely on
8、 ... and 、 modify dolphinscheduler-master and dolphinscheduler-worker as well as dolphinscheduler-api To configure , Change to your local database configuration
driver-class-name: com.mysql.cj.jdbc.Driver
url: jdbc:mysql://127.0.0.1:3306/dolphinscheduler?useUnicode=true&characterEncoding=utf8&zeroDateTimeBehavior=convertToNull&useSSL=true&serverTimezone=GMT%2B8
Nine 、 Start a local ZooKeeper
Ten 、 Start the program
(1) Start the front end npm run dev
(2) start-up MasterServer
(3) start-up WorkerServer
(4) start-up ApiApplicationServer
11、 ... and 、 Access front page
admin dolphinscheduler123
========================================================================
Twelve 、 If the scheduling task needs to be started locally, it needs to be modified Hadoop Some configuration of
(1)dolphinscheduler-dao Put the module down core-site.xml and hdfs-site.xml
(2) modify dolphinscheduler-common Under the module of common.properties To configure
The parameters to be modified are
# According to the location of the post software on the server
data.basedir.path=/data/software/dolphins3
# modify by HDFS File server storage mode
resource.storage.type=HDFS
# hdfs The file server stores the location of resources uploaded by the scheduling system resource.upload.path=/data/dolphinscheduler3# hdfs Cluster communication url
fs.defaultFS=hdfs://xxx.xxx.xxx.xxx:8020
# yarn Explorer ips
yarn.resourcemanager.ha.rm.ids=xxx.xxx.xxx.xxx
After configuration, you can create new files and upload resources
13、 ... and 、 Source packing , For server deployment
# pack
mvn -Dmaven.test.skip=true clean package install -Prelease
边栏推荐
- ETCD数据库源码分析——从raftNode的start函数说起
- Matlab / envi principal component analysis implementation and result analysis
- Three updates to build applications for different types of devices | 2022 i/o key review
- C language sorting (to be updated)
- string(讲解)
- Crudini 配置文件编辑工具
- [opencv] morphological filtering (2): open operation, morphological gradient, top hat, black hat
- 隐马尔科夫模型(HMM)学习笔记
- 软件测试的几个关键步骤,你需要知道
- 「解析」FocalLoss 解决数据不平衡问题
猜你喜欢
Tkinter window selects PCD file and displays point cloud (open3d)
【GNN】图解GNN: A gentle introduction(含视频)
Go straight to the 2022ecdc fluorite cloud Developer Conference: work with thousands of industries to accelerate intelligent upgrading
Haqi projection Black Horse posture, avec seulement six mois de forte pénétration du marché des projecteurs de 1000 yuans!
Which foreign language periodicals are famous in geology?
3428. Put apples
[SOC FPGA] custom IP PWM breathing lamp
PostgreSQL database timescaledb function time_ bucket_ Gapfill() error resolution and license replacement
请问如何查一篇外文文献的DOI号?
Matlab / envi principal component analysis implementation and result analysis
随机推荐
Redis (I) -- getting to know redis for the first time
程序员的日常 | 每日趣闻
Open the blue screen after VMware installation
哈趣投影黑馬之姿,僅用半年强勢突圍千元投影儀市場!
JMeter's own functions are not enough? Why don't you develop one yourself
Go straight to the 2022ecdc fluorite cloud Developer Conference: work with thousands of industries to accelerate intelligent upgrading
雷特智能家居龙海祁:从专业调光到全宅智能,20年专注成就专业
JVM 全面深入
CloudCompare-点对选取
Ha Qu projection dark horse posture, only half a year to break through the 1000 yuan projector market!
骑士战胜魔王(背包&dp)
UIC (configuration UI Engineering) public file library adds 7 industry materials
JWT 认证
Apache ab 压力测试
UIC(组态UI工程)公版文件库新增7款行业素材
可极大提升编程思想与能力的书有哪些?
A program lets you understand what static inner classes, local inner classes, and anonymous inner classes are
HKUST & MsrA new research: on image to image conversion, fine tuning is all you need
FlexRay通信协议概述
ICML 2022 | explore the best architecture and training method of language model