Azkaban installation and deployment

Download address

http://azkaban.github.io/downloads.html

Preparation before installation

• take jar Put in the created /usr/lcoal/azkabanjar Catalog
  

install

1. decompression azkaban-web-server-2.5.0.tar.gz、azkaban-executor-server-2.5.0.tar.gz、azkaban-sql-script-2.5.0.tar.gz To /user/local/azkaban

• tar -xvf azkaban-web-server-2.5.0.tar.gz -C /usr/local/azkaban/
• tar -xvf azkaban-executor-server-2.5.0.tar.gz -C /usr/local/azkaban/
• tar -xvf azkaban-sql-script-2.5.0.tar.gz -C /usr/local/azkaban/

2. Rename the extracted file

• mv azkaban-web-2.5.0/ web
• mv azkaban-executor-2.5.0/ executor

3. Get into mysql, establish azkaban database , And import the extracted script to azkaban database

• mysql -uroot -p
• create database azkaban;
• use azkaban;
• source /usr/local/azkaban/azkaban-2.5.0/create-all-sql-2.5.0.sql

source Heel .sql file , For batch processing .sql In the document sql sentence 

Generate keystore

1. Generate keystore The key library of the password and corresponding information

• cd /usr/local/azkaban
• keytool -keystore keystore -alias jetty -genkey -keyalg RSA

Keytool yes java Data certificate management tools , Enables users to manage their own public / Private key pair and related certificates 
-keystore： Specify the name and location of the keystore ( The generated information will not be available .keystore In file )
-genkey： Create a default file in the user's home directory ".keystore" 
-alias： For what we generate .keystore  Identify aliases ; If there is no default is mykey
-keyalg： The algorithm that specifies the key  RSA/DSA  The default is DSA

• The password of the keystore must at least 6 Characters , It can be pure numbers or letters or a combination of numbers and letters, etc , The password of the keystore should be the same as jetty The same key for , Convenient memory

[root@node1 azkaban]# keytool -keystore keystore -alias jetty -genkey -keyalg RSA
 Enter the keystore password :  
 Enter the new password again : 
 What is your first and last name ?
  [Unknown]:  
 What is the name of your organizational unit ?
  [Unknown]:  
 What is the name of your organization ?
  [Unknown]:  
 What is the name of your city or area ?
  [Unknown]:  
 Your province / City / What is the name of the Autonomous Region ?
  [Unknown]:  
 The unit's two letter country / What is the area code ?
  [Unknown]:  
CN=Unknown, OU=Unknown, O=Unknown, L=Unknown, ST=Unknown, C=Unknown Whether it is right ?
  [ no ]:  y

 Input  <jetty>  Key password for 
        ( If it's the same password as the keystore ,  Press enter ):  
 Enter the new password again :

2. take keystore copy to azkaban web In the server root

• mv keystore web/

Time synchronization configuration ( If time synchronization has been completed , Skip this step )

Replace Mysql drive

• Azkaban2.5 By default mysql5.1 drive , I am here mysql8.0, So replace the drive

1.executor

2.web

Web Server configuration

1.azkaban.properties To configure

• cd /usr/local/azkaban/web/conf
• vim azkaban.properties

#Azkaban Personalization Settings
# The server UI name , For the name shown above the server 
azkaban.name=Test
# describe 
azkaban.label=My Local Azkaban
#UI Color 
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
# Default web server Deposit web File directory 
web.resource.dir=/usr/local/azkaban/web/web/
# Default time zone , It has been changed to Asia / Shanghai   The default is the United States 
default.timezone.id=Asia/Shanghai

#Azkaban UserManager class
user.manager.class=azkaban.user.XmlUserManager
# User rights management default class （ Absolute path ）
user.manager.xml.file=/usr/local/azkaban/web/conf/azkaban-users.xml

#Loader for projects
#global The location of the configuration file （ Absolute path ）
executor.global.properties=/usr/local/azkaban/executor/conf/global.properties
azkaban.project.dir=projects

# Database type 
database.type=mysql
# Port number 
mysql.port=3306
# Database connection IP
mysql.host=node3
# Database instance name 
mysql.database=azkaban?useSSL=false&serverTimezone=UTC&characterEncoding=utf-8
# Database user name 
mysql.user=root
# Database password 
mysql.password=a
# maximum connection 
mysql.numconnections=100

# Velocity dev mode
velocity.dev.mode=false

# Azkaban Jetty server properties.
# Jetty Server properties .
# Maximum number of threads 
jetty.maxThreads=25
#Jetty SSL port 
jetty.ssl.port=8443
#Jetty port 
jetty.port=8081
#SSL file name （ Absolute path ）
jetty.keystore=/usr/local/azkaban/web/keystore
#SSL File password 
jetty.password=xbzz7789
#Jetty Master password and keystore Same file 
jetty.keypassword=xbzz7789
#SSL file name （ Absolute path ）
jetty.truststore=/usr/local/azkaban/web/keystore
#SSL File password 
jetty.trustpassword=xbzz7789

# Azkaban Executor settings
executor.port=12321

# mail settings
mail.sender=
mail.host=
job.failure.email=
job.success.email=

lockdown.create.projects=false

cache.directory=cache

2.azkaban-users.xml To configure

• Add admin user , Configure two roles admin, metrics
• cd /usr/local/azkaban/web/conf
• vim azkaban-users.xml

<azkaban-users>
	<user username="azkaban" password="azkaban" roles="admin" groups="azkaban" />
	<user username="metrics" password="metrics" roles="metrics"/>
	<user username="admin" password="admin" roles="admin,metrics" />
	<role name="admin" permissions="ADMIN" />
	<role name="metrics" permissions="METRICS"/>
</azkaban-users>

Execution server executor To configure

1.azkaban.properties To configure

• cd /usr/local/azkaban/executor/conf
• vim azkaban.properties

#Azkaban
# The time zone 
default.timezone.id=Asia/Shanghai

# Azkaban JobTypes Plugins
#jobtype  Plug in location 
azkaban.jobtype.plugin.dir=plugins/jobtypes

#Loader for projects
executor.global.properties=/usr/local/azkaban/executor/conf/global.properties
azkaban.project.dir=projects

database.type=mysql
mysql.port=3306
mysql.host=node3
mysql.database=azkaban?useSSL=false&serverTimezone=UTC&characterEncoding=utf-8
mysql.user=root
mysql.password=a
mysql.numconnections=100

# Azkaban Executor settings
# Maximum number of threads 
executor.maxThreads=50
# Port number ( Such as modification , Please contact web Consistency in service )
executor.port=12321
# Number of threads 
executor.flow.threads=30

Start the service

1. start-up executor The server

• cd /usr/local/azkaban/executor/bin
• ./azkaban-executor-start.sh

2. start-up web The server

• Execute first executor, Re execution web, avoid Web Server It will fail to start because the actuator cannot be found
• cd /usr/local/azkaban/web/bin
• ./azkaban-web-start.sh

3. Check the startup

visit Web