当前位置：网站首页>Data warehouse tool superset installation (fully available)

Data warehouse tool superset installation (fully available)

2022-07-28 05:58:00 【Big data management】

Data warehouse tools superset install
I tried to install 3.7 edition , error . See experience tiean 3.8,3.9 Version of , All failed to initialize . Final , install Python3.6 The version can succeed

1. First, uninstall the installed
conda remove -n superset --all

2. To configure conda Domestic mirror
conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/free

conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main

3. establish Python3.6 Environmental Science
conda create --name superset python=3.6
Insert picture description here

4. Get into superset Environmental Science
conda activate superser
Insert picture description here

5. install Superset Before , The following dependencies need to be installed
(superset) [@hadoop102 ~]$ sudo yum install -y gcc gcc-c++ libffi-devel python-devel python-pip python-wheel python-setuptools openssl-devel cyrus-sasl-devel openldap-devel
Insert picture description here

6. install Superset
(superset) [[email protected] ~]$ pip install --upgrade setuptools pip -i https://pypi.douban.com/simple/

7. install Supetset
(superset) [[email protected] ~]$ pip install apache-superset -i https://pypi.douban.com/simple/
Insert picture description here
9. For the above warning , Let's download it first sqlalchemy and dataclasses
Be sure to execute the following two commands
pip install sqlalchemy==1.3.24
pip install dataclasses

Insert picture description here
I've been reporting pip The version of is not a new version , Never mind , Completely ignore this error

10. initialization Supetset database
(superset) [[email protected] ~]$ superset db upgrade
Insert picture description here
Prompt for the user name to be created

Enter the user name , Other information is directly blank , The password cannot be blank , Enter password twice

11. Administrator user successfully created

Insert picture description here
12.superset initialization
superset init

Initialization done ,superset installation is complete

Two .superset Deploy startup and shutdown scripts

start-up superset
1） install gunicorn

notes ：gunicorn It's a Python Web Server, You can talk to java Medium TomCat analogy

pip install gunicorn -i https://pypi.douban.com/simple/
2） start-up Superset

notes ： Ensure current conda The environment is superset, The front is （superset） word ;
Insert picture description here
superset Successful launch
notes ：hadoop01:8787 Is my hostname and port number

gunicorn --workers 5 --timeout 120 --bind hadoop01:8787 “superset.app:create_app()” --daemon
explain ：

–workers： Specify the number of processes

–timeout：worker Process timeout , Timeout will automatically restart

–bind： Bind native address , That is to say Superset Access address

–daemon： Background operation

3） stop it superset

Stop gunicorn process

ps -ef | awk ‘/superset/ && !/awk/{print $2}’ | xargs kill -9
sign out superset Environmental Science

conda deactivate

4）superset Start stop script

（1） establish superset.sh file

vim superset.sh

Add the following ：
#!/bin/bash
superset_status(){
result=ps -ef | awk '/gunicorn/ && !/awk/{print $2}' | wc -l
if [[ $result -eq 0 ]]; then
return 0
else
return 1
fi
}
superset_start(){
source ~/.bashrc
superset_status >/dev/null 2>&1
if [[ $? -eq 0 ]];
then conda activate superset ; gunicorn --workers 5 --timeout 120 --bind hadoop102:8787 --daemon ‘superset.app:create_app()’
else
echo “superset Running ”
fi

}

superset_stop(){
superset_status >/dev/null 2>&1
if [[ $? -eq 0 ]]; then
echo “superset Not running ”
else
ps -ef | awk ‘/gunicorn/ && !/awk/{print $2}’ | xargs kill -9
fi
}

case $1 in
start )
echo “ start-up Superset”
superset_start ;;
stop )
echo “ stop it Superset”
superset_stop
;;
restart )
echo “ restart Superset”
superset_stop
superset_start
;;
status )
superset_status >/dev/null 2>&1
if [[ $? -eq 0 ]]; then
echo “superset Not running ”
else
echo “superset Running ”
fi
esac