==========================================================================================================================
=========================== Superset安裝部署 =============================================================================
==========================================================================================================================
1、安裝python環境
superset運行要求python3.6環境
1）安裝miniconda
下載地址：https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh
2）安裝miniconda
sh Miniconda3-latest-Linux-x86_64.sh
是否每次登陸自動激活base環境：conda config --set auto_activate_base false
3）創建python3.6環境
配置conda國內鏡像
bin/conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/free
bin/conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
bin/conda config --set show_channel_urls yes
創建python3.6環境
bin/conda create --name superset python=3.6
附件：
conda環境管理命令
創建環境：conda create -n env_name
查看所有環境：conda info -envs
刪除環境: conda remove -n env_name --all
4）激活superset環境：
bin/conda activate superset
停止superset環境：
bin/conda deactivate
5）查看python版本信息
(superset) [root@chavin miniconda3]# python
Python 3.6.10 |Anaconda, Inc.| (default, Mar 25 2020, 23:51:54)
[GCC 7.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>>
2、安裝superset
1）安裝superset環境依賴
sudo yum upgrade python-setuptools
sudo yum install gcc gcc-c++ libffi-devel python-devel python-pip python-wheel openssl-devel cyrus-sasl-devel openldap-devel
2）通過獲取最新的pip 和setuptools庫，將所有機會都放在您的身邊。：
bin/pip install --upgrade setuptools pip -i https://pypi.douban.com/simple/
3）安裝superset ：依賴較多，可能較慢
bin/pip install apache-superset -i https://pypi.douban.com/simple/
4）編寫superset配置文件，主要更改元數據配置信息
a)配置python環境變量：
$ vim ~/.bash_profile
PYTHONPATH="/opt/miniconda3/conf:{$PYTHONPATH}"
export PYTHONPATH
b)編寫配置文件
$ vim /opt/miniconda/conf/superset_config.py
#---------------------------------------------------------
# Superset specific config
#---------------------------------------------------------
ROW_LIMIT = 5000
SUPERSET_WEBSERVER_PORT = 8088
#---------------------------------------------------------
#---------------------------------------------------------
# Flask App Builder configuration
#---------------------------------------------------------
# Your App secret key
SECRET_KEY = '\2\1thisismyscretkey\1\2\e\y\y\h'
# The SQLAlchemy connection string to your database backend
# This connection defines the path to the database that stores your
# superset metadata (slices, connections, tables, dashboards, ...).
# Note that the connection information to connect to the datasources
# you want to explore are managed directly in the web UI
# 注釋掉默認數據庫 ，同時配置mysql元數據庫地址
# SQLALCHEMY_DATABASE_URI = 'sqlite:////path/to/superset.db'
SQLALCHEMY_DATABASE_URI = 'mysql://superset:mysql@chavin.king/superset'
# Flask-WTF flag for CSRF
WTF_CSRF_ENABLED = True
# Add endpoints that need to be exempt from CSRF protection
WTF_CSRF_EXEMPT_LIST = []
# A CSRF token that expires in 1 year
WTF_CSRF_TIME_LIMIT = 60 * 60 * 24 * 365
# Set this API key to enable Mapbox visualizations
MAPBOX_API_KEY = ''
5）初始化數據庫
a）首先對接mysql數據源：
bin/conda install mysqlclient
b）執行superset初始化
bin/superset db upgrade
附加 - 此處可能報錯如下：
Traceback (most recent call last):
File "bin/superset", line 18, in <module>
from superset.cli import superset
File "/opt/miniconda3/lib/python3.7/site-packages/superset/__init__.py", line 21, in <module>
from superset.app import create_app
File "/opt/miniconda3/lib/python3.7/site-packages/superset/app.py", line 43, in <module>
from superset.security import SupersetSecurityManager
File "/opt/miniconda3/lib/python3.7/site-packages/superset/security/__init__.py", line 17, in <module>
from superset.security.manager import SupersetSecurityManager # noqa: F401
File "/opt/miniconda3/lib/python3.7/site-packages/superset/security/manager.py", line 25, in <module>
from flask_appbuilder.security.sqla.manager import SecurityManager
File "/opt/miniconda3/lib/python3.7/site-packages/flask_appbuilder/security/sqla/manager.py", line 19, in <module>
from ..manager import BaseSecurityManager
File "/opt/miniconda3/lib/python3.7/site-packages/flask_appbuilder/security/manager.py", line 17, in <module>
from .registerviews import (
File "/opt/miniconda3/lib/python3.7/site-packages/flask_appbuilder/security/registerviews.py", line 10, in <module>
from .forms import LoginForm_oid, RegisterUserDBForm, RegisterUserOIDForm
File "/opt/miniconda3/lib/python3.7/site-packages/flask_appbuilder/security/forms.py", line 54, in <module>
class RegisterUserDBForm(DynamicForm):
File "/opt/miniconda3/lib/python3.7/site-packages/flask_appbuilder/security/forms.py", line 72, in RegisterUserDBForm
validators=[DataRequired(), Email()],
File "/opt/miniconda3/lib/python3.7/site-packages/wtforms/validators.py", line 332, in __init__
raise Exception("Install 'email_validator' for email validation support.")
Exception: Install 'email_validator' for email validation support.
解決辦法 - bin/pip install email_validator
錯誤2 - 初始化數據庫失敗
Loaded your LOCAL configuration at [/opt/miniconda3/conf/superset_config.py]
Failed to create app
Traceback (most recent call last):
File "/opt/miniconda3/lib/python3.7/site-packages/superset/app.py", line 59, in create_app
app_initializer.init_app()
File "/opt/miniconda3/lib/python3.7/site-packages/superset/app.py", line 464, in init_app
self.setup_db()
File "/opt/miniconda3/lib/python3.7/site-packages/superset/app.py", line 592, in setup_db
pessimistic_connection_handling(db.engine)
File "/opt/miniconda3/lib/python3.7/site-packages/flask_sqlalchemy/__init__.py", line 937, in engine
return self.get_engine()
File "/opt/miniconda3/lib/python3.7/site-packages/flask_sqlalchemy/__init__.py", line 956, in get_engine
return connector.get_engine()
File "/opt/miniconda3/lib/python3.7/site-packages/flask_sqlalchemy/__init__.py", line 561, in get_engine
self._engine = rv = self._sa.create_engine(sa_url, options)
File "/opt/miniconda3/lib/python3.7/site-packages/flask_sqlalchemy/__init__.py", line 966, in create_engine
return sqlalchemy.create_engine(sa_url, **engine_opts)
File "/opt/miniconda3/lib/python3.7/site-packages/sqlalchemy/engine/__init__.py", line 479, in create_engine
return strategy.create(*args, **kwargs)
File "/opt/miniconda3/lib/python3.7/site-packages/sqlalchemy/engine/strategies.py", line 87, in create
dbapi = dialect_cls.dbapi(**dbapi_args)
File "/opt/miniconda3/lib/python3.7/site-packages/sqlalchemy/dialects/mysql/mysqldb.py", line 118, in dbapi
return __import__("MySQLdb")
ModuleNotFoundError: No module named 'MySQLdb'
Traceback (most recent call last):
File "bin/superset", line 21, in <module>
superset()
File "/opt/miniconda3/lib/python3.7/site-packages/click/core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "/opt/miniconda3/lib/python3.7/site-packages/flask/cli.py", line 586, in main
return super(FlaskGroup, self).main(*args, **kwargs)
File "/opt/miniconda3/lib/python3.7/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/opt/miniconda3/lib/python3.7/site-packages/click/core.py", line 1256, in invoke
Command.invoke(self, ctx)
File "/opt/miniconda3/lib/python3.7/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/opt/miniconda3/lib/python3.7/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/opt/miniconda3/lib/python3.7/site-packages/click/decorators.py", line 21, in new_func
return f(get_current_context(), *args, **kwargs)
File "/opt/miniconda3/lib/python3.7/site-packages/flask/cli.py", line 425, in decorator
with __ctx.ensure_object(ScriptInfo).load_app().app_context():
File "/opt/miniconda3/lib/python3.7/site-packages/flask/cli.py", line 381, in load_app
app = call_factory(self, self.create_app)
File "/opt/miniconda3/lib/python3.7/site-packages/flask/cli.py", line 119, in call_factory
return app_factory()
File "/opt/miniconda3/lib/python3.7/site-packages/superset/app.py", line 66, in create_app
raise ex
File "/opt/miniconda3/lib/python3.7/site-packages/superset/app.py", line 59, in create_app
app_initializer.init_app()
File "/opt/miniconda3/lib/python3.7/site-packages/superset/app.py", line 464, in init_app
self.setup_db()
File "/opt/miniconda3/lib/python3.7/site-packages/superset/app.py", line 592, in setup_db
pessimistic_connection_handling(db.engine)
File "/opt/miniconda3/lib/python3.7/site-packages/flask_sqlalchemy/__init__.py", line 937, in engine
return self.get_engine()
File "/opt/miniconda3/lib/python3.7/site-packages/flask_sqlalchemy/__init__.py", line 956, in get_engine
return connector.get_engine()
File "/opt/miniconda3/lib/python3.7/site-packages/flask_sqlalchemy/__init__.py", line 561, in get_engine
self._engine = rv = self._sa.create_engine(sa_url, options)
File "/opt/miniconda3/lib/python3.7/site-packages/flask_sqlalchemy/__init__.py", line 966, in create_engine
return sqlalchemy.create_engine(sa_url, **engine_opts)
File "/opt/miniconda3/lib/python3.7/site-packages/sqlalchemy/engine/__init__.py", line 479, in create_engine
return strategy.create(*args, **kwargs)
File "/opt/miniconda3/lib/python3.7/site-packages/sqlalchemy/engine/strategies.py", line 87, in create
dbapi = dialect_cls.dbapi(**dbapi_args)
File "/opt/miniconda3/lib/python3.7/site-packages/sqlalchemy/dialects/mysql/mysqldb.py", line 118, in dbapi
return __import__("MySQLdb")
ModuleNotFoundError: No module named 'MySQLdb'
解決辦法 - bin/pip install mysqlclient
6）創建管理員用戶
export FLASK_APP=superset
bin/superset fab create-admin
7）初始化superset
bin/superset init
8）啟動superset
a）安裝gunicorn
bin/pip install gunicorn -i https://pypi.douban.com/simple/
b）啟動superset ，確保當前環境為superset
bin/gunicorn --workers 2 --timeout 120 --bind chavin.king:8088 "superset.app:create_app()"
--workers : 指定進程個數
--timeout ：worker進程超時時間，超時會自動重啟
--bind : 綁定本機地址 ，即superset訪問地址
或者
bin/superset run -h 0.0.0.0 -p 8088 --with-threads --reload --debugger
c）停止superset
ps -ef|awk '/gunicorn/ %% !/awk/{print $2}' | xargs kill -9
d）退出superset
conda deactivate
e）登錄superset
http://chavin.king:8088
chavin/superset