azkaban安装与配置

参考 ：https://yq.aliyun.com/articles/370418

在官网下载 wget https://github.com/azkaban/azkaban/archive/3.50.0.tar.gz

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

https://blog.csdn.net/weixin_41647178/article/details/84753935

https://www.iteye.com/blog/ssydxa219-2425996

git clone -b 3.62.0 https://github.com/azkaban/azkaban.git
####编译
./gradlew distTar
curl -G "localhost:$(<./executor.port)/executor?action=activate" && echo

chmod +x test.sh
Cannot request memory (Xms 0 kb, Xmx 0 kb) from system for job hello

没有作用. 后面的版本已经解决了这个问题。
只需要在executor的plugins/jobtypes目录下创建文件commonprivate.properties，文件的内容为memCheck.enabled=false，最后重新启动就好了

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

 

### mysql 配置
mysql –uroot –pxxxx
创建数据库: CREATE DATABASE azkaban;
创建用户名：CREATE USER 'azkaban'@'%' IDENTIFIED BY '2019_Mysql'
分配权限：GRANT SELECT,INSERT,UPDATE,DELETE,CREATE,INDEX ON `azkaban`.* TO 'azkaban'@'%' WITH GRANT OPTION;

grant all privileges on *.* to azkaban@"%" identified by "2019_Mysql";

 

flush privileges；
quit;
通过azkaban账号登录mysql：mysql –uazkaban –pazkaban
Use azkaban;
source /home/hadoop/azkaban-25/azkaban-2.5.0/create-all-sql-2.5.0.sql

上传mysql驱动包至 ~/app/azkaban/azkaban-web-2.5.0/extlib/

###创建 keystore

[hadoop@master extlib]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5.0/extlib
[hadoop@master extlib]$ keytool -keystore keystore -alias jetty -genkey -keyalg RSA
Enter keystore password:（密码是mysteel）
Re-enter new password: （密码是mysteel）
What is your first and last name?
[Unknown]: mysteel
What is the name of your organizational unit?
[Unknown]: mysteel
What is the name of your organization?
[Unknown]: mysteel
What is the name of your City or Locality?
[Unknown]: SH
What is the name of your State or Province?
[Unknown]: SH
What is the two-letter country code for this unit?
[Unknown]: CN
Is CN=mysteel, OU=mysteel, O=mysteel, L=SH, ST=SH, C=CN correct?
[no]: yes

Enter key password for <jetty>
(RETURN if same as keystore password):
Re-enter new password: （密码是mysteel）
[hadoop@master extlib]$

cp /home/hadoop/azkaban-25/azkaban-web-2.5.0/extlib/keystore /home/hadoop/azkaban-25/azkaban-web-2.5.0/bin/
########################

启动 azkaban 的exector 组件

/home/hadoop/azkaban-350/azkaban-web-server-350/conf  
vi azkaban.properties

在 /home/hadoop/azkaban-350/azkaban-exec-server-350 下 执行 bin/start-exec.sh

在/home/hadoop/azkaban-350/azkaban-web-server-350 下执行bin/start-web.sh

最好在上面的这个目录（bin）启动服务，原因一，会在同级目录生成 日志，原因二 ，配置里有很多相对目录，不在bin 统计目录启动会发生找不到文件的问题。

jps 

22083 AzkabanExecutorServer
22854 AzkabanWebServer

打开 网址 http://192.168.91.112:8071/   

备注  不要用https打开

原来端口是 8081 因为 spark 也在使用8081 端口，所以修改为8071 (azkaban-exec-server-350/conf/  下 vi azkaban.properties )

jetty.port=8071

login 用户用 azkaban-users.xml 中的 【<user groups="azkaban" password="azkaban" roles="admin" username="azkaban"/>】

 

 

 

 

 

 测试：

创建文件

vi  command.job

#command.job
type=command
command=sqoop import --connect jdbc:mysql://192.168.91.112:3306/bgdmysqldb --username root --password '2019_Mysql' --table dh_call_info2 --fields-terminated-by '\t' --num-mappers 1 --hive-import --hive-database rdw --hive-table dh_call_info2 --delete-target-dir

打包

zip command_sq.job  command.job

上传服务器

 运行