1. 安裝配置Ambari Server
- 安裝Ambari-server
cd apache-ambari-2.7.6-src/
yum install ambari-server/target/rpm/ambari-server/RPMS/x86_64/ambari-server*.rpm
ambari-server setup
/usr/sbin/ambari-server:行34: buildNumber: 為綁定變量
- 修改ambari-server文件
vi /usr/sbin/ambari-server
修改為
HASH="${VERSION}"
- 安裝Ambari-server
再次執行ambari-server setup
Using python /usr/bin/python
Setup ambari-server
Checking SELinux...
SELinux status is 'enabled'
SELinux mode is 'enforcing'
Temporarily disabling SELinux
WARNING: SELinux is set to 'permissive' mode and temporarily disabled.
OK to continue [y/n] (y)? y
Customize user account for ambari-server daemon [y/n] (n)? n
Adjusting ambari-server permissions and ownership...
Checking firewall status...
WARNING: iptables is running. Confirm the necessary Ambari ports are accessible. Refer to the Ambari documentation for more details on ports.
OK to continue [y/n] (y)? y
Checking JDK...
[1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8
[2] Custom JDK
==============================================================================
Enter choice (1): 2
WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts.
WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts.
Path to JAVA_HOME: /usr/local/jdk_1.8
Validating JDK on Ambari Server...done.
Check JDK version for Ambari Server...
JDK version found: 8
Minimum JDK version is 8 for Ambari. Skipping to setup different JDK for Ambari Server.
Checking GPL software agreement...
GPL License for LZO: https://www.gnu.org/licenses/old-licenses/gpl-2.0.en.html
Enable Ambari Server to download and install GPL Licensed LZO packages [y/n] (n)? y
Completing setup...
Configuring database...
Enter advanced database configuration [y/n] (n)? n
Configuring database...
Default properties detected. Using built-in database.
Configuring ambari database...
Checking PostgreSQL...
Running initdb: This may take up to a minute.
Initializing database ... OK
About to start PostgreSQL
Configuring local database...
Configuring PostgreSQL...
Restarting PostgreSQL
Creating schema and user...
done.
Creating tables...
done.
Extracting system views...
ambari-admin-2.7.6.0.0.jar
Ambari repo file doesn't contain latest json url, skipping repoinfos modification
Adjusting ambari-server permissions and ownership...
Ambari Server 'setup' completed successfully.
- 啟動Ambari-server
ambari-server start
成功后在瀏覽器輸入Ambari地址 http://ip:<prot_number>
port_number默認8080。用戶名
admin
,密碼admin
Using python /usr/bin/python
Starting ambari-server
Ambari Server running with administrator privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Ambari database consistency check started...
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Waiting for server start............................
Server started listening on 8080
DB configs consistency check: no errors and warnings were found.
Ambari Server 'start' completed successfully.
如果瀏覽器未成功請求到Ambari頁面,查看下8080端口信息及防火牆是否關閉。
lsof -i:8080
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
java 31253 root 210u IPv6 75454065 0t0 TCP *:webcache (LISTEN)
systemctl status firewalld
systemctl stop firewalld
systemctl disable firewalld
2. 安裝Ambari-agent
- 安裝ambari-agent
yum install ambari-agent/target/rpm/ambari-agent/RPMS/x86_64/ambari-agent-*.rpm
ambari-agent setup
/var/lib/ambari-agent/bin/ambari-agent:行23: buildNumber: 為綁定變量
修改配置
vi /var/lib/ambari-agent/bin/ambari-agent
# 將HASH="${buildNumber}"修改為: HASH="${VERSION}"
登錄用戶名密碼均為admin,點擊登錄后,會提示初始化一個集群信息。
點擊 Launch后,填寫集群名稱后,進入選擇HDP版本及確定HDP/HDP-GPL/HDP-Utils
所在的目錄。
關於離線的HDP/HDP-GPL/HDP-Util制作,參照附錄內容
填寫目標主機Host地址,及私鑰內容。
- 設置目標主機host
- 檢查hostname
vi /etc/hostname
centos.novalocal
- 檢查hosts
vi /etc/hosts
192.168.2.181 centos.novalocal
- 檢查ambari-agent-ini
vi /etc/ambari-agent/conf/ambari-agent.ini
force_https_protocol=PROTOCOL_TLSv1_2
# 修改hostname一行為ambari-server對應的主機名
# 在security下面添加如下行:force_https_protocol=PROTOCOL_TLSv1_2,確保有下圖所示的兩個配置
啟動ambari-agent
ambari-agent start
生成私鑰。
ssh-keygen -t rsa 並三次回車
將私鑰分發給各個節點,此處偽分布,因此只需要給本機分發。
ssh-copy-id centos.novalocal
拷貝私鑰內容
cat ~/.ssh/id_rsa
-----BEGIN RSA PRIVATE KEY-----
MIIEpgIBAAKCAQEA3xiLT5S1r/F8vr21BY9x9XeHPHVQYVUi7pvN0k9kleoFAKDh
Neo19060dXL3zK68EiX/EKR4hzvEwhaR3QP1fR1h8H++dB/+6TdvEzdyeErQKTRY
MzUjQTNVUZM54LfyqS6eTAVxHegV992oXNA7cA4P/U02rmUN3Y02ghDEbUOlxwqf
VRKVk/x6/Dxc5896c4zvXnaYuWp1gaZ9UChDxS58/+xwcyWBe8KkOR6UfxH14fMw
J5OI4Tw8OEBPOjouhYbnzAw3o0dBnp5DtcGXZXjt99XZoN4DtRT3G+Tzvp1Iu0tX
qdL4y4E6prSNIN0o1jfkv2z5k7HjZ64diHYRAwIDAQABAoIBAQDXtlu9bwTeQplj
tPq7jZ+awSA6DRTTiAZmwK+akrmnWsfLe8NG5leX8Ln8dlWzy6B9y898wArqd5gg
MsKG+bT8bNSuPlZg4i8QQVFdO1eriGsN7Fb77H1SJdhxL/Henv47J6BX0Us2p5nW
OLT6ST2vc2lyep5MsdleR5RU3vGO0vOCfr3J/r4i1JkDyEeRBqIQsbpEIXq9l7S0
sTVCHL8AGj+ZqyQpRCqzZJoz7e/NLshqpJ3p999V36gscID5mQGapaeVBF28IVCN
PEiH8HngVIkdNNZVaVlnrWSJj/iRs9vkbNFF92DiP+SJVho/f85ZoCAYWd3aYILP
+JssGOdBAoGBAPkjhCVwBJZLebGIyZcYc0+5yLyqpDaB1v4266hYLrqndyI/mK09
TWHhwgULxEsxubnYm2qN6XLRRpNh+EIaL+2nHm4vU29Kla555t1Aq3yHENRX5tCm
o1+R2mZFD7lphuPNlIVczWDNsK+3Cx9p8WPT8idqEaaXH0GHRyFAp38vAoGBAOU9
a4VVLw8lRZ+g4kKfDNfcsCXx7JEVZ6HGGbaK/IlrcFF1uTibpfK2SNUdnNlFdupD
ZmkC+BluwXjTmKIj6Qx29R52HeXqnlNyv2RfM8RADJlHQh0BmV+VpLeYFU7hboGH
pbvkd321nEmdPMHRk3M0DNGQM7VIybcsRhqsfzZtAoGBAI0P6fuUkFRUycOWsqWl
h2zFwX3plG70Vzm6+PVpcJPozBCNN7InOpBIViWrQupcbk9m8KCFV3/WNIKwfvNW
hnqmHBnBHBmwfk264de2jSJGC2ZfmuXa5DfxilpLkhqmQGTtesGECRldfUQQfPC9
eJrQX5SnfvT3LhBZOxH93JirAoGBAJxnXXao+eSRf4E72WOu9KpKrfwVpVwPiJc9
e8mp5kc0AHvzoB3ZRE3mxKZy/9LVrB6FQdgf6HohsOrpI1hsu9J/TxoraJa3jrJM
tfybX8xkDrR9g8QalTQ7+xgwMUmSUT0a+Z7KcCRaxnkLSKrMfJe7SYupoT3snYPW
NzZ3vou5AoGBAO2RtiBK57HzIrxt5Oah6OfK/JBBEAgLF6jaHmBSN4U9hmzohuKD
6C+Orw9DWcLFyyGFW7NavBqqDwS6rLc0ReUNKqWkFMcTM/zzA4DWkprYnGTqN6UK
44XHsewjVgb8h/rhUKD4VhlXXO6MIBQTsYsDTD0q2e5sYGAuzndsqaZW
-----END RSA PRIVATE KEY-----
隨后,下一步Ambari執行確認Host等信息。
點擊下一步后,會看到選擇安裝服務。可以看到SmartSense為默認必選項
需要移除掉默認的SmartSense服務。
# 查找SMARTSENSE
find / -name SMARTSENSE |xargs
# 刪除
rm -rf /var/lib/ambari-server/resources/stacks/HDP/3.0/services/SMARTSENSE /var/lib/ambari-agent/cache/stacks/HDP/3.0/services/SMARTSENSE
重啟ambari-server
ambari-server restart
此處我們選擇zookeeper和zeppelin進行安裝,並且SmartSense服務已經消失。
進入配置hive用戶名密碼以及hive連接的mysql配置信息。
報錯:mysql-connector-java.jar找不到
2022-04-20 11:13:09,518 - File['/var/lib/ambari-agent/tmp/mysql-connector-java.jar'] {'content': DownloadSource('http://centos.novalocal:8080/resources/mysql-connector-java.jar')}
2022-04-20 11:13:09,519 - Downloading the file from http://centos.novalocal:8080/resources/mysql-connector-java.jar
在主機centos.novalocal
中安裝mysql-connector-java.jar
sudo yum install mysql-connector-java*
ls -al /usr/share/java/mysql-connector-java.jar
cd /var/lib/ambari-server/resources/
ln -s /usr/share/java/mysql-connector-java.jar mysql-connector-java.jar
點擊重試(RETRY)。繼續執行
隨后next進入Ambari DashBoard主頁面。
附錄
離線安裝HDP/HDP-Utils
HDP-Utils、HDP及GPL文件下載地址。
HDP 3.1.5 安裝包及Ambari安裝包下載:
鏈接: https://pan.baidu.com/s/1KsU1U5ltJYHuK7F893coAQ
提取碼: ku5u
mkdir -p /var/www/html/ambari
解壓上述三個文件
tar -zxvf HDP-UTILS-1.1.0.22-centos7.tar.gz -C /var/www/html/ambari
tar -zxvf HDP-2.6.3.0-centos7-rpm.tar.gz -C /var/www/html/ambari
tar -zxvf HDP-GPL-3.1.5.0-centos7-gpl.tar.gz -C /var/www/html/ambari
tar -zxvf ambari-2.7.5.0-centos7.tar.gz -C /var/www/html/ambari
制作本地源
yum install yum-utils createrepo yum-plugin-priorities -y
createrepo ./
修改文件里面的源地址
vi HDP/centos7/2.6.3.0-235/hdp.repo
#VERSION_NUMBER=3.1.5.0-152
[HDP-3.1.5.0]
name=HDP Version - HDP-3.1.5.0
baseurl=http://192.168.2.157/ambari/HDP/centos7/3.1.5.0-152/
gpgcheck=0
[HDP-UTILS-1.1.0.22]
name=HDP-UTILS Version - HDP-UTILS-1.1.0.22
baseurl=http://192.168.2.157/ambari/HDP-UTILS/HDP-UTILS/centos7/1.1.0.22/
gpgcheck=0
將ip修改為對應自己機器的ip
- 執行yum緩存
yum clean all
yum makecache
yum repolist
查看的時候可能rpm信息並不會出現,刪除當前目錄下index.html
即可打開依賴目錄。
在部署Ambari-server時,在select version中無法選擇HDP版本。
此時需要將HDP-2.6.3.0-centos7-rpm.tar.gz
解壓后的HDP文件拷貝到 apache-ambari-2.7.6-src/ambari-server/src/main/resources/stacks/HDP
中,重新執行編譯命令即可。