Centos7 部署 Aambari 集群


官网链接
https://docs.hortonworks.com/HDPDocuments/Ambari-2.7.3.0/bk_ambari-installation/content/mmsr_max_open_file_reqs.html

1.环境要求:cenots 7
软件要求:本地yum 源,Openssl(V1.0),Python 2.7.x,OracleJDK 1.8,scp,unzip,curl,
查看安装版本
openssl version
java -version
python --version

Aambari-server端需要一个关系型数据库:Mysql5.6或者Postgresql 9.x

安装jdk
# mkdir /usr/local/jdk
# tar -xvf jdk-8u131-linux-x64.tar.gz -C /usr/local/jdk/

# vim /etc/profile
export JAVA_HOME=/usr/local/jdk/jdk1.8.0_131
export JRE_HOME=$JAVA_HOME/jre
export CLASSPATH=:$JAVA_HOME/lib:$JRE_HOME/lib
export PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin

# source /etc/profile
# java -version


打开最大文件要求(每一台主机)
ulimit -n 10000

2.为集群主机配置互信
在Ambari Server中,确保可以使用SSH连接到集群中的每个主机,而不必输入密码。
ssh-keygen #一路回车,生成密钥
for host in 192.168.10.20 192.168.0.21; do
ssh-copy-id -i ~/.ssh/id_rsa.pub $host
done

配置本地系统镜像源
vim /etc/yum.repos.d/yum.repo
[Media_local]
name=CentOS-Media
baseurl=file:///media/mnt
gpgcheck=0
enabled=1

mkdir -p /media/mnt
mount /dev/sr0 /media/mnt

安装http服务,配置本地http源
yum install -y httpd

配置httpdf服务打开目录
vim /etc/httpd/conf.d/welcome.conf
<LocationMatch "^/+$">
Options Indexes #将Indexes前面的 - 去掉
ErrorDocument 403 /.noindex.html
</LocationMatch>

# mkdir -p /var/www/html/ambari-hdp
将ambari需要的包解压到var/www/html/ambari-hdp 下
# tar -zxvf ambari-2.2.1.0-centos7.tar.gz -C /var/www/html/ambari-hdp/
# tar -zxvf HDP-2.4.0.0-centos7-rpm.tar.gz -C /var/www/html/ambari-hdp/
# tar -zxvf HDP-GPL-3.1.0.0-centos7-gpl.tar.gz -C /var/www/html/ambari-hdp/
# tar -zxvf HDP-UTILS-1.1.0.20-centos7.tar.gz -C /var/www/html/ambari-hdp/HDP-UTILS

保存重启httpd服务
web 访问下http服务能不能看到解压的目录(看到则正常)

在ambari.server上执行:
# yum localinstall -y yum-plugin-priorities-1.1.31-50.el7.noarch.rpm
# 设置为以下内容
vi /etc/yum/pluginconf.d/priorities.conf
[main]
enabled=1
gpgcheck=0


3.在server端配置NTP服务器,客户端同步时间后在部署就行
yum install -y ntp
vi /etc/ntp.conf
服务端:
restrict 192.168.10.0 mask 255.255.255.0 nomodify notrap
restrict 127.0.0.1
restrict ::1
server 127.127.1.0
fudge 127.127.1.0 stratum 10

客户端:
server 192.168.10.20(服务端IP)
restrict 192.168.10.20 nomodify notrap noquery
fudge 192.168.10.20 stratum 10

时区配置为上海
rm -rf /etc/localtime
ln -s /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

4.配置网络主机名
vi /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=hostname

vi /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.10.20 test20
192.168.10.21 test21
192.168.10.22 test22

 

5.安装基础数据库
yum install -y postgresql*
yum install postgresql-jdbc*

安装ambari-server
yum install -y ambari-server
ambari初始化数据库组件为postgresql
ambari-server setup --jdbc-db=postgres --jdbc-driver=/usr/share/java/postgresql-jdbc.jar

确认.jar文件位于java共享目录中
ll /usr/share/java/postgresql-jdbc.jar
chmod 644 /usr/share/java/postgresql-jdbc.jar

postgresql 初始化并启动
postgresql-setup initdb
systemctl start postgresql
su - postgres
psql

创建基础数据库和用户
CREATE DATABASE "ambaridb";
CREATE DATABASE "hivedb";
CREATE USER rangerdba with password 'citms';
CREATE USER hive with password 'citms';
GRANT ALL PRIVILEGES ON DATABASE ambaridb TO rangerdba;
GRANT ALL PRIVILEGES ON DATABASE hivedb TO hive;
\connect ambaridb;
create schema ambari AUTHORIZATION rangerdba;
alter schema ambari owner to rangerdba;
alter role rangerdba set search_path to 'ambari','public';


修改配置文件
vim /var/lib/pgsql/data/postgresql.conf
listen_addresses='localhost' 改为 listen_addresses='本机IP'

vim /var/lib/pgsql/data/pg_hba.conf
修改一下内容
# "local" is for Unix domain socket connections only
local all * trust
# IPv4 local connections:
host all * 0.0.0.0/0 trust

编辑完成后,用postgres 刷新配置
su - postgres
pg_ctl -D $PGDATA reload

导入基础数据
psql -U rangerdba -d ambaridb
\i /var/lib/ambari-server/resources/Ambari-DDL-Postgres-CREATE.sql
----------------------------------------------------------------------

ambari-server setup
根据提示选择进行安装
1.y
2.回车
3.Enable Ambari Server to download and install GPL Licensed LZO packages [y/n] (n)
4.Enter advanced database configuration [y/n] (n)? y
选择4
5.Enter choice (1): 4
Hostname (localhost): 192.168.0.237
Port (5432):
Database name (ambari): ambaridb
Postgres schema (ambari):
Username (ambari): rangerdba
Enter Database Password (bigdata):
Re-enter password:
Configuring ambari database...
----------------------------------------------------------

启动服务
ambari-server start

Server started listening on 8080
DB configs consistency check: no errors and warnings were found.
Ambari Server 'start' completed successfully.
----------------------------------------------------------

访问Web初始化配置集群
http:server_IP:8080
admin/admin


安装集群时:
1.发现主机配置输入主机名,不要用IP
将ambari-server 的私钥复制进Host Registration Information 文件中
并且agent端需要安装客户端
yum install -y ambari-agent

2.安装hadoop组件时可能会提示安装hadoop_3_1_0_0_78 包失败
原因是缺少包(已经离线下载到压缩包中)
yum localinstall -y libtirpc-0.2.4-0.15.el7.x86_64.rpm
yum localinstall -y libtirpc-devel-0.2.4-0.15.el7.x86_64.rpm

 

############################################
报错解决
1.hive启动报错
Sys DB and Information Schema not created yet

解决方案:
cd /etc/hive/
touch /etc/hive/sys.db.created
进入ambari-server 端重启
ambari-server restart

Advance_SSL报错
密码和账户名一样:admin/admin


免责声明!

本站转载的文章为个人学习借鉴使用,本站对版权不负任何法律责任。如果侵犯了您的隐私权益,请联系本站邮箱yoyou2525@163.com删除。



 
粤ICP备18138465号  © 2018-2025 CODEPRJ.COM