kafka和zookeeper安裝部署(版本弄不好就是坑)


yum install -y unzip zip

配置host

vi /etc/host
172.19
.68.10 zk1

1. zookeeper

zookeeper下載地址

http://mirror.bit.edu.cn/apache/zookeeper/zookeeper-3.4.14/zookeeper-3.4.14.tar.gz

tar -zxvf apache-zookeeper-3.4.14.tar.gz

mv apache-zookeeper-3.4.14 zookeeper

cd /opt/zookeeper

拷貝zoo_sample.cfg文件重命名為zoo.cfg,然后修改dataDir屬性

# 數據的存放目錄
dataDir=/opt/zkdata
# 端口,默認就是2181
clientPort=2181
server.1=zk1:2888:3888

配置環境變量

# Zookeeper Environment Variable
export ZOOKEEPER_HOME=/opt/zookeeper
export PATH=$PATH:$ZOOKEEPER_HOME/bin

在/opt/zookeeper/data文件下創建myid
  vi myid
  1

Zookeeper 啟動停止命令

zkServer.sh start
zkServer.sh stop

2. kafka

kafka下載地址

http://kafka.apache.org/quickstart

http://mirror.bit.edu.cn/apache/kafka/2.2.0/kafka_2.12-2.2.0.tgz

tar -zxvf kafka_2.12-2.2.0.tgz

修改config/server.properties

#broker的全局唯一編號,不能重復

broker.id=0

#kafka消息存放的路徑

log.dirs=/opt/kafka/logs

#broker需要使用zookeeper保存meta數據

zookeeper.connect=localhost:2181

https://blog.csdn.net/lizhitao/article/details/25667831 配置屬性說明

啟動

nohup bin/kafka-server-start.sh config/server.properties &

3. 安裝kafka-manager

下載地址 https://github.com/yahoo/kafka-manager/releases

 sbt編譯

cd /etc/yum.repos.d/
curl https://bintray.com/sbt/rpm/rpm > bintray-sbt-rpm.repo
yum install sbt
下載sbt
wget https://dl.bintray.com/sbt/native-packages/sbt/0.13.6/sbt-0.13.6.tgz
tar -zxvf sbt-0.13.6.tgz
添加環境變量
vi /etc/profile

export SBT_HOME=/opt/sb 
export PATH=$PATH:/$SBT_HOME/bin
/×修改sbt文件權限×/
$ chmod u+x sbt 

驗證:檢查sbt是否安裝成功,查看命令輸出

修改鏡像提高下載速度
cd ~
mkdir .sbt
vim repositories

[repositories]
local
aliyun: http://maven.aliyun.com/nexus/content/groups/public
typesafe: http://repo.typesafe.com/typesafe/ivy-releases/, [organization]/[module]/(scala_[scalaVersion]/)(sbt_[sbtVersion]/)[revision]/[type]s/[artifact](-[classifier]).[ext], bootOnly

sbt -version

編譯kafka-manager

./sbt clean dist

出現此圖表示更新成功

cd  /opt/kafka-manager/target/universal/

unzip kafka-manager-2.0.0.1.zip

修改配置

kafka-manager.zkhosts="localhost:2181"此行中的localhost,改為你的Zookeeper服務器的IP地址

啟動

nohup ./kafka-manager -Dconfig.file=/opt/kafka-manager/target/universal/kafka-manager-2.0.0.1/conf/application.conf -Dhttp.port=9001 &

 win10上面運行連接遠程kafka記得在C:\Windows\System32\drivers\etc下修改hosts

47.103.*.* node1


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM