21.6.6:安裝kafka-2.8
說明:kafka 在設計上就是依賴於 zookeeper 的,所以啟動 kafka 前需要啟動 zookeeper
***zookeeper的安裝:
zookeeper依賴於jdk環境
***先安裝jdk
yum -y install java-1.8.0-openjdk-demo.x86_64
#驗證一下是否安裝成功
java -version
若java安裝不成功,需要更換yum源
#備份初始源
#備份初始源配置
mv /etc/yum.repos.d/CentOS-Base.repo /etc/yum.repos.d/CentOS-Base.repo.backup
#下載新的阿里鏡像源
wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo
#清理和重建索引
yum clean all
yum makecache
***開始安裝zookeeper
wget https://mirrors.tuna.tsinghua.edu.cn/apache/zookeeper/zookeeper-3.7.0/apache-zookeeper-3.7.0-bin.tar.gz
tar -zxvf apache-zookeeper-3.7.0-bin.tar.gz
mv apache-zookeeper-3.7.0-bin /usr/local
ln -s /usr/local/apache-zookeeper-3.7.0-bin /usr/local/zookeeper
# 添加至環境變量
echo export PATH=\"\$PATH:/usr/local/zookeeper/bin\" >> ~/.bashrc
#更新環境變量
source ~/.bashrc
目錄說明:
/usr/local/apache-zookeeper-3.7.0-bin/bin 執行文件(.sh的文件是linux文件,.cmd文件是windows文件)
/usr/local/apache-zookeeper-3.7.0-bin/conf 配置文件
/usr/local/apache-zookeeper-3.7.0-bin/docs 文檔
/usr/local/apache-zookeeper-3.7.0-bin/lib jars包
開始配置:
cd /usr/local/zookeeper/conf
cp zoo_sample.cfg zoo.cfg
vim zoo.cfg
tickTime=2000 #檢測時間間隔
initLimit=10 主從連接超時時間
syncLimit=5 follower與leader同步超時時間
dataDir=/usr/local/zookeeper/data 存儲節點id、地址、數據快照
clientPort=2181 對外服務的端口
maxClientCnxns=60 客戶端對外連接的數量
啟動、關閉、狀態、查看、連接
啟動:/usr/local/zookeeper/bin/zkServer.sh start
關閉:/usr/local/zookeeper/bin/zkServer.sh stop
狀態:/usr/local/zookeeper/bin/zkServer.sh status
查看啟動:ps aux|grep zoo
連接本機zoo:/usr/local/zookeeper/bin/zkCli.sh
連接其他機器:zkCli.sh -server 192.168.74.128:2181
配置集群版(更新中):
zoo.cfg中
server.1 = 192.168.74.129:28888:38888
server.2 = 192.168.74.130:28888:38888
server.3 = 192.168.74.131:28888:38888
***開始安裝:
1)官網:http://kafka.apache.org/downloads
2)下載:https://downloads.apache.org/kafka/2.8.0/kafka_2.13-2.8.0.tgz
tar -zxvf kafka_2.13-2.8.0.tgz
mv kafka_2.13-2.8.0 /usr/local/
由於下載的是二進制包,所以解壓后就算是安裝好了,無需編譯。
kafka 在設計上就是依賴於 zookeeper 的,所以啟動 kafka 前需要啟動 zookeeper
啟動kafka:
/usr/local/kafka_2.13-2.8.0/bin/kafka-server-start.sh /usr/local/kafka_2.13-2.8.0/config/server.properties
后台啟動:
nohup /usr/local/kafka_2.13-2.8.0/bin/kafka-server-start.sh /usr/local/kafka_2.13-2.8.0/config/server.properties>>kafka.nohup &
端口:
創建topic:
/usr/local/kafka_2.13-2.8.0/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
創建一個名為test的topic,1個分區,每個分區分配1個副本
查看topic是否創建成功
/usr/local/kafka_2.13-2.8.0/bin/kafka-topics.sh -list -zookeeper localhost:2181
開始驗證:
從producer端發送消息
查看consumer端接收到的消息
producer端:
/usr/local/kafka_2.13-2.8.0/bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
consumer端:
/usr/local/kafka_2.13-2.8.0/bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning
能正常發送消息,能正常接收消息證明搭建成功