環境:
3台centos7.4
3台zookeeper3.4.14
1. wget http://mirror.bit.edu.cn/apache/kafka/2.3.0/kafka_2.11-2.3.0.tgz
2. 解壓:tar -zxvf kafka_2.11-2.3.0.tgz
3. 進入kafka目錄,修改config/server.properties,找到zookeeper.connect,修改zk集群的連接地址為:
zookeeper.connect=10.99.32.3:2181,10.99.32.31:2181,10.99.32.9:2181
然后修改broker.id=0 //1,2,每個節點的id必須不一樣,否則啟動會報錯
4. 啟動kafka:bin/kafka-server-start.sh -daemon config/server.properties
啟動報錯:org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists:寫入zk時目錄相同,原因可能是server.properties里面的broker.id=1重復了
5. 啟動成功后使用jps查看運行的,或者使用ps -aux | grep kafka,有記錄即為運行成功
6. 創建topic:
bin/kafka-topics.sh --create --zookeeper 10.99.32.3:2181 --replication-factor 3 --partitions 1 --topic myTopic
7. 顯示topic信息:
bin/kafka-topics.sh --describe --zookeeper 10.99.32.3:2181 --topic myTopic
8. 添加信息節點只需要配置增加即可