集群規划:
| Hostname | Elasticsearch | Kibana | Marvel | Marvel Client |
|---|---|---|---|---|
| node01 | √ | √ | √ | √ |
| node02 | √ | √ | ||
| node03 | √ | √ | ||
| node04 | √ | √ | ||
| node05 | √ | √ |
前置准備請參考(主要是jdk 和 免密登錄):
https://www.cnblogs.com/ronnieyuan/p/11518913.html
https://www.cnblogs.com/ronnieyuan/p/11461377.html
Elasticsearch 的安裝
-
上傳tar包並解壓:
tar -zxvf elasticsearch-7.3.2-no-jdk-linux-x86_64.tar.gz -C /opt/ronnie/ -
修改配置文件
cd /opt/ronnie/elasticsearch-7.3.2/config/ vim elasticsearch.yml需要修改的配置:
# 集群名 cluster.name: ronnie-es # 節點名 我這是5台虛擬機, 所以分別是node-1 到 node-5 node.name: node-1 # 主機名 network.host: 192.168.180.130 # http連接端口, ps: 9300為集群內部通信端口 http.port: 9200 # 比較新的版本不需要配置多波和防腦裂 discovery.zen.ping_timeout: 120s client.transport.ping_timeout: 60s discovery.zen.ping.unicast.hosts: ["192.168.180.130","192.168.180.131","192.168.180.132","192.168.180.133","192.168.180.134"] # 初始主節點 cluster.initial_master_nodes: ["node-1"] -
將elasticsearch目錄發送給其他4台虛擬機
scp -r /opt/ronnie/elasticsearch-7.3.2/ root@192.168.180.131:/opt/ronnie/ scp -r /opt/ronnie/elasticsearch-7.3.2/ root@192.168.180.132:/opt/ronnie/ scp -r /opt/ronnie/elasticsearch-7.3.2/ root@192.168.180.133:/opt/ronnie/ scp -r /opt/ronnie/elasticsearch-7.3.2/ root@192.168.180.134:/opt/ronnie/修改elasticsearch.yml文件中對應的節點名和主機名
-
修改系統配置文件
vim ~/.bashrc， 添加ES_HOME路徑
# elasticsearch export ES_HOME=/opt/ronnie/elasticsearch-7.3.2 export PATH=$ES_HOME/bin:$PATH使修改后的配置生效: source ~/.bashrc， 在命令行下可以tab出elasticsearch即配置成功
-
這時候啟動會報一個錯: org.elasticsearch.bootstrap.StartupException:java.lang.RuntimeException: can not run elasticsearch as root
- 原因是es 不允許使用root權限運行, 以前發生過生產事故。
-
所以我們需要創建一個非root用戶來運行es
groupadd es useradd es -g es -p 123456 cd /opt/ronnie chown -R es:es elasticsearch-7.3.2/ # 切換為es用戶 su es
-
啟動報錯
# 說明可控的虛擬內存太小了, 需要調整虛擬內存 max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]-
su root 切換到root用戶
-
執行命令:
sysctl -w vm.max_map_count=262144 -
再切換回非root用戶啟動
-
可以看到一個個節點信息被注冊到主節點
[2019-12-19T13:21:33,355][INFO ][o.e.l.LicenseService ] [node-1] license [f1827ea0-c747-4151-98ec-e5db1b56ee14] mode [basic] - valid [2019-12-19T13:21:33,357][INFO ][o.e.x.s.s.SecurityStatusChangeListener] [node-1] Active license is now [BASIC]; Security is disabled [2019-12-19T13:21:35,056][INFO ][o.e.c.s.MasterService ] [node-1] node-join[{node-2}{fccTE81jSGyFi6UAqI3pJA}{Ei_BMkwPR1S3P577Oy85yA}{192.168.180.131}{192.168.180.131:9300}{dim}{ml.machine_memory=3781853184, ml.max_open_jobs=20, xpack.installed=true} join existing leader], term: 1, version: 16, reason: added {{node-2}{fccTE81jSGyFi6UAqI3pJA}{Ei_BMkwPR1S3P577Oy85yA}{192.168.180.131}{192.168.180.131:9300}{dim}{ml.machine_memory=3781853184, ml.max_open_jobs=20, xpack.installed=true},} [2019-12-19T13:21:35,781][INFO ][o.e.c.s.ClusterApplierService] [node-1] added {{node-2}{fccTE81jSGyFi6UAqI3pJA}{Ei_BMkwPR1S3P577Oy85yA}{192.168.180.131}{192.168.180.131:9300}{dim}{ml.machine_memory=3781853184, ml.max_open_jobs=20, xpack.installed=true},}, term: 1, version: 16, reason: Publication{term=1, version=16} [2019-12-19T13:21:36,120][INFO ][o.e.c.s.MasterService ] [node-1] node-join[{node-3}{iYSKZYruQziDaukE38R9Hg}{731BcyNzTfmLsxoLUkVcsA}{192.168.180.132}{192.168.180.132:9300}{dim}{ml.machine_memory=3781853184, ml.max_open_jobs=20, xpack.installed=true} join existing leader], term: 1, version: 17, reason: added {{node-3}{iYSKZYruQziDaukE38R9Hg}{731BcyNzTfmLsxoLUkVcsA}{192.168.180.132}{192.168.180.132:9300}{dim}{ml.machine_memory=3781853184, ml.max_open_jobs=20, xpack.installed=true},} [2019-12-19T13:21:36,645][INFO ][o.e.c.s.ClusterApplierService] [node-1] added {{node-3}{iYSKZYruQziDaukE38R9Hg}{731BcyNzTfmLsxoLUkVcsA}{192.168.180.132}{192.168.180.132:9300}{dim}{ml.machine_memory=3781853184, ml.max_open_jobs=20, xpack.installed=true},}, term: 1, version: 17, reason: Publication{term=1, version=17} [2019-12-19T13:21:37,385][INFO ][o.e.c.s.MasterService ] [node-1] node-join[{node-4}{qgdThjgcS02z55uB6RAXJg}{TVdEG16wSA-8r9HNfjMrjg}{192.168.180.133}{192.168.180.133:9300}{dim}{ml.machine_memory=3781853184, ml.max_open_jobs=20, xpack.installed=true} join existing leader], term: 1, version: 19, reason: added {{node-4}{qgdThjgcS02z55uB6RAXJg}{TVdEG16wSA-8r9HNfjMrjg}{192.168.180.133}{192.168.180.133:9300}{dim}{ml.machine_memory=3781853184, ml.max_open_jobs=20, xpack.installed=true},} [2019-12-19T13:21:37,844][INFO ][o.e.c.s.ClusterApplierService] [node-1] added {{node-4}{qgdThjgcS02z55uB6RAXJg}{TVdEG16wSA-8r9HNfjMrjg}{192.168.180.133}{192.168.180.133:9300}{dim}{ml.machine_memory=3781853184, ml.max_open_jobs=20, xpack.installed=true},}, term: 1, version: 19, reason: Publication{term=1, version=19} [2019-12-19T13:21:37,848][INFO ][o.e.c.s.MasterService ] [node-1] node-join[{node-5}{3LkyJBolQAK-MQ9msg60ow}{AB15qo9QQJCi3smFB4WhnQ}{192.168.180.134}{192.168.180.134:9300}{dim}{ml.machine_memory=3781853184, ml.max_open_jobs=20, xpack.installed=true} join existing leader], term: 1, version: 20, reason: added {{node-5}{3LkyJBolQAK-MQ9msg60ow}{AB15qo9QQJCi3smFB4WhnQ}{192.168.180.134}{192.168.180.134:9300}{dim}{ml.machine_memory=3781853184, ml.max_open_jobs=20, xpack.installed=true},} [2019-12-19T13:21:38,257][INFO ][o.e.c.s.ClusterApplierService] [node-1] added {{node-5}{3LkyJBolQAK-MQ9msg60ow}{AB15qo9QQJCi3smFB4WhnQ}{192.168.180.134}{192.168.180.134:9300}{dim}{ml.machine_memory=3781853184, ml.max_open_jobs=20, xpack.installed=true},}, term: 1, version: 20, reason: Publication{term=1, version=20} -
通過瀏覽器訪問9200端口:
-