Cloudera Manager中安裝部署Elasticsearch服務

 

 

 

1. 制作Elasticsearch的Parcel包和csd文件

2. 將Parcel包和manifest.json文件部署到httpd服務中

   [root@node01 ~]# mkdir -p /var/www/html/elasticsearch [root@node01 ~]# cd /var/www/html/elasticsearch [root@node01 elasticsearch]# cp /root/github/cloudera/elasticsearch-parcel/build-parcel/ELASTICSEARCH-0.0.5.elasticsearch.p0.5/ ./ [root@node01 elasticsearch]# cp /root/github/cloudera/elasticsearch-parcel/build-parcel/manifest.json ./ [root@node01 elasticsearch]# ll total 338924 -rw-r--r-- 1 root root 347041696 May 5 10:23 ELASTICSEARCH-0.0.5.elasticsearch.p0.5-xenial.parcel -rw-r--r-- 1 root root 485 May 5 10:23 manifest.json

    

   瀏覽器訪問是否部署成功
   

3. 將生成的csd文件,復制到cloudera-manager-server服務所在節點的/opt/cloudera/csd目錄下

   [root@node01 ~]# cd /opt/cloudera/csd/ [root@node01 csd]# cp ~/github/cloudera/elasticsearch-parcel/build-csd/ELASTICSEARCH-1.0.jar ./

    

4. 重啟cloudera-scm-server服務

   [root@node01 ~]# /opt/cm-5.12.1/etc/init.d/cloudera-scm-server restart

    
5. 配置遠程Parcel存儲庫

   

6. 重啟Cloudera Management Service
   

7. 下載分發激活
   
   
   
   
   

8. 部署Elasticsearch
   
   
   
   
   
   
   

9. 配置節點

   cluster.initial_master_nodes: ["bigdata-dev-41","bigdata-dev-42","bigdata-dev-43"]

    

   
   

   1. 1. 遇到的問題

         1. 問題一

            could not find java in JAVA_HOME or bundled at /usr/java/latest/bin/java

             
            解決辦法：

            [root@node01 cloudera]# cd elasticsearch-parcel
            [root@node01 cloudera]# cd csd-src/scripts/
            [root@node01 cloudera]# vim control.sh

             
            注釋掉JAVA_HOME設置

            locateJava() {
            	echo
                #export JAVA_HOME=/usr/java/latest
                echo "Changing Java Home to: $JAVA_HOME"
            	export JAVA="$JAVA_HOME/bin/java"
            	echo "Changing Java to: $JAVA"
                echo
            }

             
         2. 問題二

            Exception in thread "main" org.elasticsearch.bootstrap.BootstrapException: org.elasticsearch.cli.UserException: unable to create temporary keystore at [/opt/cloudera/parcels/ELASTICSEARCH/config/elasticsearch.keystore.tmp], please check filesystem permissions Likely root cause: java.nio.file.AccessDeniedException: /opt/cloudera/parcels/ELASTICSEARCH-0.0.5.elasticsearch.p0.5/config/elasticsearch.keystore.tmp at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214) at java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434) at java.nio.file.Files.newOutputStream(Files.java:216) at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:411) at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:407) at org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:255) at org.elasticsearch.common.settings.KeyStoreWrapper.save(KeyStoreWrapper.java:467) at org.elasticsearch.bootstrap.Bootstrap.loadSecureSettings(Bootstrap.java:232) at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:289) at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) at org.elasticsearch.cli.Command.main(Command.java:90) at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92)

         　　                  解決辦法：
                                   在cdh集群各個節點均執行：

                          chmod 777 /opt/cloudera/parcels/ELASTICSEARCH-0.0.5.elasticsearch.p0.5/config/