Cloudera Manager安裝之利用parcels方式安裝3或4節點集群（包含最新穩定版本或指定版本的安裝）（添加服務）（CentOS6.5）（五）

 

參考博客

Cloudera Manager安裝之利用parcels方式安裝單節點集群

 Cloudera Manager安裝之Cloudera Manager 5.3.X安裝（三）（tar方式、rpm方式和yum方式）

 

 

 

 　　ClouderManager官網的安裝歷史穩定版

https://www.cloudera.com/documentation/manager/5-1-x/Cloudera-Manager-Installation-Guide/cm5ig_install_older_cm5.html

 

 

 

 

 

說在前面的話（看清楚就好！！！）

　　 我這篇博客，是兩種方式都使用過：（在/etc/yum.repos.d下的）

[hadoop@clouderamanager01 yum.repos.d]$ sudo vi cloudera-manager.repo
[hadoop@clouderamanager02 yum.repos.d]$ sudo vi cloudera-manager.repo
[hadoop@clouderamanager03 yum.repos.d]$ sudo vi cloudera-manager.repo

 

即（博主我推薦用這種！！！）（但是不需）

[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera Manager
baseurl=https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/
gpgkey =https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/RPM-GPG-KEY-cloudera
gpgcheck = 1

 

 

 

 

或者（但是，需要自定義存儲庫）

[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera Manager
baseurl=https://clouderamanager01/cm5/redhat/6/x86_64/cm/5.3.6/
enabled = 1
gpgcheck = 1

 

 

 

 

 

 

 

 

 

 

 

 

 

 

　　我這里是，使用CM 5.3.x利用parcels方式集群安裝CDH 5.3.x的3節點集群！（開始開工）

 

 

 

 

 

下載以下三個文件就好：

http://archive.cloudera.com/cdh5/parcels/5.3.6/CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel http://archive.cloudera.com/cdh5/parcels/5.3.6/CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha1 http://archive.cloudera.com/cdh5/parcels/5.3.6/manifest.json

 

 

 

 

 

 

 

 

　　以下是clouderamanager01這台機器上（主節點）

 

[hadoop@clouderaManager01 softwares]$ pwd
/opt/softwares [hadoop@clouderaManager01 softwares]$ ll total 4 drwxr-xr-x 2 hadoop hadoop 4096 Apr 8 13:49 cm-5.3.6 [hadoop@clouderaManager01 softwares]$ sudo mkdir cdh-5.3.6 [hadoop@clouderaManager01 softwares]$ ll total 8 drwxr-xr-x 2 root root 4096 Apr 8 20:00 cdh-5.3.6 drwxr-xr-x 2 hadoop hadoop 4096 Apr 8 13:49 cm-5.3.6 [hadoop@clouderaManager01 softwares]$ cd cdh-5.3.6/ [hadoop@clouderaManager01 cdh-5.3.6]$ pwd /opt/softwares/cdh-5.3.6 [hadoop@clouderaManager01 cdh-5.3.6]$ ll total 0 [hadoop@clouderaManager01 cdh-5.3.6]$ sudo rz [hadoop@clouderaManager01 cdh-5.3.6]$ sudo rz [hadoop@clouderaManager01 cdh-5.3.6]$ sudo rz [hadoop@clouderaManager01 cdh-5.3.6]$ ll total 1473900 -rw-r--r-- 1 root root 1509217191 Apr 7 19:38 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.html -rw-r--r-- 1 root root 41 Apr 7 19:24 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha1 -rw-r--r-- 1 root root 42661 Apr 7 19:24 manifest.json [hadoop@clouderaManager01 cdh-5.3.6]$ 

 

 

 

 

 

 　　以下是clouderamanager01這台機器上安裝之后，默認產生的（在這里，你看看就好）

[hadoop@clouderaManager01 opt]$ pwd
/opt [hadoop@clouderaManager01 opt]$ ll total 16 drwxr-xr-x 4 cloudera-scm cloudera-scm 4096 Apr 8 18:31 cloudera drwxr-xr-x 2 root root 4096 Apr 8 18:13 cloudera-manager drwxr-xr-x. 2 root root 4096 Nov 22 2013 rh drwxr-xr-x 4 hadoop hadoop 4096 Apr 8 20:00 softwares [hadoop@clouderaManager01 opt]$ cd cloudera [hadoop@clouderaManager01 cloudera]$ ll total 8 drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Jul 30 2015 csd drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Jul 30 2015 parcel-repo [hadoop@clouderaManager01 cloudera]$ cd parcel-repo/ [hadoop@clouderaManager01 parcel-repo]$ pwd /opt/cloudera/parcel-repo [hadoop@clouderaManager01 parcel-repo]$ ll total 0 [hadoop@clouderaManager01 parcel-repo]$ 

 

 

 

 　　或者，有時候，安裝CM完成后，出現：

以下是clouderamanager01這台機器上安裝之后，默認產生的（在這里，你看看就好）

 

[hadoop@clouderamanager01 opt]$ pwd
/opt
[hadoop@clouderamanager01 opt]$ ll
total 8
drwxr-xr-x  4 cloudera-scm cloudera-scm 4096 Apr  8 22:48 cloudera
drwxr-xr-x. 3 hadoop       hadoop       4096 Apr  8 11:20 softwares
[hadoop@clouderamanager01 opt]$ cd cloudera/
[hadoop@clouderamanager01 cloudera]$ ll
total 8
drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Mar 20 11:24 csd
drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Mar 20 11:24 parcel-repo
[hadoop@clouderamanager01 cloudera]$

 

 

 

 

 

 

 

 

 　　上傳我們剛之前下載好的CDH離線包

[hadoop@clouderamanager01 softwares]$ pwd
/opt/softwares
[hadoop@clouderamanager01 softwares]$ ll
total 4
drwxr-xr-x. 2 hadoop hadoop 4096 Apr  8 11:20 cm-5.3.6
[hadoop@clouderamanager01 softwares]$ sudo mkdir cdh-5.3.6
[hadoop@clouderamanager01 softwares]$ ll
total 8
drwxr-xr-x  2 root   root   4096 Apr  8 23:04 cdh-5.3.6
drwxr-xr-x. 2 hadoop hadoop 4096 Apr  8 11:20 cm-5.3.6
[hadoop@clouderamanager01 softwares]$ cd cdh-5.3.6/
[hadoop@clouderamanager01 cdh-5.3.6]$ pwd
/opt/softwares/cdh-5.3.6
[hadoop@clouderamanager01 cdh-5.3.6]$ ll
total 0
[hadoop@clouderamanager01 cdh-5.3.6]$ sudo rz

[hadoop@clouderamanager01 cdh-5.3.6]$ sudo rz

[hadoop@clouderamanager01 cdh-5.3.6]$ sudo rz

[hadoop@clouderamanager01 cdh-5.3.6]$ ll
total 1473900
-rw-r--r-- 1 root root 1509217191 Apr  8 12:47 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.html
-rw-r--r-- 1 root root         41 Apr  8 12:32 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha1
-rw-r--r-- 1 root root      42661 Apr  8 12:33 manifest.json
[hadoop@clouderamanager01 cdh-5.3.6]$ 

 　　注意，是，CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel。而不是CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.html，也不是CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.parcel！！！（這個離線包很容易在下載的時候，自己出現后綴的變名。）（若是你下載的時候，沒出現變名是更好啦！）

 

 　　

 

 

 

 

 　　需要改CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha1的名稱和CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.html的名稱

 

[hadoop@clouderamanager01 cdh-5.3.6]$ pwd
/opt/softwares/cdh-5.3.6
[hadoop@clouderamanager01 cdh-5.3.6]$ ll
total 1473900
-rw-r--r-- 1 root root 1509217191 Apr  8 12:47 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.html
-rw-r--r-- 1 root root         41 Apr  8 12:32 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha1
-rw-r--r-- 1 root root      42661 Apr  8 12:33 manifest.json
[hadoop@clouderamanager01 cdh-5.3.6]$ sudo mv CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha1 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha
[hadoop@clouderamanager01 cdh-5.3.6]$ sudo mv CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.html CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel
[hadoop@clouderamanager01 cdh-5.3.6]$ ll
total 1473900
-rw-r--r-- 1 root root 1509217191 Apr  8 12:47 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel
-rw-r--r-- 1 root root         41 Apr  8 12:32 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha
-rw-r--r-- 1 root root      42661 Apr  8 12:33 manifest.json
[hadoop@clouderamanager01 cdh-5.3.6]$ 

　　一定要改成，CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel和CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha。

 

 

 

 

 

 　　

 

[hadoop@clouderamanager01 cdh-5.3.6]$ pwd
/opt/softwares/cdh-5.3.6
[hadoop@clouderamanager01 cdh-5.3.6]$ ll
total 1473900
-rw-r--r-- 1 root root 1509217191 Apr  8 12:47 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel
-rw-r--r-- 1 root root         41 Apr  8 12:32 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha
-rw-r--r-- 1 root root      42661 Apr  8 12:33 manifest.json
[hadoop@clouderamanager01 cdh-5.3.6]$ more CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha
9b0c758c15792be3d7da7597b376668c09a32e2d
[hadoop@clouderamanager01 cdh-5.3.6]$ 

 

 

 

 

 

 

 

 

　　　　查看manifest.json

http://archive.cloudera.com/cdh5/parcels/5.3.6/manifest.json

 

 

 

 

 

 

　　在clouderamanager02和clouderamanager03機器上，進入/etc/yum.repos.d/

 

[hadoop@clouderamanager02 ~]$ cd /etc/yum.repos.d/
[hadoop@clouderamanager02 yum.repos.d]$ pwd
/etc/yum.repos.d
[hadoop@clouderamanager02 yum.repos.d]$ ll
total 16
-rw-r--r--. 1 root root 1926 Nov 27  2013 CentOS-Base.repo
-rw-r--r--. 1 root root  638 Nov 27  2013 CentOS-Debuginfo.repo
-rw-r--r--. 1 root root  630 Nov 27  2013 CentOS-Media.repo
-rw-r--r--. 1 root root 3664 Nov 27  2013 CentOS-Vault.repo
[hadoop@clouderamanager02 yum.repos.d]$ sudo vi cloudera-manager.repo

 

 

 

 

[cloudera-manager]
name=Cloudera Manager baseurl=http://clouderamanager01/cm5/redhat/6/x86_64/cm/5.3.6/ gpgcheck=0

 

 或者

[cloudera-manager]
name=Cloudera Manager
baseurl=http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/
gpgcheck=1

 　　同理，機器clouderamanager03也要去做。

 

 

 

 

 

 

 

 

 

 

關於/opt/cloudera/parcel-repo和/opt/cloudera/parcel（必須弄懂，別怕）

　　192.168.80.148   clouderamanager01　 （部署ClouderaManager-server和Mirror server）  （部署Agent） 　　　　（分配1G，我這里只是體驗過程，當然你可以分配更多或更小)　

　　192.168.80.149   clouderamanager02    （部署Agent）　　　　　　　　　　　　　　　　　　　　　 （分配1G，我這里只是體驗過程，當然你可以分配更多或更小)

　　192.168.80.150   clouderamanager03   （部署Agent）

 

　　部署ClouderaManager-server和Mirror server的機器，默認是存儲在/opt/cloudera/parcel-repo。

　　部署Agent的機器，默認是存儲在/opt/cloudera/parcel。

 

 

 　　即，這也是為什么，我在下面這篇博客里寫到。

Cloudera Manager安裝之Cloudera Manager 5.3.X安裝（三）（tar方式、rpm方式和yum方式）

　　博客里，提及到的tar方式來安裝。

 

　　

 

 

 

　　

 

 

 

 

 

 

 

 

 

 

 

 

 

 　　進入，CM安裝的機器，自動生成的默認/opt/cloudera/parcel-repo目錄下（在clouderamanager01主節點）

[hadoop@clouderamanager01 opt]$ pwd
/opt
[hadoop@clouderamanager01 opt]$ ll
total 8
drwxr-xr-x  4 cloudera-scm cloudera-scm 4096 Apr  8 22:48 cloudera
drwxr-xr-x. 4 hadoop       hadoop       4096 Apr  8 23:04 softwares
[hadoop@clouderamanager01 opt]$ cd cloudera/
[hadoop@clouderamanager01 cloudera]$ pwd
/opt/cloudera
[hadoop@clouderamanager01 cloudera]$ ll
total 8
drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Mar 20 11:24 csd
drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Mar 20 11:24 parcel-repo
[hadoop@clouderamanager01 cloudera]$ cd parcel-repo/
[hadoop@clouderamanager01 parcel-repo]$ pwd
/opt/cloudera/parcel-repo
[hadoop@clouderamanager01 parcel-repo]$ ll
total 0
[hadoop@clouderamanager01 parcel-repo]$ 

 

 

 

 

 

 　　將我們之前上傳在/opt/softwares/cdh-5.3.6（其實這個用作為備份，萬一以后丟失了再可以重新安裝。免得再下載）的CDH離線安裝包，

移動到這個/opt/cloudera/parcel-repo目錄上去。

 

[hadoop@clouderamanager01 parcel-repo]$ pwd
/opt/cloudera/parcel-repo
[hadoop@clouderamanager01 parcel-repo]$ ll
total 0
[hadoop@clouderamanager01 parcel-repo]$ sudo cp /opt/softwares/cdh-5.3.6/CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel .
[hadoop@clouderamanager01 parcel-repo]$ sudo cp /opt/softwares/cdh-5.3.6/CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha .
[hadoop@clouderamanager01 parcel-repo]$ ll
total 1473856
-rw-r--r-- 1 root root 1509217191 Apr  8 23:35 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel
-rw-r--r-- 1 root root         41 Apr  8 23:35 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha
[hadoop@clouderamanager01 parcel-repo]$ sudo cp /opt/softwares/cdh-5.3.6/manifest.json .
[hadoop@clouderamanager01 parcel-repo]$ ll
total 1473900
-rw-r--r-- 1 root root 1509217191 Apr  8 23:35 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel
-rw-r--r-- 1 root root         41 Apr  8 23:35 CDH-5.3.6-1.cdh5.3.6.p0.11-el6.parcel.sha
-rw-r--r-- 1 root root      42661 Apr  8 23:35 manifest.json
[hadoop@clouderamanager01 parcel-repo]$ 

 

 

 

 

 

 

 

[hadoop@clouderamanager01 parcel-repo]$ sudo service cloudera-scm-server status
cloudera-scm-server (pid  1888) is running...
[hadoop@clouderamanager01 parcel-repo]$ sudo service cloudera-scm-server restart
Stopping cloudera-scm-server:                              [  OK  ]
Starting cloudera-scm-server:                              [  OK  ]
[hadoop@clouderamanager01 parcel-repo]$ 

 　　等上幾分鍾，

 

 

 

 

 

 

 

 　　如果Clouder Manager的7180端口，沒起來，怎么辦？

[hadoop@clouderamanager01 parcel-repo]$  sudo netstat -tnlp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address               Foreign Address             State       PID/Program name   
tcp        0      0 0.0.0.0:22                  0.0.0.0:*                   LISTEN      901/sshd            
tcp        0      0 127.0.0.1:25                0.0.0.0:*                   LISTEN      985/master          
tcp        0      0 0.0.0.0:7432                0.0.0.0:*                   LISTEN      1850/postgres       
tcp        0      0 :::80                       :::*                        LISTEN      995/httpd           
tcp        0      0 :::22                       :::*                        LISTEN      901/sshd            
tcp        0      0 ::1:25                      :::*                        LISTEN      985/master          
tcp        0      0 :::7432                     :::*                        LISTEN      1850/postgres       
[hadoop@clouderamanager01 parcel-repo]$ sudo reboot

Broadcast message from hadoop@clouderamanager01
    (/dev/pts/0) at 23:45 ...

The system is going down for reboot NOW!
[hadoop@clouderamanager01 parcel-repo]$ 
Connection closed by foreign host.

Disconnected from remote host(clouderamanager01) at 15:46:15.

Type `help' to learn how to use Xshell prompt.

 

 

　　或者

　　改為本地的，進入/etc/yum.repos.d

　　即

sudo chmod 755  clouder-manager.repo

[hadoop@clouderamanager01 yum.repos.d]$ pwd
/etc/yum.repos.d
[hadoop@clouderamanager01 yum.repos.d]$ ll
total 20
-rw-r--r--. 1 root root 1926 Nov 27  2013 CentOS-Base.repo
-rw-r--r--. 1 root root  638 Nov 27  2013 CentOS-Debuginfo.repo
-rw-r--r--. 1 root root  630 Nov 27  2013 CentOS-Media.repo
-rw-r--r--. 1 root root 3664 Nov 27  2013 CentOS-Vault.repo
-rw-r--r--  1 root root  202 Apr  9 01:59 cloudera-manager.repo
[hadoop@clouderamanager01 yum.repos.d]$ sudo chmod 755 cloudera-manager.repo
[hadoop@clouderamanager01 yum.repos.d]$ ll
total 20
-rw-r--r--. 1 root root 1926 Nov 27  2013 CentOS-Base.repo
-rw-r--r--. 1 root root  638 Nov 27  2013 CentOS-Debuginfo.repo
-rw-r--r--. 1 root root  630 Nov 27  2013 CentOS-Media.repo
-rw-r--r--. 1 root root 3664 Nov 27  2013 CentOS-Vault.repo
-rwxr-xr-x  1 root root  202 Apr  9 01:59 cloudera-manager.repo
[hadoop@clouderamanager01 yum.repos.d]$ 

 

 

 

 

　　將

[cloudera-manager]
name=Cloudera Manager
baseurl=http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/
gpgcheck = 1

 

 

　　改為

[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera Manager
baseurl=http://clouderamanager01/cm5/redhat/6/x86_64/cm/5.3.6/   
gpgcheck = 1

 

 

 

　　注意，此時，所有的機器（比如我這里是clouderamanager01、clouderamanager02和clouderamanager03）都要更改為

[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera Manager
baseurl=http://clouderamanager01/cm5/redhat/6/x86_64/cm/5.3.6/
enabled =1 
gpgcheck = 1

 

 

 　　於是，將所有機器的/etc/yum.repos.d/clouder-manager.repo改好為本地的之后，再次刷新就好

 

 

 

 

 

 

clouderamanager[01-03]

 

 

 

　　

　　

　　有時候會是如下， 　　

 　　這是，因為。我之前前面3台機器都沒有啟動服務，所以會是如下。三個自動會勾選。

 

 

 

 

 

 

 http://clouderamanager01/cm5/redhat/6/x86_64/cm/5.3.6/

 

 

 

 在安裝過程中，出現如下問題

 

 

[hadoop@clouderaManager01 html]$ pwd
/var/www/html [hadoop@clouderaManager01 html]$ ll total 4 drwxr-xr-x 3 root root 4096 Apr 8 20:37 cm5 [hadoop@clouderaManager01 html]$ sudo mkdir -p cm5/redhat/6/x86_64/cm/5.3.6/repodata [hadoop@clouderaManager01 html]$ ll total 4 drwxr-xr-x 3 root root 4096 Apr 8 20:37 cm5 [hadoop@clouderaManager01 html]$ cd cm5/redhat/6/x86_64/cm/5.3.6/repodata/ [hadoop@clouderaManager01 repodata]$ pwd /var/www/html/cm5/redhat/6/x86_64/cm/5.3.6/repodata [hadoop@clouderaManager01 repodata]$ ll total 0 [hadoop@clouderaManager01 repodata]$ 

 

 

 

 

 

 

 

 

 

 

[hadoop@clouderamanager01 repodata]$ pwd
/var/www/html/cm5/redhat/6/x86_64/cm/5.3.6/repodata
[hadoop@clouderamanager01 repodata]$ lll
-bash: lll: command not found
[hadoop@clouderamanager01 repodata]$ ll
total 0
[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ sudo rz

[hadoop@clouderamanager01 repodata]$ ll
total 124
-rw-r--r-- 1 root root 91122 Apr  7 22:36 filelists.xml.gz
-rw-r--r-- 1 root root   198 Apr  7 22:36 filelists.xml.gz.asc
-rw-r--r-- 1 root root   570 Apr  7 22:36 other.xml.gz
-rw-r--r-- 1 root root   198 Apr  7 22:36 other.xml.gz.asc
-rw-r--r-- 1 root root  4208 Apr  7 22:37 primary.xml.gz
-rw-r--r-- 1 root root   198 Apr  7 22:37 primary.xml.gz.asc
-rw-r--r-- 1 root root   951 Apr  7 22:37 repomd.xml
-rw-r--r-- 1 root root   198 Apr  7 22:37 repomd.xml.asc
[hadoop@clouderamanager01 repodata]$ 

 

 

 

 

 

 

 

 

 

 

 　　如果還是沒有得到解決的話，則

[hadoop@clouderamanager01 yum.repos.d]$ sudo vi cloudera-manager.repo

[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64 name=Cloudera Manager baseurl=http://clouderamanager01/cm5/redhat/6/x86_64/cm/5.3.6/
enabled =1 gpgcheck = 1

　　這里。所有的節點都要一樣的。如果其下有其他的，刪除（比如cloudera-manager.repo.~!或其他的cloudera-manager.repo.repnew等）

 

 

 

　　以及重啟下

[hadoop@clouderamanager01 parcel-repo]$ sudo service cloudera-scm-server status
cloudera-scm-server (pid  1888) is running... [hadoop@clouderamanager01 parcel-repo]$ sudo service cloudera-scm-server restart Stopping cloudera-scm-server: [ OK ] Starting cloudera-scm-server: [ OK ] [hadoop@clouderamanager01 parcel-repo]$ 

 　　等上幾分鍾。

 

 　　如果還是沒有解決的話，說明那個文件cloudera-manager-agent-5.3.6-1.cm536.p0.244.el6.x86_64.rpm已經損壞了。重新下載它，再上傳。

 　　然后，再重啟

sudo service cloudera-scm-server restart

 　　就可以解決問題了。

 

 

 

　　如果還是沒解決的話，那就換成在線的吧！（哎）

 

[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera Manager
baseurl=https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/
gpgkey =https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/RPM-GPG-KEY-cloudera
gpgcheck = 1

　　然后，接着下面

　　重復，執行上面的過程。這里省略，.....

 

直至如下界面.....

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 　　

 

 

 　　如果你的網速慢的話，則會出現，

　　比如我還遇到過這樣的一種情況，也就是說，clouderamanager01先安裝成功，然后再次執行上面的重頭開始，再來clouderamanager02和clouderamanager03安裝成功！

 

 

 

 

 

 

 

 

 

 

 

 

 

安裝Parcel到所有主機上（我這里是clouderaManager01、clouderaManager02和clouderaManager03這台機器上）
　　因為Parcel文件已經提前下載好了，第一個進度條會直接顯示已下載，然后開始分配。這個過程實際上就是將Parcel內的軟件解壓縮安裝到各個主機上的過程。耐心等待，時間會比較長，我安裝3台主機（即在clouderaManager01、02和03上，安裝3節點集群）大概是需要30分鍾時間。（這里看個人的網速）

　　其實啊，這里分配就是解壓。

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 主機檢查
　　檢查就可以了，建議不要跳過。靜靜地等一分鍾多點的時間

　　檢查結果如下：

 

 

http://clouderamanager01:7180/cmf/express-wizard/wizard#step=hostInspectorStep

　　因為我這里，之前是在clouderaManager01、clouderaManager02、clouderaManager03和clouderaManager04安裝過。

然后，后面，再clouderamanager01、clouderamanager02和clouderamanager03。

　　所以，會已經有了記錄的痕跡。（當然，若是你第一次安裝的話，就不會有這個問題出現的哈！）

 　 Cloudera Manager安裝之Cloudera Manager安裝前准備(CentOS6.5）（一）

　　永久修改，我們直接修改配置文件，我們直接修改/etc/sysconfig/network

 

 

NETWORKING=yes
HOSTNAME=clouderaManager01

　　對應三台都要修改。我這里是自己，當時失誤！主機名弄錯大小寫字母M了。

 　　然后

sudo reboot

 

 

 

 

 

 

　　　這個問題怎么解決呢？

　　說白了swap就是交換區，當內存容不下這些數據時，就移動到磁盤那去。由於我們是大數據，不希望移動到磁盤。

[hadoop@clouderaManager01 ~]$ sudo free -m 
             total       used       free     shared    buffers     cached
Mem:           980        917         63          0          1         32
-/+ buffers/cache:        883         96
Swap:         1999        552       1447
[hadoop@clouderaManager01 ~]$ sudo cat /proc/sys/vm/swappiness
60
[hadoop@clouderaManager01 ~]$ sudo sysctl -w vm.swappiness=10
vm.swappiness = 10
[hadoop@clouderaManager01 ~]$ 

 　　clouderaManager01和clouderaManager02和clouderaManager03都要執行。

 　　

 

 

 

 

　　這個怎么來解決呢？是我們的Linux版本的bug問題。

 

[hadoop@clouderaManager01 ~]$ su root
Password: 
[root@clouderaManager01 hadoop]# echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
[root@clouderaManager01 hadoop]# vi /etc/rc.local 

　　

 

#!/bin/sh
#
# This script will be executed *after* all the other init scripts.
# You can put your own initialization stuff in here if you don't
# want to do the full Sys V style init stuff.

touch /var/lock/subsys/local


echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag

　　clouderaManager01和clouderaManager02和clouderaManager03都要執行。

 

 

 

 

　　帶你認識下安裝成功之后的目錄結構

[root@clouderaManager01 cloudera]# pwd
/opt/cloudera
[root@clouderaManager01 cloudera]# ll
total 16
drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Mar 20 11:24 csd
drwxr-xr-x 2 root         root         4096 Apr  9 04:14 parcel-cache
drwxr-xr-x 2 cloudera-scm cloudera-scm 4096 Apr  8 23:52 parcel-repo
drwxr-xr-x 4 root         root         4096 Apr  9 04:33 parcels
[root@clouderaManager01 cloudera]# cd parcels/
[root@clouderaManager01 parcels]# pwd
/opt/cloudera/parcels
[root@clouderaManager01 parcels]# ll
total 4
lrwxrwxrwx  1 root root   26 Apr  9 04:33 CDH -> CDH-5.3.6-1.cdh5.3.6.p0.11
drwxr-xr-x 11 root root 4096 Jul 29  2015 CDH-5.3.6-1.cdh5.3.6.p0.11
[root@clouderaManager01 parcels]# cd CDH
[root@clouderaManager01 CDH]# pwd
/opt/cloudera/parcels/CDH
[root@clouderaManager01 CDH]# ls
bin  etc  include  jars  lib  lib64  libexec  meta  share
[root@clouderaManager01 CDH]# 

 

 

 

 

 

 

 

[root@clouderaManager01 CDH]# pwd
/opt/cloudera/parcels/CDH
[root@clouderaManager01 CDH]# ll
total 80
drwxr-xr-x  2 root root  4096 Jul 29  2015 bin
drwxr-xr-x 26 root root  4096 Jul 29  2015 etc
drwxr-xr-x  4 root root  4096 Jul 29  2015 include
drwxr-xr-x  2 root root 49152 Jul 29  2015 jars
drwxr-xr-x 36 root root  4096 Jul 29  2015 lib
drwxr-xr-x  2 root root  4096 Jul 29  2015 lib64
drwxr-xr-x  3 root root  4096 Jul 29  2015 libexec
drwxr-xr-x  2 root root  4096 Jul 29  2015 meta
drwxr-xr-x  3 root root  4096 Jul 29  2015 share
[root@clouderaManager01 CDH]# cd bin/
[root@clouderaManager01 bin]# ls
avro-tools  hadoop                hcat          kite-dataset  oozie          solrctl         sqoop2-server            sqoop-help               sqoop-merge      zookeeper-client
beeline     hadoop-0.20           hdfs          llama         oozie-setup    spark-executor  sqoop2-tool              sqoop-import             sqoop-metastore  zookeeper-server
catalogd    hadoop-fuse-dfs       hive          llamaadmin    parquet-tools  spark-shell     sqoop-codegen            sqoop-import-all-tables  sqoop-version    zookeeper-server-cleanup
cli_mt      hadoop-fuse-dfs.orig  hiveserver2   load_gen      pig            spark-submit    sqoop-create-hive-table  sqoop-job                statestored      zookeeper-server-initialize
cli_st      hbase                 impalad       mahout        pyspark        sqoop           sqoop-eval               sqoop-list-databases     whirr
flume-ng    hbase-indexer         impala-shell  mapred        sentry         sqoop2          sqoop-export             sqoop-list-tables        yarn
[root@clouderaManager01 bin]# 

 

 

 

 

 

 

 

 

 

 

 

 

安裝完成之后，再安裝所需的服務（其實，這一步，若你的內存和空間足夠，最好選擇所有服務）

 　　其實啊，這步是選擇集群中要安裝的CDH服務，為了將來新增服務麻煩，我們這里選擇所有服務。其中有暫時用不到的服務，我們可以在界面中停止服務，這樣可以節省內存資源

　　這里，添加Cloudera Management Service服務

 

 

 

 

 　　然后，關於安裝其他的，如Zookeeper、Hive、HBase和Spakr、Hadoop等。這些。我就不贅述了。

 

　　因為，這是，我在自己的電腦虛擬機里搭建的。過卡和內存不夠，以下不貼圖和不寫了。

 　　

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

安裝完畢后點繼續

 　　貼圖，這里不寫了。

 

 

 

 

 

　　

 

 

 

 

 

 

 

 

 

 

 

 

 

角色分配
　　分配各個節點的角色

 

 

 

 

 

 

 

 

 

 

數據庫設置
　　CDH默認內嵌了一個數據庫，如果你需要MySQL或者Oracle請選擇使用自定義數據庫，

　　  我這里，先點擊測試連接，即選擇CDH默認的內嵌數據庫成功后點繼續。

 

 

 

 

 

 

 

 

 

 

審核更改
　　 這里全部默認就可以了，直接繼續。

 

 

 

 

 

 

 

 

 

安裝完成，初始化
　　到這里集群已經安裝部署完成了，CDH會自動對你選擇的服務進行初始化設置，你也可以稍后自行開啟。

 

 

 

 

初始化完成后，將進入主頁面

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

常見錯誤

[hadoop@clouderaManager01 parcel-repo]$ sudo service cloudera-scm-server restart

./cloudera-scm-server: line 109: pstree: command not found Starting cloudera-scm-server: [ OK ]

　　主要因為沒有安裝pstree包。


解決辦法：

[hadoop@clouderaManager01 parcel-repo]$ sudo yum install epel-release (安裝yum 源)
[hadoop@clouderaManager01 parcel-repo]$ sudo yum provides pstree (找到提供pstree命令的包)
[hadoop@clouderaManager01 parcel-repo]$ sudo yum install psmisc (安裝對應的包)


然后，
[hadoop@clouderaManager01 parcel-repo]$ sudo service cloudera-scm-server restart
Stopping cloudera-scm-server:                              [  OK  ]
Starting cloudera-scm-server:                              [  OK  ] 

 

 

 

 

 

Detecting Cloudera Manager Server...
    Detecting Cloudera Manager Server...
    BEGIN host -t PTR 192.168.1.198 198.1.168.192.in-addr.arpa domain name pointer localhost. END (0) using localhost as scm server hostname BEGIN which python /usr/bin/python END (0) BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' localhost 7182 Traceback (most recent call last): File "<string>", line 1, in <module> File "<string>", line 1, in connect socket.error: [Errno 111] Connection refused END (1) could not contact scm server at localhost:7182, giving up waiting for rollback request

 

 

解決辦法：

　　在失敗的主機上，終端執行

sudo mv /usr/bin/host /usr/bin/host.bak

　　然后重試。

 

 

 

 

　　安裝過程一直卡在"正在獲取安裝鎖"狀態界面

　　解決辦法：
在卡住的主機上，刪除/tmp文件夾中的所有scm_prepare_node.開頭的文件，清空yum緩存，然后重啟主機。

sudo cd /tmp 
sudo rm -rf  scm_prepare_node.* sudo yum clean all sudo reboot

 

 

 

 

 

安裝完畢后NameNode格式化失敗，報以下錯誤

IncorrectVersionException: Unexpected version of storage directory /data/dfs

　　解決辦法：

　　刪除NameNode節點的/data/dfs文件夾，重新添加主機。

 

 

 

 

如何更改節點ip

　　解決辦法：
　　重新設置每台主機的hosts文件，完成后進入主機界面，點擊重新運行升級向導，再走一遍之前的流程即可。

 

 

 

 

 

參考鏈接

http://www.mamicode.com/info-detail-1596233.html

http://www.jianshu.com/p/57179e03795f

http://www.aboutyun.com/thread-20741-1-1.html

 

 

 

 

 

 

 

 

 

 

 

 

 

 

擴展

　　參考

 

Cloudera Manager安裝之利用parcels方式（在線或離線）安裝3或4節點集群（包含最新穩定版本或指定版本的安裝）（添加服務）（Ubuntu14.04）（五）

 

 　　最好，在這之前，先將

注意，在此之前。

　　cmbigdata1機器上，則需要執行

bigdata@cmbigdata1:~$ sudo /usr/share/cmf/schema/scm_prepare_database.sh mysql scm scm scm_password

[sudo] password for bigdata: 
Sorry, try again.
[sudo] password for bigdata: 
JAVA_HOME=/usr/local/jdk/jdk1.8.0_60

Verifying that we can write to /etc/cloudera-scm-server Creating SCM configuration file in /etc/cloudera-scm-server Executing: /usr/java/jdk1.7.0_80/bin/java -cp /usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/schema/../lib/* com.cloudera.enterprise.dbutil.DbCommandExecutor /etc/cloudera-scm-server/db.properties com.cloudera.cmf.db. [ main] DbCommandExecutor INFO Successfully connected to database. All done, your SCM database is configured correctly! bigdata@ubuntucmbigdata1:~$ sudo service cloudera-scm-server start cloudera-scm-server is already running bigdata@cmbigdata1:~$ 

bigdata@cmbigdata1:~$ sudo service cloudera-scm-agent start
cloudera-scm-agent is already running
bigdata@cmbigdata1:~$

 

 

 

　　然后，在cmbigdata2、cmbigdata3、cmbigdata4上

bigdata@cmbigdata2:~$ sudo service cloudera-scm-agent start
cloudera-scm-agent is already running
bigdata@cmbigdata1:~$ 



bigdata@cmbigdata3:~$ sudo service cloudera-scm-agent start
cloudera-scm-agent is already running
bigdata@cmbigdata1:~$ 





bigdata@cmbigdata4:~$ sudo service cloudera-scm-agent start
cloudera-scm-agent is already running
bigdata@cmbigdata1:~$ 

 

 

 

 

 

 

 

 

 

 

 

 　　因為，我的集群情況是如下

 

 

 

 

 

 　　
 　　這是，因為。我之前前面4台機器都沒有啟動服務，所以會是如下。四個自動會勾選。

 

 

 

 

 

 　

 

 

　

 

 

 

 

 http://cmbigdata1/cm5/redhat/6/x86_64/cm/5.3.6/

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

http://cmbigdata1:7180/cmf/express-wizard/resume#step=installStep

 

 

 

 

 

 

 

 

 

 

　　對於，第一個黃色警告，其實就是時間同步 的問題。

[bigdata@cmbigdata1 ~]$ ntpdate pool.ntp.org
[bigdata@cmbigdata2 ~]$ ntpdate pool.ntp.org
[bigdata@cmbigdata3 ~]$ ntpdate pool.ntp.org
[bigdata@cmbigdata4 ~]$ ntpdate pool.ntp.org

 

 

 

　　對於，第二個黃色警告的解決辦法！

    Cloudera 建議將 /proc/sys/vm/swappiness 設置為 0。當前設置為 60。使用 sysctl 命令在運行時更改該設置並編輯 /etc/sysctl.conf 以在重啟后保存該設置。您可以繼續進行安裝，但可能會遇到問題，Cloudera Manager 報告您的主機由於交換運行狀況不佳。以下主機受到影響： 
cmbigdata[1-4]

　　

[bigdata@cmbigdata1 ~]$ su root
Password: 
[root@cmbigdata1 bigdata]# echo 0 > /proc/sys/vm/swappiness
[root@cmbigdata1 bigdata]# 

 

 

 

 

 

 

 

 

 

 　　然后，接下來，這一步，其實跟我另外寫的一篇用ambari是一樣的。

　　

Ambari安裝之部署3個節點的HA分布式集群

 

 

 

 

 　　最后，我的初步安裝是

 

 

 

 

 

 

 　　因為，在以后，自己是可以修改的。

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

所以，CDH默認內嵌了一個數據庫，無法通過。我這里選擇需要MySQL或者Oracle請選擇使用自定義數據庫，

　　比如Hive， oozie 元數據庫配置，使用我們安裝的mysql來存放元數據，其中數據庫名，用戶名和密碼需要預先創建好的。這里。請移步

 

 

 

 

　如果你是一名有經驗大數據工程師，無論是安裝jdk（注意：CentOS6.5有自帶的jdk），還是安裝mysql。都是先查看系統是否已經安裝Mysql包。

[root@master app]# rpm -qa|grep mysql 
mysql-libs-5.1.71-1.el6.x86_64
[root@master app]# rpm -e --nodeps mysql-libs-5.1.71-1.el6.x86_64
[root@master app]# rpm -qa|grep mysql 
[root@master app]#

 

 

 

[root@cmbigdata1 ~]# yum install mysql-server
Is this ok [y/N]: y

 

 

 

[root@cmbigdata1 ~]# service mysqld start

 

 

[root@cmbigdata1 ~]# yum install mysql-connector-java
Is this ok [y/N]: y

 

 

 

 

 

[root@cmbigdata ~]# mysql -u root -p
Enter password:           //默認密碼為空，輸入后回車即可
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 3
Server version: 5.1.73 Source distribution
Copyright (c) 2000, 2013, Oracle and/or its affiliates. All rights reserved.
mysql> set password for root@localhost=password('rootroot'); 　　密碼設置為rootroot
默認情況下Mysql只允許本地登錄，所以只需配置root@localhost就好

mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

mysql> exit;
Bye
[root@cmbigdata1 ~]#

 

 

 

 

 

 

 

[root@cmbigdata1 ~]# mysql -uroot -prootroot

 　　我這里，是第一次安裝。所以直接進入

 

 

 

mysql> create database hive DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on hive.* TO 'hive'@'%' IDENTIFIED BY 'hive';
Query OK, 0 rows affected (0.00 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

mysql> 

 

 

 

 

 

 

 

mysql> create database clouder_manager DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on clouder_manager.* TO 'clouder_manager'@'%' IDENTIFIED BY 'clouder_manager';
Query OK, 0 rows affected (0.00 sec)

mysql> 

 

 

 

 

 

 

 

 

mysql> create database amon DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on amon.* TO 'amon'@'%' IDENTIFIED BY 'amon_password';
Query OK, 0 rows affected (0.00 sec)

mysql> 

 

 

 

 

mysql> create database smon DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on smon.* TO 'smon'@'%' IDENTIFIED BY 'smon_password';
Query OK, 0 rows affected (0.00 sec)

 

 

 

mysql> create database rman DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on rman.* TO 'rman'@'%' IDENTIFIED BY 'rman_password';
Query OK, 0 rows affected (0.00 sec)

 

 

 

mysql> create database hmon DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on hmon.* TO 'hmon'@'%' IDENTIFIED BY 'hmon_password';
Query OK, 0 rows affected (0.00 sec)

 

 

 

mysql> create database nav DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on nav.* TO 'hmon'@'%' IDENTIFIED BY 'nav_password';
Query OK, 0 rows affected (0.00 sec)

 

 

 

 

mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

mysql> select user,host,password from mysql.user;
+-----------------+------------+-------------------------------------------+
| user            | host       | password                                  |
+-----------------+------------+-------------------------------------------+
| root            | localhost  | *6C362347EBEAA7DF44F6D34884615A35095E80EB |
| root            | cmbigdata1 |                                           |
| root            | 127.0.0.1  |                                           |
|                 | localhost  |                                           |
|                 | cmbigdata1 |                                           |
| hive            | %          | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| clouder_manager | %t         | *B2E4B48ED054F1F571DBCCAB3D08912B73FEF2D5 |
| amon            | %          | *4A1243A12C2625553EC0465DD4E640DB056AA07A |
| smon            | %          | *F65C49868BBCA6D143F5AF81D1864B1C64DF25B4 |
| rman            | %          | *AEF345BFE495D8E678EA9D3D5708FD110AD2F08E |
| hmon            | %          | *993A16D875A9AB1932CC2F57E7DADA76AD35C3B2 |
+-----------------+------------+-------------------------------------------+
11 rows in set (0.00 sec)

mysql> exit;
Bye
[root@cmbigdata1 ~]# 

 

 

 

 

　　然后，執行，還是如此

 

 

 

 

　　參考

Ubuntu 14.04 MySQL 安裝配置 For Cloudera Manages 5

 

 

 　　解決辦法

mysql> grant all on *.* TO 'hive'@'cmbigdata1' IDENTIFIED BY 'hive';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on *.* TO 'amon'@'cmbigdata1' IDENTIFIED BY 'amon_password';
Query OK, 0 rows affected (0.00 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on *.* TO 'clouder_manager'@'%cmbigdata1' IDENTIFIED BY 'clouder_manager';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on *.* TO 'smon'@'cmbigdata1' IDENTIFIED BY 'smon_password';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on *.* TO 'rman'@'cmbigdata1' IDENTIFIED BY 'rman_password';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on *.* TO 'hmon'@'cmbigdata1' IDENTIFIED BY 'hmon_password';
Query OK, 0 rows affected (0.01 sec)

mysql> grant all on *.* TO 'nav'@'cmbigdata1' IDENTIFIED BY 'nav_password';
Query OK, 0 rows affected (0.00 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

mysql> select user,host,password from mysql.user;
+-----------------+-------------+-------------------------------------------+
| user | host | password |
+-----------------+-------------+-------------------------------------------+
| root | localhost | *6C362347EBEAA7DF44F6D34884615A35095E80EB |
| root | cmbigdata1 | |
| root | 127.0.0.1 | |
| | localhost | |
| | cmbigdata1 | |
| hive | % | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| clouder_manager | %t | *B2E4B48ED054F1F571DBCCAB3D08912B73FEF2D5 |
| amon | % | *4A1243A12C2625553EC0465DD4E640DB056AA07A |
| smon | % | *F65C49868BBCA6D143F5AF81D1864B1C64DF25B4 |
| rman | % | *AEF345BFE495D8E678EA9D3D5708FD110AD2F08E |
| hmon | % | *993A16D875A9AB1932CC2F57E7DADA76AD35C3B2 |
| hive | cmbigdata1 | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| amon | cmbigdata1 | *4A1243A12C2625553EC0465DD4E640DB056AA07A |
| clouder_manager | %cmbigdata1 | *B2E4B48ED054F1F571DBCCAB3D08912B73FEF2D5 |
| smon | cmbigdata1 | *F65C49868BBCA6D143F5AF81D1864B1C64DF25B4 |
| rman | cmbigdata1 | *AEF345BFE495D8E678EA9D3D5708FD110AD2F08E |
| hmon | cmbigdata1 | *DC736DB1383C5AC16BFE895C856F8D30214AF19A |
| nav | cmbigdata1 | *993A16D875A9AB1932CC2F57E7DADA76AD35C3B2 |
+-----------------+-------------+-------------------------------------------+
18 rows in set (0.00 sec)

mysql>

 

 

 

 

 

　　別忘了oozie

mysql> create database oozie DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.22 sec)

mysql> grant all on *.* TO 'oozie'@'cmbigdata1' IDENTIFIED BY 'oozie_password';
Query OK, 0 rows affected (0.18 sec)

mysql> grant all on oozie.* TO 'oozie'@'%' IDENTIFIED BY 'oozie_password';
Query OK, 0 rows affected (0.04 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.15 sec)

mysql> select user,host,password from mysql.user;
+-----------------+-------------+-------------------------------------------+
| user            | host        | password                                  |
+-----------------+-------------+-------------------------------------------+
| root            | localhost   | *6C362347EBEAA7DF44F6D34884615A35095E80EB |
| root            | cmbigdata1  |                                           |
| root            | 127.0.0.1   |                                           |
|                 | localhost   |                                           |
|                 | cmbigdata1  |                                           |
| hive            | %           | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| clouder_manager | %t          | *B2E4B48ED054F1F571DBCCAB3D08912B73FEF2D5 |
| amon            | %           | *4A1243A12C2625553EC0465DD4E640DB056AA07A |
| smon            | %           | *F65C49868BBCA6D143F5AF81D1864B1C64DF25B4 |
| rman            | %           | *AEF345BFE495D8E678EA9D3D5708FD110AD2F08E |
| hmon            | %           | *993A16D875A9AB1932CC2F57E7DADA76AD35C3B2 |
| hive            | cmbigdata1  | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| amon            | cmbigdata1  | *4A1243A12C2625553EC0465DD4E640DB056AA07A |
| clouder_manager | %cmbigdata1 | *B2E4B48ED054F1F571DBCCAB3D08912B73FEF2D5 |
| smon            | cmbigdata1  | *F65C49868BBCA6D143F5AF81D1864B1C64DF25B4 |
| rman            | cmbigdata1  | *AEF345BFE495D8E678EA9D3D5708FD110AD2F08E |
| hmon            | cmbigdata1  | *DC736DB1383C5AC16BFE895C856F8D30214AF19A |
| nav             | cmbigdata1  | *993A16D875A9AB1932CC2F57E7DADA76AD35C3B2 |
| oozie           | cmbigdata1  | *81A1BB46F79EBD0AA76E6EFAA31D62458CFCAF62 |
| oozie           | %           | *81A1BB46F79EBD0AA76E6EFAA31D62458CFCAF62 |
+-----------------+-------------+-------------------------------------------+
20 rows in set (0.15 sec)

mysql> 

 

 

 

 

 

 

　　下面，這里，是可以以后再更改的。

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

　　說白了，這里是啟動的總界面，但是呢，我們若這里沒啟動成功，沒關系，可以在后面，單獨來啟動！（具體如下的詳細步驟）

http://cmbigdata1:7180/cmf/clusters/2/express-add-services/index#step=commandDetailsStep

 

 

 

 　　遇到這個問題

正在啟動 Key-Value Store Indexer 服務

Failed to execute command Start on service Key-Value Store Indexer

 

 

 

 

 　　啟動與停止Key-Value Store Indexer

 

 

 

 　　

 

　　通過，這樣，也是可以達到目的的。對於這個問題，以后再來解決！

 

 

 

 

 

 

 

 

 啟動與停止Oozie和相關配置

 　　對於這里，安裝出現這個問題，無法解決，后面繼續不了 。其實，不然，（可以單獨解決）

 

 

 

 

 

　　通過，這樣，也是可以達到目的的。

 　　

 

 

 

 

 

 

 

 

 

 

 

 　　啟動與停止Hue，並相關配置

 

 

 

 

 

 

 

 

 

 

 

　　啟動與停止Cloudera Management Service，並相關配置

 

 

 

 

 

 

 

 

 

 

 

http://cmbigdata1:7180/cmf/home

 

 

 

 

 

 

 

 

 

 

　　關於安裝kafka，見

CDH集成Kafka

 

 

參考

http://www.doc88.com/p-0042075356791.html