- 3.1 解壓GI的安裝包
- 3.2 安裝配置Xmanager軟件
- 3.3 共享存儲LUN的賦權
- 3.4 使用Xmanager圖形化界面配置GI
- 3.5 驗證crsctl的狀態
- 3.6 測試集群的FAILED OVER功能
Linux平台 Oracle 19c RAC安裝指導：
Part1：Linux平台 Oracle 19c RAC安裝Part1：准備工作
Part2：Linux平台 Oracle 19c RAC安裝Part2：GI配置
Part3：Linux平台 Oracle 19c RAC安裝Part3：DB配置
本文安裝環境：OEL 7.6 + Oracle 19.3 GI & RAC
三、GI(Grid Infrastructure)安裝
3.1 解壓GI的安裝包
su - grid 解壓 GRID 到 GRID用戶的$ORACLE_HOME下[grid@db193 grid]$ pwd
/u01/app/19.3.0/grid
[grid@db193 grid]$ unzip /u01/media/LINUX.X64_193000_grid_home.zip
3.2 安裝配置Xmanager軟件
在自己的Windows系統上成功安裝Xmanager Enterprise之后，運行Xstart.exe可執行程序， 配置如下Session：db193
Host：192.168.1.193
Protocol：SSH
User Name：grid
Execution Command：/usr/bin/xterm -ls -display $DISPLAY
點擊RUN，輸入grid用戶的密碼可以正常彈出命令窗口界面，即配置成功。
當然也可以通過開啟Xmanager - Passive，直接在SecureCRT連接的會話窗口中臨時配置DISPLAY變量直接調用圖形：
export DISPLAY=192.168.1.31:0.0
3.3 共享存儲LUN的賦權
在《[Linux平台 Oracle 19c RAC安裝Part1：准備工作 -> 1.3 共享存儲規划](https://www.cnblogs.com/jyzhao/p/11273271.html#1.3)》中已完成綁定和權限，這里不需要再次操作。--只需確認兩個節點鏈接文件(/dev/asm*)對應的sd[b-g]2的權限正確即可：
# ls -l /dev/sd?2
brw-rw---- 1 root disk 8, 2 Jul 31 09:13 /dev/sda2
brw-rw---- 1 grid asmadmin 8, 18 Jul 31 18:06 /dev/sdb2
brw-rw---- 1 grid asmadmin 8, 34 Jul 31 18:06 /dev/sdc2
brw-rw---- 1 grid asmadmin 8, 50 Jul 31 18:06 /dev/sdd2
brw-rw---- 1 grid asmadmin 8, 66 Jul 31 17:10 /dev/sde2
brw-rw---- 1 grid asmadmin 8, 82 Jul 31 17:10 /dev/sdf2
brw-rw---- 1 grid asmadmin 8, 98 Jul 31 17:10 /dev/sdg2
3.4 使用Xmanager圖形化界面配置GI
Xmanager通過grid用戶登錄，進入$ORACLE_HOME目錄，運行gridSetup配置GI$ cd $ORACLE_HOME
$ ./gridSetup.sh
其實從12cR2開始，GI的配置就跟之前有一些變化，19c也一樣，下面來看下GI配置的整個圖形化安裝的過程截圖：
注：這里Public網卡這里用的enp0s3，ASM&Private這里用的enp0s8。
注：這里有一個新的存儲GIMR的，之前12c、18c版本都是選擇是外部冗余的一個40G大小的盤（當初給很多剛接觸安裝12cRAC的DBA造成了不適），而在19c安裝中可以看到默認就是不選擇的，恢復了11g時代的清爽感，這點我個人覺得很贊。
注：這里跟之前區別不大，我依然是選擇3塊1G的盤，Normal冗余作為OCR和voting disk。
注：這里檢查出來的問題都需要認真核對，確認確實可以忽略才可以點擊“Ignore All”，如果這里檢測出缺少某些RPM包，需要使用yum安裝好。我這里是自己的測試環境，分的配置較低，所以有內存和swap檢測不通過，實際生產環境不應出現。
注：執行root腳本，確保先在一節點執行完畢后，再在其他節點執行。
第一個節點root執行腳本：
[root@db193 ~]# /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.
Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.
[root@db193 ~]# /u01/app/19.3.0/grid/root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /u01/app/19.3.0/grid
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/19.3.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
/u01/app/grid/crsdata/db193/crsconfig/rootcrs_db193_2019-07-31_07-27-23AM.log
2019/07/31 07:28:07 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2019/07/31 07:28:08 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2019/07/31 07:28:08 CLSRSC-363: User ignored prerequisites during installation
2019/07/31 07:28:08 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2019/07/31 07:28:17 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2019/07/31 07:28:21 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
2019/07/31 07:28:21 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
2019/07/31 07:28:21 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2019/07/31 07:31:54 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2019/07/31 07:32:24 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2019/07/31 07:32:37 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2019/07/31 07:33:17 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2019/07/31 07:33:18 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2019/07/31 07:33:42 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2019/07/31 07:33:43 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2019/07/31 07:34:48 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2019/07/31 07:35:21 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2019/07/31 07:35:50 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2019/07/31 07:36:14 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
ASM has been created and started successfully.
[DBT-30001] Disk groups created successfully. Check /u01/app/grid/cfgtoollogs/asmca/asmca-190731AM073727.log for details.
2019/07/31 07:40:00 CLSRSC-482: Running command: '/u01/app/19.3.0/grid/bin/ocrconfig -upgrade grid oinstall'
CRS-4256: Updating the profile
Successful addition of voting disk b789e47e76d74f06bf5f8b5cb4d62b88.
Successful addition of voting disk 3bc8119dfafe4fbebf7e1bf11aec8b9a.
Successful addition of voting disk bccdf28694a54ffcbf41354c7e4f133d.
Successfully replaced voting disk group with +CRS.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE b789e47e76d74f06bf5f8b5cb4d62b88 (/dev/asm-ocr1) [CRS]
2. ONLINE 3bc8119dfafe4fbebf7e1bf11aec8b9a (/dev/asm-ocr2) [CRS]
3. ONLINE bccdf28694a54ffcbf41354c7e4f133d (/dev/asm-ocr3) [CRS]
Located 3 voting disk(s).
2019/07/31 07:48:20 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2019/07/31 07:50:48 CLSRSC-343: Successfully started Oracle Clusterware stack
2019/07/31 07:50:49 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
2019/07/31 08:04:16 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2019/07/31 08:08:26 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
[root@db193 ~]#
執行成功后，在第二個節點root執行腳本：
[root@db195 ~]# /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.
Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.
[root@db195 ~]# /u01/app/19.3.0/grid/root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /u01/app/19.3.0/grid
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/19.3.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
/u01/app/grid/crsdata/db195/crsconfig/rootcrs_db195_2019-07-31_08-10-55AM.log
2019/07/31 08:11:34 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2019/07/31 08:11:34 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2019/07/31 08:11:34 CLSRSC-363: User ignored prerequisites during installation
2019/07/31 08:11:34 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2019/07/31 08:11:44 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2019/07/31 08:11:44 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
2019/07/31 08:11:45 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
2019/07/31 08:11:51 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2019/07/31 08:12:03 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2019/07/31 08:12:04 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2019/07/31 08:12:32 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2019/07/31 08:12:33 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2019/07/31 08:12:56 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2019/07/31 08:12:59 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2019/07/31 08:13:59 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2019/07/31 08:14:31 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2019/07/31 08:14:42 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2019/07/31 08:14:51 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2019/07/31 08:14:58 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
2019/07/31 08:15:32 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2019/07/31 08:17:41 CLSRSC-343: Successfully started Oracle Clusterware stack
2019/07/31 08:17:42 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
2019/07/31 08:22:03 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2019/07/31 08:23:05 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
[root@db195 ~]#
這段時間從打印的日志來看，雖然耗時也比以前11g時代長，但實際相比12c的上一個版本18c來說卻縮短了不少。
root腳本成功執行完后繼續安裝:
注：最后這個報錯提示，查看日志發現是因為使用了一個scan ip的提示，可以忽略。
至此GI配置完成。
3.5 驗證crsctl的狀態
crsctl stat res -t查看集群資源狀態信息，看到19c實際相對18c來說，有做很多的精簡，更趨於穩定性因素考慮~[grid@db193 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE db193 STABLE
ONLINE ONLINE db195 STABLE
ora.chad
ONLINE ONLINE db193 STABLE
ONLINE ONLINE db195 STABLE
ora.net1.network
ONLINE ONLINE db193 STABLE
ONLINE ONLINE db195 STABLE
ora.ons
ONLINE ONLINE db193 STABLE
ONLINE ONLINE db195 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE db193 STABLE
2 ONLINE ONLINE db195 STABLE
3 OFFLINE OFFLINE STABLE
ora.CRS.dg(ora.asmgroup)
1 ONLINE ONLINE db193 STABLE
2 ONLINE ONLINE db195 STABLE
3 OFFLINE OFFLINE STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE db193 STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE db193 Started,STABLE
2 ONLINE ONLINE db195 Started,STABLE
3 OFFLINE OFFLINE STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE db193 STABLE
2 ONLINE ONLINE db195 STABLE
3 OFFLINE OFFLINE STABLE
ora.cvu
1 ONLINE ONLINE db193 STABLE
ora.db193.vip
1 ONLINE ONLINE db193 STABLE
ora.db195.vip
1 ONLINE ONLINE db195 STABLE
ora.qosmserver
1 ONLINE ONLINE db193 STABLE
ora.scan1.vip
1 ONLINE ONLINE db193 STABLE
--------------------------------------------------------------------------------
crsctl stat res -t -init
[grid@db193 ~]$ crsctl stat res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE db193 Started,STABLE
ora.cluster_interconnect.haip
1 ONLINE ONLINE db193 STABLE
ora.crf
1 ONLINE ONLINE db193 STABLE
ora.crsd
1 ONLINE ONLINE db193 STABLE
ora.cssd
1 ONLINE ONLINE db193 STABLE
ora.cssdmonitor
1 ONLINE ONLINE db193 STABLE
ora.ctssd
1 ONLINE ONLINE db193 ACTIVE:0,STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.evmd
1 ONLINE ONLINE db193 STABLE
ora.gipcd
1 ONLINE ONLINE db193 STABLE
ora.gpnpd
1 ONLINE ONLINE db193 STABLE
ora.mdnsd
1 ONLINE ONLINE db193 STABLE
ora.storage
1 ONLINE ONLINE db193 STABLE
--------------------------------------------------------------------------------
3.6 測試集群的FAILED OVER功能
節點2被重啟，查看節點1狀態：[grid@db193 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE db193 STABLE
ora.chad
ONLINE ONLINE db193 STABLE
ora.net1.network
ONLINE ONLINE db193 STABLE
ora.ons
ONLINE ONLINE db193 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE db193 STABLE
2 ONLINE OFFLINE STABLE
3 OFFLINE OFFLINE STABLE
ora.CRS.dg(ora.asmgroup)
1 ONLINE ONLINE db193 STABLE
2 ONLINE OFFLINE STABLE
3 OFFLINE OFFLINE STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE db193 STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE db193 Started,STABLE
2 ONLINE OFFLINE STABLE
3 OFFLINE OFFLINE STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE db193 STABLE
2 ONLINE OFFLINE STABLE
3 OFFLINE OFFLINE STABLE
ora.cvu
1 ONLINE ONLINE db193 STABLE
ora.db193.vip
1 ONLINE ONLINE db193 STABLE
ora.db195.vip
1 ONLINE INTERMEDIATE db193 FAILED OVER,STABLE
ora.qosmserver
1 ONLINE ONLINE db193 STABLE
ora.scan1.vip
1 ONLINE ONLINE db193 STABLE
--------------------------------------------------------------------------------
節點1被重啟，查看節點2狀態：
[grid@db195 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE db195 STABLE
ora.chad
ONLINE ONLINE db195 STABLE
ora.net1.network
ONLINE ONLINE db195 STABLE
ora.ons
ONLINE ONLINE db195 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE OFFLINE STABLE
2 ONLINE ONLINE db195 STABLE
3 OFFLINE OFFLINE STABLE
ora.CRS.dg(ora.asmgroup)
1 ONLINE OFFLINE STABLE
2 ONLINE ONLINE db195 STABLE
3 OFFLINE OFFLINE STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE db195 STABLE
ora.asm(ora.asmgroup)
1 ONLINE OFFLINE STABLE
2 ONLINE ONLINE db195 Started,STABLE
3 OFFLINE OFFLINE STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE OFFLINE STABLE
2 ONLINE ONLINE db195 STABLE
3 OFFLINE OFFLINE STABLE
ora.cvu
1 ONLINE ONLINE db195 STABLE
ora.db193.vip
1 ONLINE INTERMEDIATE db195 FAILED OVER,STABLE
ora.db195.vip
1 ONLINE ONLINE db195 STABLE
ora.qosmserver
1 ONLINE ONLINE db195 STABLE
ora.scan1.vip
1 ONLINE ONLINE db195 STABLE
--------------------------------------------------------------------------------
附：集群日志位置：
--如果忘記，可以使用adrci查看日志位置
[grid@db195 trace]$ pwd
/u01/app/grid/diag/crs/db195/crs/trace
[grid@db195 trace]$ tail -20f alert.log
2019-07-31 09:13:53.813 [CRSD(9156)]CRS-8500: Oracle Clusterware CRSD process is starting with operating system process ID 9156
2019-07-31 09:14:05.943 [CRSD(9156)]CRS-1012: The OCR service started on node db195.
2019-07-31 09:14:06.585 [CRSD(9156)]CRS-1201: CRSD started on node db195.
2019-07-31 09:14:15.787 [ORAAGENT(9824)]CRS-8500: Oracle Clusterware ORAAGENT process is starting with operating system process ID 9824
2019-07-31 09:14:16.576 [ORAROOTAGENT(9856)]CRS-8500: Oracle Clusterware ORAROOTAGENT process is starting with operating system process ID 9856
2019-07-31 09:14:28.516 [ORAAGENT(10272)]CRS-8500: Oracle Clusterware ORAAGENT process is starting with operating system process ID 10272
2019-07-31 09:21:07.409 [OCTSSD(8378)]CRS-2407: The new Cluster Time Synchronization Service reference node is host db195.
2019-07-31 09:21:10.569 [OCSSD(7062)]CRS-1625: Node db193, number 1, was shut down
2019-07-31 09:21:10.948 [OCSSD(7062)]CRS-1601: CSSD Reconfiguration complete. Active nodes are db195 .
2019-07-31 09:21:11.055 [CRSD(9156)]CRS-5504: Node down event reported for node 'db193'.
2019-07-31 09:21:11.292 [CRSD(9156)]CRS-2773: Server 'db193' has been removed from pool 'Free'.
2019-07-31 09:22:25.944 [OLOGGERD(21377)]CRS-8500: Oracle Clusterware OLOGGERD process is starting with operating system process ID 21377
2019-07-31 09:23:41.207 [OCSSD(7062)]CRS-1601: CSSD Reconfiguration complete. Active nodes are db193 db195 .
[grid@db195 trace]$ tail -5f ocssd.trc
2019-07-31 09:35:40.732 : CSSD:527664896: [ INFO] clssgmDiscEndpcl: initiating gipcDestroy 0x27553
2019-07-31 09:35:40.732 : CSSD:527664896: [ INFO] clssgmDiscEndpcl: completed gipcDestroy 0x27553
2019-07-31 09:35:42.136 : CSSD:527664896: [ INFO] : Processing member data change type 1, size 4 for group HB+ASM, memberID 17:2:2
2019-07-31 09:35:42.136 : CSSD:527664896: [ INFO] : Sending member data change to GMP for group HB+ASM, memberID 17:2:2
2019-07-31 09:35:42.138 : CSSD:1010091776: [ INFO] clssgmpcMemberDataUpdt: grockName HB+ASM memberID 17:2:2, datatype 1 datasize 4
至此，19c的GI配置已全部完成。