- 3.1 解壓GI的安裝包
- 3.2 安裝配置Xmanager軟件
- 3.3 共享存儲LUN的賦權
- 3.4 使用Xmanager圖形化界面配置GI
- 3.5 驗證crsctl的狀態
- 3.6 測試集群的FAILED OVER功能
Linux平台 Oracle 18c RAC安裝指導：
Part1：Linux平台 Oracle 18c RAC安裝Part1：准備工作
Part2：Linux平台 Oracle 18c RAC安裝Part2：GI配置
Part3：Linux平台 Oracle 18c RAC安裝Part3：DB配置
本文安裝環境：OEL 7.5 + Oracle 18.3 GI & RAC
三、GI(Grid Infrastructure)安裝
3.1 解壓GI的安裝包
su - grid 解壓 GRID 到 GRID用戶的$ORACLE_HOME下[grid@db40 grid]$ pwd
/u01/app/18.3.0/grid
[grid@db40 grid]$ unzip /tmp/LINUX.X64_180000_grid_home.zip
3.2 安裝配置Xmanager軟件
在自己的Windows系統上成功安裝Xmanager Enterprise之后，運行Xstart.exe可執行程序， 配置如下Session：db40
Host：192.168.1.40
Protocol：SSH
User Name：grid
Execution Command：/usr/bin/xterm -ls -display $DISPLAY
點擊RUN，輸入grid用戶的密碼可以正常彈出命令窗口界面，即配置成功。
當然也可以通過開啟Xmanager - Passive，直接在SecureCRT連接的會話窗口中臨時配置DISPLAY變量直接調用圖形：
export DISPLAY=192.168.1.31:0.0
3.3 共享存儲LUN的賦權
vi /etc/udev/rules.d/12-dm-permissions.rules# MULTIPATH DEVICES
#
# Set permissions for all multipath devices
ENV{DM_UUID}=="mpath-?*", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
配置重載生效：
# udevadm control --reload
# udevadm trigger
3.4 使用Xmanager圖形化界面配置GI
Xmanager通過grid用戶登錄，進入$ORACLE_HOME目錄，運行gridSetup配置GI$ cd $ORACLE_HOME
$ ./gridSetup.sh
其實從12cR2開始，GI的配置就跟之前有一些變化，18c也一樣，下面來看下GI配置的整個圖形化安裝的過程截圖：
注：這里Public網卡這里用的enp0s3，ASM&Private這里用的enp0s8，enp0s9和enp0s10是模擬IPSAN用到的網卡，所以這里不使用它們。
注：這里跟之前區別不大，我依然是選擇3塊1G的盤，Normal冗余作為OCR和voting disk。
注：這里有一個新的存儲GIMR的，我這里選擇是外部冗余的一個40G大小的盤，這是12c新引入的概念，18c依然如此。
注：這里檢查出來的問題都需要認真核對，確認確實可以忽略才可以點擊“Ignore All”，如果這里檢測出缺少某些RPM包，需要使用yum安裝好。
注：執行root腳本，確保先在一節點執行完畢后，再在其他節點執行。
第一個節點root執行腳本：
[root@db40 tmp]# /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.
Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.
[root@db40 tmp]# /u01/app/18.3.0/grid/root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /u01/app/18.3.0/grid
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/18.3.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
/u01/app/grid/crsdata/db40/crsconfig/rootcrs_db40_2018-08-04_10-25-09AM.log
2018/08/04 10:25:34 CLSRSC-594: Executing installation step 1 of 20: 'SetupTFA'.
2018/08/04 10:25:35 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.
2018/08/04 10:26:29 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2018/08/04 10:26:29 CLSRSC-594: Executing installation step 2 of 20: 'ValidateEnv'.
2018/08/04 10:26:29 CLSRSC-363: User ignored prerequisites during installation
2018/08/04 10:26:29 CLSRSC-594: Executing installation step 3 of 20: 'CheckFirstNode'.
2018/08/04 10:26:35 CLSRSC-594: Executing installation step 4 of 20: 'GenSiteGUIDs'.
2018/08/04 10:26:37 CLSRSC-594: Executing installation step 5 of 20: 'SaveParamFile'.
2018/08/04 10:26:53 CLSRSC-594: Executing installation step 6 of 20: 'SetupOSD'.
2018/08/04 10:26:53 CLSRSC-594: Executing installation step 7 of 20: 'CheckCRSConfig'.
2018/08/04 10:26:53 CLSRSC-594: Executing installation step 8 of 20: 'SetupLocalGPNP'.
2018/08/04 10:27:47 CLSRSC-594: Executing installation step 9 of 20: 'CreateRootCert'.
2018/08/04 10:27:54 CLSRSC-594: Executing installation step 10 of 20: 'ConfigOLR'.
2018/08/04 10:28:09 CLSRSC-594: Executing installation step 11 of 20: 'ConfigCHMOS'.
2018/08/04 10:28:10 CLSRSC-594: Executing installation step 12 of 20: 'CreateOHASD'.
2018/08/04 10:28:21 CLSRSC-594: Executing installation step 13 of 20: 'ConfigOHASD'.
2018/08/04 10:28:21 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2018/08/04 10:30:29 CLSRSC-594: Executing installation step 14 of 20: 'InstallAFD'.
2018/08/04 10:30:43 CLSRSC-594: Executing installation step 15 of 20: 'InstallACFS'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'db40'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'db40' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
2018/08/04 10:32:34 CLSRSC-594: Executing installation step 16 of 20: 'InstallKA'.
2018/08/04 10:32:47 CLSRSC-594: Executing installation step 17 of 20: 'InitConfig'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'db40'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'db40' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.evmd' on 'db40'
CRS-2672: Attempting to start 'ora.mdnsd' on 'db40'
CRS-2676: Start of 'ora.mdnsd' on 'db40' succeeded
CRS-2676: Start of 'ora.evmd' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'db40'
CRS-2676: Start of 'ora.gpnpd' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'db40'
CRS-2672: Attempting to start 'ora.gipcd' on 'db40'
CRS-2676: Start of 'ora.cssdmonitor' on 'db40' succeeded
CRS-2676: Start of 'ora.gipcd' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'db40'
CRS-2672: Attempting to start 'ora.diskmon' on 'db40'
CRS-2676: Start of 'ora.diskmon' on 'db40' succeeded
CRS-2676: Start of 'ora.cssd' on 'db40' succeeded
[INFO] [DBT-30001] Disk groups created successfully. Check /u01/app/grid/cfgtoollogs/asmca/asmca-180804AM103332.log for details.
2018/08/04 10:37:38 CLSRSC-482: Running command: '/u01/app/18.3.0/grid/bin/ocrconfig -upgrade grid oinstall'
CRS-2672: Attempting to start 'ora.crf' on 'db40'
CRS-2672: Attempting to start 'ora.storage' on 'db40'
CRS-2676: Start of 'ora.storage' on 'db40' succeeded
CRS-2676: Start of 'ora.crf' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'db40'
CRS-2676: Start of 'ora.crsd' on 'db40' succeeded
CRS-4256: Updating the profile
Successful addition of voting disk e234d69db62c4f41bff377eec5bed671.
Successful addition of voting disk eb9d2950a5aa4f4cbfa46432f7c4f709.
Successful addition of voting disk 84c44e2025be4fe3bf7d5a7a4049d4fd.
Successfully replaced voting disk group with +OCRVT.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE e234d69db62c4f41bff377eec5bed671 (/dev/mapper/mpatha) [OCRVT]
2. ONLINE eb9d2950a5aa4f4cbfa46432f7c4f709 (/dev/mapper/mpathb) [OCRVT]
3. ONLINE 84c44e2025be4fe3bf7d5a7a4049d4fd (/dev/mapper/mpathc) [OCRVT]
Located 3 voting disk(s).
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'db40'
CRS-2673: Attempting to stop 'ora.crsd' on 'db40'
CRS-2677: Stop of 'ora.crsd' on 'db40' succeeded
CRS-2673: Attempting to stop 'ora.storage' on 'db40'
CRS-2673: Attempting to stop 'ora.crf' on 'db40'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'db40'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'db40'
CRS-2677: Stop of 'ora.crf' on 'db40' succeeded
CRS-2677: Stop of 'ora.storage' on 'db40' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'db40'
CRS-2677: Stop of 'ora.drivers.acfs' on 'db40' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'db40' succeeded
CRS-2677: Stop of 'ora.asm' on 'db40' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'db40'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'db40' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'db40'
CRS-2673: Attempting to stop 'ora.evmd' on 'db40'
CRS-2677: Stop of 'ora.evmd' on 'db40' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'db40' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'db40'
CRS-2677: Stop of 'ora.cssd' on 'db40' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'db40'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'db40'
CRS-2677: Stop of 'ora.gipcd' on 'db40' succeeded
CRS-2677: Stop of 'ora.gpnpd' on 'db40' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'db40' has completed
CRS-4133: Oracle High Availability Services has been stopped.
2018/08/04 10:42:19 CLSRSC-594: Executing installation step 18 of 20: 'StartCluster'.
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.evmd' on 'db40'
CRS-2672: Attempting to start 'ora.mdnsd' on 'db40'
CRS-2676: Start of 'ora.mdnsd' on 'db40' succeeded
CRS-2676: Start of 'ora.evmd' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'db40'
CRS-2676: Start of 'ora.gpnpd' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'db40'
CRS-2676: Start of 'ora.gipcd' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'db40'
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'db40'
CRS-2676: Start of 'ora.cssdmonitor' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'db40'
CRS-2672: Attempting to start 'ora.diskmon' on 'db40'
CRS-2676: Start of 'ora.diskmon' on 'db40' succeeded
CRS-2676: Start of 'ora.crf' on 'db40' succeeded
CRS-2676: Start of 'ora.cssd' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'db40'
CRS-2672: Attempting to start 'ora.ctssd' on 'db40'
CRS-2676: Start of 'ora.ctssd' on 'db40' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'db40'
CRS-2676: Start of 'ora.asm' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'db40'
CRS-2676: Start of 'ora.storage' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'db40'
CRS-2676: Start of 'ora.crsd' on 'db40' succeeded
CRS-6023: Starting Oracle Cluster Ready Services-managed resources
CRS-6017: Processing resource auto-start for servers: db40
CRS-6016: Resource auto-start has completed for server db40
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
2018/08/04 10:45:28 CLSRSC-343: Successfully started Oracle Clusterware stack
2018/08/04 10:45:28 CLSRSC-594: Executing installation step 19 of 20: 'ConfigNode'.
CRS-2672: Attempting to start 'ora.ASMNET1LSNR_ASM.lsnr' on 'db40'
CRS-2676: Start of 'ora.ASMNET1LSNR_ASM.lsnr' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'db40'
CRS-2676: Start of 'ora.asm' on 'db40' succeeded
CRS-2672: Attempting to start 'ora.OCRVT.dg' on 'db40'
CRS-2676: Start of 'ora.OCRVT.dg' on 'db40' succeeded
2018/08/04 10:49:35 CLSRSC-594: Executing installation step 20 of 20: 'PostConfig'.
[INFO] [DBT-30001] Disk groups created successfully. Check /u01/app/grid/cfgtoollogs/asmca/asmca-180804AM104944.log for details.
2018/08/04 10:55:24 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
執行成功后，在第二個節點root執行腳本：
[root@db42 app]# /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.
Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.
[root@db42 app]# /u01/app/18.3.0/grid/root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /u01/app/18.3.0/grid
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/18.3.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
/u01/app/grid/crsdata/db42/crsconfig/rootcrs_db42_2018-08-04_11-09-32AM.log
2018/08/04 11:09:50 CLSRSC-594: Executing installation step 1 of 20: 'SetupTFA'.
2018/08/04 11:09:50 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.
2018/08/04 11:10:38 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2018/08/04 11:10:38 CLSRSC-594: Executing installation step 2 of 20: 'ValidateEnv'.
2018/08/04 11:10:38 CLSRSC-363: User ignored prerequisites during installation
2018/08/04 11:10:39 CLSRSC-594: Executing installation step 3 of 20: 'CheckFirstNode'.
2018/08/04 11:10:41 CLSRSC-594: Executing installation step 4 of 20: 'GenSiteGUIDs'.
2018/08/04 11:10:42 CLSRSC-594: Executing installation step 5 of 20: 'SaveParamFile'.
2018/08/04 11:10:48 CLSRSC-594: Executing installation step 6 of 20: 'SetupOSD'.
2018/08/04 11:10:48 CLSRSC-594: Executing installation step 7 of 20: 'CheckCRSConfig'.
2018/08/04 11:10:49 CLSRSC-594: Executing installation step 8 of 20: 'SetupLocalGPNP'.
2018/08/04 11:10:52 CLSRSC-594: Executing installation step 9 of 20: 'CreateRootCert'.
2018/08/04 11:10:52 CLSRSC-594: Executing installation step 10 of 20: 'ConfigOLR'.
2018/08/04 11:10:58 CLSRSC-594: Executing installation step 11 of 20: 'ConfigCHMOS'.
2018/08/04 11:10:58 CLSRSC-594: Executing installation step 12 of 20: 'CreateOHASD'.
2018/08/04 11:11:01 CLSRSC-594: Executing installation step 13 of 20: 'ConfigOHASD'.
2018/08/04 11:11:02 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2018/08/04 11:13:06 CLSRSC-594: Executing installation step 14 of 20: 'InstallAFD'.
2018/08/04 11:13:10 CLSRSC-594: Executing installation step 15 of 20: 'InstallACFS'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'db42'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'db42' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
2018/08/04 11:14:48 CLSRSC-594: Executing installation step 16 of 20: 'InstallKA'.
2018/08/04 11:14:50 CLSRSC-594: Executing installation step 17 of 20: 'InitConfig'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'db42'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'db42' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'db42'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'db42'
CRS-2677: Stop of 'ora.drivers.acfs' on 'db42' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'db42' has completed
CRS-4133: Oracle High Availability Services has been stopped.
2018/08/04 11:15:18 CLSRSC-594: Executing installation step 18 of 20: 'StartCluster'.
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.evmd' on 'db42'
CRS-2672: Attempting to start 'ora.mdnsd' on 'db42'
CRS-2676: Start of 'ora.evmd' on 'db42' succeeded
CRS-2676: Start of 'ora.mdnsd' on 'db42' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'db42'
CRS-2676: Start of 'ora.gpnpd' on 'db42' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'db42'
CRS-2676: Start of 'ora.gipcd' on 'db42' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'db42'
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'db42'
CRS-2676: Start of 'ora.crf' on 'db42' succeeded
CRS-2676: Start of 'ora.cssdmonitor' on 'db42' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'db42'
CRS-2672: Attempting to start 'ora.diskmon' on 'db42'
CRS-2676: Start of 'ora.diskmon' on 'db42' succeeded
CRS-2676: Start of 'ora.cssd' on 'db42' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'db42'
CRS-2672: Attempting to start 'ora.ctssd' on 'db42'
CRS-2676: Start of 'ora.ctssd' on 'db42' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'db42'
CRS-2676: Start of 'ora.crsd' on 'db42' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'db42' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'db42'
CRS-2676: Start of 'ora.asm' on 'db42' succeeded
CRS-6017: Processing resource auto-start for servers: db42
CRS-2672: Attempting to start 'ora.ASMNET1LSNR_ASM.lsnr' on 'db42'
CRS-2672: Attempting to start 'ora.ons' on 'db42'
CRS-2676: Start of 'ora.ASMNET1LSNR_ASM.lsnr' on 'db42' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'db42'
CRS-2676: Start of 'ora.ons' on 'db42' succeeded
CRS-2676: Start of 'ora.asm' on 'db42' succeeded
CRS-2672: Attempting to start 'ora.proxy_advm' on 'db40'
CRS-2672: Attempting to start 'ora.proxy_advm' on 'db42'
CRS-2676: Start of 'ora.proxy_advm' on 'db40' succeeded
CRS-2676: Start of 'ora.proxy_advm' on 'db42' succeeded
CRS-6016: Resource auto-start has completed for server db42
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
2018/08/04 11:21:10 CLSRSC-343: Successfully started Oracle Clusterware stack
2018/08/04 11:21:11 CLSRSC-594: Executing installation step 19 of 20: 'ConfigNode'.
2018/08/04 11:21:52 CLSRSC-594: Executing installation step 20 of 20: 'PostConfig'.
2018/08/04 11:22:06 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
root腳本成功執行完后繼續安裝:
這段時間也很漫長，看來Oracle集群軟件是越來越龐大了，老DBA們此時此刻有沒有懷念11g甚至10g的時代呢？
安裝過程中可以跟蹤安裝日志：
tail -20f /tmp/GridSetupActions2018-08-03_11-27-06PM/gridSetupActions2018-08-03_11-27-06PM.log
注：日志中可以看到有一個階段starting read loop消耗了1個多小時才進入到下個階段，這很可能是有異常導致時間過長，但即使排除這個異常時間段依然還有將近2小時的時間。
INFO: [Aug 4, 2018 2:04:42 PM] ... GenericInternalPlugIn: starting read loop.
INFO: [Aug 4, 2018 3:25:37 PM] Completed Plugin named: mgmtca
注：最后這個報錯提示，查看日志發現是因為使用了一個scan ip的提示，可以忽略。
至此GI配置完成。
3.5 驗證crsctl的狀態
crsctl stat res -t查看集群資源狀態信息，看到18c又新出現一些資源了，看來DBA又有新東西需要學習了~[grid@db40 grid]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
ONLINE ONLINE db40 STABLE
ONLINE ONLINE db42 STABLE
ora.LISTENER.lsnr
ONLINE ONLINE db40 STABLE
ONLINE ONLINE db42 STABLE
ora.MGMT.GHCHKPT.advm
OFFLINE OFFLINE db40 STABLE
OFFLINE OFFLINE db42 STABLE
ora.MGMT.dg
ONLINE ONLINE db40 STABLE
ONLINE ONLINE db42 STABLE
ora.OCRVT.dg
ONLINE ONLINE db40 STABLE
ONLINE ONLINE db42 STABLE
ora.chad
ONLINE ONLINE db40 STABLE
ONLINE ONLINE db42 STABLE
ora.helper
OFFLINE OFFLINE db40 STABLE
OFFLINE OFFLINE db42 IDLE,STABLE
ora.mgmt.ghchkpt.acfs
OFFLINE OFFLINE db40 volume /opt/oracle/r
hp_images/chkbase is
unmounted,STABLE
OFFLINE OFFLINE db42 STABLE
ora.net1.network
ONLINE ONLINE db40 STABLE
ONLINE ONLINE db42 STABLE
ora.ons
ONLINE ONLINE db40 STABLE
ONLINE ONLINE db42 STABLE
ora.proxy_advm
ONLINE ONLINE db40 STABLE
ONLINE ONLINE db42 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE db40 STABLE
ora.MGMTLSNR
1 ONLINE ONLINE db40 169.254.7.255 10.0.0
.40,STABLE
ora.asm
1 ONLINE ONLINE db40 Started,STABLE
2 ONLINE ONLINE db42 Started,STABLE
3 OFFLINE OFFLINE STABLE
ora.cvu
1 ONLINE ONLINE db40 STABLE
ora.db40.vip
1 ONLINE ONLINE db40 STABLE
ora.db42.vip
1 ONLINE ONLINE db42 STABLE
ora.mgmtdb
1 ONLINE ONLINE db40 Open,STABLE
ora.qosmserver
1 ONLINE ONLINE db40 STABLE
ora.rhpserver
1 OFFLINE OFFLINE STABLE
ora.scan1.vip
1 ONLINE ONLINE db40 STABLE
--------------------------------------------------------------------------------
crsctl stat res -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE db40 Started,STABLE
ora.cluster_interconnect.haip
1 ONLINE ONLINE db40 STABLE
ora.crf
1 ONLINE ONLINE db40 STABLE
ora.crsd
1 ONLINE ONLINE db40 STABLE
ora.cssd
1 ONLINE ONLINE db40 STABLE
ora.cssdmonitor
1 ONLINE ONLINE db40 STABLE
ora.ctssd
1 ONLINE ONLINE db40 ACTIVE:0,STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.drivers.acfs
1 ONLINE ONLINE db40 STABLE
ora.evmd
1 ONLINE ONLINE db40 STABLE
ora.gipcd
1 ONLINE ONLINE db40 STABLE
ora.gpnpd
1 ONLINE ONLINE db40 STABLE
ora.mdnsd
1 ONLINE ONLINE db40 STABLE
ora.storage
1 ONLINE ONLINE db40 STABLE
--------------------------------------------------------------------------------
3.6 測試集群的FAILED OVER功能
節點2被重啟，查看節點1狀態：[grid@db40 trace]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
ONLINE ONLINE db40 STABLE
ora.LISTENER.lsnr
ONLINE ONLINE db40 STABLE
ora.MGMT.GHCHKPT.advm
OFFLINE OFFLINE db40 STABLE
ora.MGMT.dg
ONLINE ONLINE db40 STABLE
ora.OCRVT.dg
ONLINE ONLINE db40 STABLE
ora.chad
ONLINE ONLINE db40 STABLE
ora.helper
OFFLINE OFFLINE db40 STABLE
ora.mgmt.ghchkpt.acfs
OFFLINE OFFLINE db40 volume /opt/oracle/r
hp_images/chkbase is
unmounted,STABLE
ora.net1.network
ONLINE ONLINE db40 STABLE
ora.ons
ONLINE ONLINE db40 STABLE
ora.proxy_advm
ONLINE ONLINE db40 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE db40 STABLE
ora.MGMTLSNR
1 ONLINE ONLINE db40 169.254.7.255 10.0.0
.40,STABLE
ora.asm
1 ONLINE ONLINE db40 Started,STABLE
2 ONLINE OFFLINE STABLE
3 OFFLINE OFFLINE STABLE
ora.cvu
1 ONLINE ONLINE db40 STABLE
ora.db40.vip
1 ONLINE ONLINE db40 STABLE
ora.db42.vip
1 ONLINE INTERMEDIATE db40 FAILED OVER,STABLE
ora.mgmtdb
1 ONLINE ONLINE db40 Open,STABLE
ora.qosmserver
1 ONLINE ONLINE db40 STABLE
ora.rhpserver
1 OFFLINE OFFLINE STABLE
ora.scan1.vip
1 ONLINE ONLINE db40 STABLE
--------------------------------------------------------------------------------
節點1被重啟，查看節點2狀態：
[grid@db42 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
ONLINE ONLINE db42 STABLE
ora.LISTENER.lsnr
ONLINE ONLINE db42 STABLE
ora.MGMT.GHCHKPT.advm
OFFLINE OFFLINE db42 STABLE
ora.MGMT.dg
ONLINE INTERMEDIATE db42 STABLE
ora.OCRVT.dg
ONLINE INTERMEDIATE db42 STABLE
ora.chad
ONLINE ONLINE db42 STABLE
ora.helper
OFFLINE OFFLINE db42 STABLE
ora.mgmt.ghchkpt.acfs
OFFLINE OFFLINE db42 STABLE
ora.net1.network
ONLINE ONLINE db42 STABLE
ora.ons
ONLINE ONLINE db42 STABLE
ora.proxy_advm
ONLINE ONLINE db42 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE db42 STABLE
ora.MGMTLSNR
1 ONLINE ONLINE db42 169.254.7.154 10.0.0
.42,STABLE
ora.asm
1 ONLINE OFFLINE STABLE
2 ONLINE ONLINE db42 Started,STABLE
3 OFFLINE OFFLINE STABLE
ora.cvu
1 ONLINE ONLINE db42 STABLE
ora.db40.vip
1 ONLINE INTERMEDIATE db42 FAILED OVER,STABLE
ora.db42.vip
1 ONLINE ONLINE db42 STABLE
ora.mgmtdb
1 ONLINE ONLINE db42 Open,STABLE
ora.qosmserver
1 ONLINE ONLINE db42 STABLE
ora.rhpserver
1 OFFLINE OFFLINE STABLE
ora.scan1.vip
1 ONLINE ONLINE db42 STABLE
--------------------------------------------------------------------------------
附：集群日志位置：
[grid@db40 log]$ cd $ORACLE_BASE/diag/crs/db40/crs/trace
[grid@db40 trace]$ pwd
/u01/app/grid/diag/crs/db40/crs/trace
[grid@db40 trace]$ tail -5f ocssd.trc
2018-08-04 17:35:16.507 : CSSD:758277888: clssgmMbrDataUpdt: Sending member data change to GMP for group HB+ASM, memberID 17:2:1
2018-08-04 17:35:16.509 : CSSD:770635520: clssgmpcMemberDataUpdt: grockName HB+ASM memberID 17:2:1, datatype 1 datasize 4
2018-08-04 17:35:16.514 : CSSD:755123968: clssgmcpDataUpdtCmpl: Status 0 mbr data updt memberID 17:2:1 from clientID 1:39:2
2018-08-04 17:35:17.319 : CSSD:3337582336: clssnmSendingThread: sending status msg to all nodes
2018-08-04 17:35:17.321 : CSSD:3337582336: clssnmSendingThread: sent 4 status msgs to all nodes
2018-08-04 17:35:17.793 : CSSD:762750720: clssgmpcGMCReqWorkerThread: processing msg (0x7f2914038720) type 2, msg size 76, payload (0x7f291403874c) size 32, sequence 27970, for clientID 1:39:2
2018-08-04 17:35:18.424 : CSSD:758277888: clssgmMbrDataUpdt: Processing member data change type 1, size 4 for group HB+ASM, memberID 17:2:1
2018-08-04 17:35:18.424 : CSSD:758277888: clssgmMbrDataUpdt: Sending member data change to GMP for group HB+ASM, memberID 17:2:1
2018-08-04 17:35:18.425 : CSSD:770635520: clssgmpcMemberDataUpdt: grockName HB+ASM memberID 17:2:1, datatype 1 datasize 4
2018-08-04 17:35:18.427 : CSSD:755123968: clssgmcpDataUpdtCmpl: Status 0 mbr data updt memberID 17:2:1 from clientID 1:39:2
2018-08-04 17:35:19.083 : CSSD:755123968: clssgmSendEventsToMbrs: Group GR+DB_+ASM, member count 1, event master 0, event type 6, event incarn 346, event member count 1, pids 31422-21167708,
2018-08-04 17:35:19.446 : CSSD:762750720: clssgmpcGMCReqWorkerThread: processing msg (0x7f2914038720) type 2, msg size 76, payload (0x7f291403874c) size 32, sequence 27972, for clientID 1:37:2
[grid@db40 trace]$ tail -20f alert.log
Build version: 18.0.0.0.0
Build full version: 18.3.0.0.0
Build hash: 9256567290
Bug numbers: NoTransactionInformation
Commands:
Build version: 18.0.0.0.0
Build full version: 18.3.0.0.0
Build hash: 9256567290
Bug numbers: NoTransactionInformation
2018-08-04 18:02:57.013 [CLSECHO(3376)]ACFS-9327: Verifying ADVM/ACFS devices.
2018-08-04 18:02:57.058 [CLSECHO(3384)]ACFS-9156: Detecting control device '/dev/asm/.asm_ctl_spec'.
2018-08-04 18:02:57.115 [CLSECHO(3395)]ACFS-9156: Detecting control device '/dev/ofsctl'.
2018-08-04 18:02:58.991 [CLSECHO(3482)]ACFS-9294: updating file /etc/sysconfig/oracledrivers.conf
2018-08-04 18:02:59.032 [CLSECHO(3490)]ACFS-9322: completed
2018-08-04 18:03:00.398 [OSYSMOND(3571)]CRS-8500: Oracle Clusterware OSYSMOND process is starting with operating system process ID 3571
2018-08-04 18:03:00.324 [CSSDMONITOR(3567)]CRS-8500: Oracle Clusterware CSSDMONITOR process is starting with operating system process ID 3567
2018-08-04 18:03:00.796 [CSSDAGENT(3598)]CRS-8500: Oracle Clusterware CSSDAGENT process is starting with operating system process ID 3598
2018-08-04 18:03:01.461 [OCSSD(3621)]CRS-8500: Oracle Clusterware OCSSD process is starting with operating system process ID 3621
2018-08-04 18:03:03.374 [OCSSD(3621)]CRS-1713: CSSD daemon is started in hub mode
2018-08-04 18:03:23.052 [OCSSD(3621)]CRS-1707: Lease acquisition for node db40 number 1 completed
2018-08-04 18:03:29.122 [OCSSD(3621)]CRS-1605: CSSD voting file is online: /dev/mapper/mpathc; details in /u01/app/grid/diag/crs/db40/crs/trace/ocssd.trc.
2018-08-04 18:03:29.150 [OCSSD(3621)]CRS-1605: CSSD voting file is online: /dev/mapper/mpathb; details in /u01/app/grid/diag/crs/db40/crs/trace/ocssd.trc.
2018-08-04 18:03:31.087 [OCSSD(3621)]CRS-1605: CSSD voting file is online: /dev/mapper/mpatha; details in /u01/app/grid/diag/crs/db40/crs/trace/ocssd.trc.
2018-08-04 18:03:33.767 [OCSSD(3621)]CRS-1601: CSSD Reconfiguration complete. Active nodes are db40 db42 .
2018-08-04 18:03:35.311 [OLOGGERD(3862)]CRS-8500: Oracle Clusterware OLOGGERD process is starting with operating system process ID 3862
2018-08-04 18:03:35.833 [OCTSSD(3869)]CRS-8500: Oracle Clusterware OCTSSD process is starting with operating system process ID 3869
2018-08-04 18:03:36.055 [OCSSD(3621)]CRS-1720: Cluster Synchronization Services daemon (CSSD) is ready for operation.
2018-08-04 18:03:39.797 [OCTSSD(3869)]CRS-2407: The new Cluster Time Synchronization Service reference node is host db42.
2018-08-04 18:03:39.810 [OCTSSD(3869)]CRS-2401: The Cluster Time Synchronization Service started on host db40.
2018-08-04 18:03:41.572 [CRSD(3956)]CRS-8500: Oracle Clusterware CRSD process is starting with operating system process ID 3956
2018-08-04 18:03:57.242 [CRSD(3956)]CRS-1012: The OCR service started on node db40.
2018-08-04 18:03:59.550 [CRSD(3956)]CRS-1201: CRSD started on node db40.
至此，12cR2的GI配置已全部完成。