假設我們的RAC環境中OCR磁盤和votedisk磁盤全部被破壞，並且都沒有備份，那么我們該如何恢復我們的RAC環境。
最近簡單的辦法就是重新初始化我們的ocr盤和votedisk盤，把集群中的所有相關資源重新注冊到OCR磁盤和votedisk磁盤中。
1.停掉所有節點的Clusterware Stack
[root@rac3 bin]# ./crsctl stop crs Stopping resources. Successfully stopped CRS resources Stopping CSSD. Shutting down CSS daemon. Shutdown request successfully issued. [root@rac4 bin]# ./crsctl stop crs Stopping resources. Successfully stopped CRS resources Stopping CSSD. Shutting down CSS daemon. Shutdown request successfully issued.
2.為安全期間，我們先備份一下ocr和votedisk
為防止我們的實驗失敗，我們先備份一下ocr盤和votedisk盤。
當然，在正式的RAC環境中是不會不備份ocr盤和votedisk盤，我們模擬的也是一種極端情況。
[root@rac3 bin]# ./crsctl query css votedisk
0. 0 /dev/raw/raw2
located 1 votedisk(s).
[root@rac3 bin]# dd if=/dev/raw/raw2 of=/home/oracle/votedisk.bak
208864+0 records in
208864+0 records out
[root@rac3 bin]# ./ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 2
Total space (kbytes) : 104344
Used space (kbytes) : 4340
Available space (kbytes) : 100004
ID : 1887132889
Device/File Name : /dev/raw/raw1
Device/File integrity check succeeded
Device/File not configured
Cluster registry integrity check succeeded
[root@rac3 bin]# ./ocrconfig -export /home/oracle/ocr.bak
3.我們先破壞一下ocr和votedisk
[root@rac3 bin]# dd if=/dev/zero of=/dev/raw/raw1 bs=1M count=100 100+0 records in 100+0 records out [root@rac3 bin]# dd if=/dev/zero of=/dev/raw/raw1 bs=1M count=130 dd: writing `/dev/raw/raw1': No space left on device 102+0 records in 101+0 records out [root@rac3 bin]# dd if=/dev/zero of=/dev/raw/raw2 bs=1M count=130 dd: writing `/dev/raw/raw2': No space left on device 102+0 records in 101+0 records out
現在ocr和votedisk已經被我們破壞，目前我們的RAC肯定是啟不來了。
現在我們就利用重建的方式重新把信息注冊到ocr和votedisk中去。
4.分別在每個節點上執行$CRS_HOME/install/rootdele.sh
[root@rac3 install]# ./rootdelete.sh Shutting down Oracle Cluster Ready Services (CRS): OCR initialization failed with invalid format: PROC-22: The OCR backend has an invalid format Shutdown has begun. The daemons should exit soon. Checking to see if Oracle CRS stack is down... Oracle CRS stack is not running. Oracle CRS stack is down now. Removing script for Oracle Cluster Ready services Updating ocr file for downgrade Cleaning up SCR settings in '/etc/oracle/scls_scr'
[root@rac4 install]# ./rootdelete.sh Shutting down Oracle Cluster Ready Services (CRS): OCR initialization failed with invalid format: PROC-22: The OCR backend has an invalid format Shutdown has begun. The daemons should exit soon. Checking to see if Oracle CRS stack is down... Oracle CRS stack is not running. Oracle CRS stack is down now. Removing script for Oracle Cluster Ready services Updating ocr file for downgrade Cleaning up SCR settings in '/etc/oracle/scls_scr'
5.在任意一個節點上執行腳本$CRS_HOME/install/rootdeinstall.sh
只需要一個節點上執行即可
[root@rac3 install]# ./rootdeinstall.sh Removing contents from OCR mirror device 2560+0 records in 2560+0 records out Removing contents from OCR device 2560+0 records in 2560+0 records out
6.在和步驟5同一個節點上執行$CRS_HOME/root.sh腳本
[root@rac3 crs_1]# ./root.sh
WARNING: directory '/opt/ora10g/product/10.2.0' is not owned by root
WARNING: directory '/opt/ora10g/product' is not owned by root
WARNING: directory '/opt/ora10g' is not owned by root
WARNING: directory '/opt' is not owned by root
Checking to see if Oracle CRS stack is already configured
Setting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
WARNING: directory '/opt/ora10g/product/10.2.0' is not owned by root
WARNING: directory '/opt/ora10g/product' is not owned by root
WARNING: directory '/opt/ora10g' is not owned by root
WARNING: directory '/opt' is not owned by root
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 1: rac3 rac3-priv rac3
node 2: rac4 rac4-priv rac4
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
Now formatting voting device: /dev/raw/raw2
Format of 1 voting devices complete.
Startup will be queued to init within 90 seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.
CSS is active on these nodes.
rac3
CSS is inactive on these nodes.
rac4
Local node checking complete.
Run root.sh on remaining nodes to start CRS daemons.
7.在其他節點執行$CRS_HOME/root.sh腳本,注意最后一個節點的輸出
[root@rac4 crs_1]# ./root.sh WARNING: directory '/opt/ora10g/product/10.2.0' is not owned by root WARNING: directory '/opt/ora10g/product' is not owned by root WARNING: directory '/opt/ora10g' is not owned by root WARNING: directory '/opt' is not owned by root Checking to see if Oracle CRS stack is already configured Current Oracle Cluster Registry mirror location '/dev/raw/raw7' in '/etc/oracle/ocr.loc' and '' does not match Update either '/etc/oracle/ocr.loc' to use '' or variable CRS_OCR_LOCATIONS in rootconfig.sh with '/dev/raw/raw7' then rerun rootconfig.sh
發現有報錯,報錯信息應該是ocr mirror location和當前不匹配,這是之前我們試驗ocr轉移位置時留下的(/dev/raw/raw7),
/etc/oracle/ocr.loc文件里我們已經ocrmirrorconfig_loc參數注釋掉了,系統怎么還能看得到那??
http://www.cnblogs.com/myrunning/p/4253696.html
[root@rac4 oracle]# cat ocr.loc #Device/file /dev/raw/raw1 getting replaced by device /dev/raw/raw8 ocrconfig_loc=/dev/raw/raw1 #ocrmirrorconfig_loc=/dev/raw/raw7 local_only=false
我們把/etc/oracle/ocr.loc文件的"#ocrmirrorconfig_loc=/dev/raw/raw7" 去掉,重新執行$CRS_HOME/root.sh
[root@rac4 oracle]# cat ocr.loc #Device/file /dev/raw/raw1 getting replaced by device /dev/raw/raw8 ocrconfig_loc=/dev/raw/raw1 local_only=false
去掉"#ocrmirrorconfig_loc=/dev/raw/raw7",重新執行$CRS_HOME/root.sh,發現問題解決:
[root@rac4 crs_1]# ./root.sh
WARNING: directory '/opt/ora10g/product/10.2.0' is not owned by root
WARNING: directory '/opt/ora10g/product' is not owned by root
WARNING: directory '/opt/ora10g' is not owned by root
WARNING: directory '/opt' is not owned by root
Checking to see if Oracle CRS stack is already configured
Setting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
WARNING: directory '/opt/ora10g/product/10.2.0' is not owned by root
WARNING: directory '/opt/ora10g/product' is not owned by root
WARNING: directory '/opt/ora10g' is not owned by root
WARNING: directory '/opt' is not owned by root
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10G Release 2.
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 1: rac3 rac3-priv rac3
node 2: rac4 rac4-priv rac4
clscfg: Arguments check out successfully.
NO KEYS WERE WRITTEN. Supply -force parameter to override.
-force is destructive and will destroy any previous cluster
configuration.
Oracle Cluster Registry for cluster has already been initialized
Startup will be queued to init within 90 seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.
CSS is active on these nodes.
rac3
rac4
CSS is active on all nodes.
Waiting for the Oracle CRSD and EVMD to start
Oracle CRS stack installed and running under init(1M)
Running vipca(silent) for configuring nodeapps
The given interface(s), "eth0" is not public. Public interfaces should be used to configure virtual IPs.
發現問題，由於"eth0" is not public.vipca沒有執行成功,這需要我們手動地在這個節點上執行vipca
8.重新執行vipca命令
執行vipca報出Error 0(Native: listNetInterfaces:[3])錯誤，如圖：
這是因為我們需要重新設置一下RAC的公共網絡及私有網絡：
使用root用戶重新手動執行vipca:
9.驗證ONS/GSD/VIP有沒有正常注冊到集群中
[oracle@rac4 ~]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora.rac3.gsd application ONLINE ONLINE rac3 ora.rac3.ons application ONLINE ONLINE rac3 ora.rac3.vip application ONLINE ONLINE rac4 ora.rac4.gsd application ONLINE ONLINE rac4 ora.rac4.ons application ONLINE ONLINE rac4 ora.rac4.vip application ONLINE ONLINE rac4
10.使用netca命令重新配置監聽
使用netca命令配置監聽，該命令會自動把Listener注冊到Clusterware中。
使用oracle用戶手動執行netca命令：
確認一下我們剛剛配置的Listener有沒有注冊到監聽中：
[oracle@rac4 ~]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora....C3.lsnr application ONLINE ONLINE rac3 ora.rac3.gsd application ONLINE ONLINE rac3 ora.rac3.ons application ONLINE ONLINE rac3 ora.rac3.vip application ONLINE ONLINE rac3 ora....C4.lsnr application ONLINE ONLINE rac4 ora.rac4.gsd application ONLINE ONLINE rac4 ora.rac4.ons application ONLINE ONLINE rac4 ora.rac4.vip application ONLINE ONLINE rac4
可以看到至此，我們把listener、ons、gsd、vip都已經注冊到ocr中了,下一步還需要把ASM、數據庫注冊到ocr中我們的實驗就完成了。
11.把ASM注冊到OCR中
[oracle@rac3 ~]$ srvctl add asm -n rac3 -i +ASM1 -o /opt/ora10g/product/10.2.0/db_1 [oracle@rac3 ~]$ srvctl add asm -n rac4 -i +ASM2 -o /opt/ora10g/product/10.2.0/db_1 [oracle@rac3 ~]$ [oracle@rac3 ~]$ srvctl config asm -n rac3 +ASM1 /opt/ora10g/product/10.2.0/db_1 [oracle@rac3 ~]$ srvctl config asm -n rac4 +ASM2 /opt/ora10g/product/10.2.0/db_1
12.啟動ASM驗證
[oracle@rac3 ~]$ srvctl start asm -n rac3 [oracle@rac3 ~]$ srvctl start asm -n rac4 [oracle@rac3 ~]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora....SM1.asm application ONLINE ONLINE rac3 ora....C3.lsnr application ONLINE ONLINE rac3 ora.rac3.gsd application ONLINE ONLINE rac3 ora.rac3.ons application ONLINE ONLINE rac3 ora.rac3.vip application ONLINE ONLINE rac3 ora....SM2.asm application ONLINE ONLINE rac4 ora....C4.lsnr application ONLINE ONLINE rac4 ora.rac4.gsd application ONLINE ONLINE rac4 ora.rac4.ons application ONLINE ONLINE rac4 ora.rac4.vip application ONLINE ONLINE rac4
通過上面的輸出可以看出ASM已經成功啟動,啟動的時候可以關注一下asm的啟動日志，方便有錯誤的時候即使發現問題：
[oracle@rac3 bdump]$ pwd
/opt/ora10g/admin/+ASM/bdump
[oracle@rac3 bdump]$ tail -f alert_+ASM1.log
13.把數據庫注冊到OCR中
[oracle@rac3 ~]$ srvctl add database -d racdb -o $ORACLE_HOME [oracle@rac3 ~]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora....SM1.asm application ONLINE ONLINE rac3 ora....C3.lsnr application ONLINE ONLINE rac3 ora.rac3.gsd application ONLINE ONLINE rac3 ora.rac3.ons application ONLINE ONLINE rac3 ora.rac3.vip application ONLINE ONLINE rac3 ora....SM2.asm application ONLINE ONLINE rac4 ora....C4.lsnr application ONLINE ONLINE rac4 ora.rac4.gsd application ONLINE ONLINE rac4 ora.rac4.ons application ONLINE ONLINE rac4 ora.rac4.vip application ONLINE ONLINE rac4 ora.racdb.db application OFFLINE OFFLINE
14.把實例注冊到OCR中
[oracle@rac3 ~]$ srvctl add instance -d racdb -n rac3 -i racdb1 [oracle@rac3 ~]$ srvctl add instance -d racdb -n rac4 -i racdb2 [oracle@rac3 ~]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora....SM1.asm application ONLINE ONLINE rac3 ora....C3.lsnr application ONLINE ONLINE rac3 ora.rac3.gsd application ONLINE ONLINE rac3 ora.rac3.ons application ONLINE ONLINE rac3 ora.rac3.vip application ONLINE ONLINE rac3 ora....SM2.asm application ONLINE ONLINE rac4 ora....C4.lsnr application ONLINE ONLINE rac4 ora.rac4.gsd application ONLINE ONLINE rac4 ora.rac4.ons application ONLINE ONLINE rac4 ora.rac4.vip application ONLINE ONLINE rac4 ora.racdb.db application OFFLINE OFFLINE ora....b1.inst application OFFLINE OFFLINE ora....b2.inst application OFFLINE OFFLINE
15.修改實例和ASM實例的依賴關系
[oracle@rac3 ~]$ srvctl modify instance -d racdb -i racdb1 -s +ASM1 [oracle@rac3 ~]$ srvctl modify instance -d racdb -i racdb2 -s +ASM2 [oracle@rac3 ~]$
16.啟動數據庫進行驗證
[oracle@rac3 ~]$ srvctl start database -d racdb [oracle@rac3 ~]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora....SM1.asm application ONLINE ONLINE rac3 ora....C3.lsnr application ONLINE ONLINE rac3 ora.rac3.gsd application ONLINE ONLINE rac3 ora.rac3.ons application ONLINE ONLINE rac3 ora.rac3.vip application ONLINE ONLINE rac3 ora....SM2.asm application ONLINE ONLINE rac4 ora....C4.lsnr application ONLINE ONLINE rac4 ora.rac4.gsd application ONLINE ONLINE rac4 ora.rac4.ons application ONLINE ONLINE rac4 ora.rac4.vip application ONLINE ONLINE rac4 ora.racdb.db application ONLINE ONLINE rac3 ora....b1.inst application ONLINE ONLINE rac3 ora....b2.inst application ONLINE ONLINE rac4
現在可以看到我們注冊到CRS中的數據已經正常啟動了
[oracle@rac3 ~]$ sqlplus '/as sysdba'
SQL*Plus: Release 10.2.0.1.0 - Production on Thu Jan 29 12:47:02 2015
Copyright (c) 1982, 2005, Oracle. All rights reserved.
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP and Data Mining options
SQL> col name for a50
SQL> select * from v$dbfile;
FILE# NAME
---------- --------------------------------------------------
4 +DATA/racdb/datafile/users.259.845203503
3 +DATA/racdb/datafile/sysaux.257.845203501
2 +DATA/racdb/datafile/undotbs1.258.845203501
1 +DATA/racdb/datafile/system.256.845203499
5 +DATA/racdb/datafile/undotbs2.264.845203661
6 +DATA/racdb/datafile/rlst.268.852657465
6 rows selected.
SQL>
17.手動添加service到ocr中
[oracle@rac3 ~]$ srvctl add service -d racdb -s racdbservice -r racdb1 -a racdb2 -P BASIC [oracle@rac3 ~]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora....SM1.asm application ONLINE ONLINE rac3 ora....C3.lsnr application ONLINE ONLINE rac3 ora.rac3.gsd application ONLINE ONLINE rac3 ora.rac3.ons application ONLINE ONLINE rac3 ora.rac3.vip application ONLINE ONLINE rac3 ora....SM2.asm application ONLINE ONLINE rac4 ora....C4.lsnr application ONLINE ONLINE rac4 ora.rac4.gsd application ONLINE ONLINE rac4 ora.rac4.ons application ONLINE ONLINE rac4 ora.rac4.vip application ONLINE ONLINE rac4 ora.racdb.db application ONLINE ONLINE rac3 ora....b1.inst application ONLINE ONLINE rac3 ora....b2.inst application ONLINE ONLINE rac4 ora....vice.cs application OFFLINE OFFLINE ora....db1.srv application OFFLINE OFFLINE
[oracle@rac3 ~]$ srvctl start service -d racdb [oracle@rac3 ~]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora....SM1.asm application ONLINE ONLINE rac3 ora....C3.lsnr application ONLINE ONLINE rac3 ora.rac3.gsd application ONLINE ONLINE rac3 ora.rac3.ons application ONLINE ONLINE rac3 ora.rac3.vip application ONLINE ONLINE rac3 ora....SM2.asm application ONLINE ONLINE rac4 ora....C4.lsnr application ONLINE ONLINE rac4 ora.rac4.gsd application ONLINE ONLINE rac4 ora.rac4.ons application ONLINE ONLINE rac4 ora.rac4.vip application ONLINE ONLINE rac4 ora.racdb.db application ONLINE ONLINE rac3 ora....b1.inst application ONLINE ONLINE rac3 ora....b2.inst application ONLINE ONLINE rac4 ora....vice.cs application ONLINE ONLINE rac3 ora....db1.srv application ONLINE ONLINE rac3
至此，我們已經正確的重新初始化了我們的OCR盤和VoteDisk盤，並且沒有用到備份。
轉：http://www.cnblogs.com/myrunning/p/4311850.html