ORACLE 10G RAC+LINUX+ASM安裝
1 軟件准備
10201_database_linux_x86_64.cpio è ORACLE 10.2.0.1軟件
10201_clusterware_linux_x86_64.cpio.gz èORACLE 10.2.0.1 集群軟件
p8202632_10205_Linux-x86-64.zip è ORACLE 10.2.0.5升級包
2 系統環境准備
| 主機名 |
IP地址 |
操作系統 |
| rac1 |
eth0 public 172.44.2.18 eth1 private 172.44.4.18 vip 172.44.2.180 |
centos 5.8 x86_64 |
| rac2 |
eth0 public 172.44.2.22 eth1 private 172.44.4.22 vip 172.44.2.220 |
centos 5.8 x86_64 |
3 安裝
3.1 安裝前提說明
本次安裝是在ESXI5.5上基於Centos5.8安裝ORACLE 10G RAC+ASM。
3.1.1 ESXI配置共享磁盤
1. 在ESXI中的虛擬機上新增5塊磁盤，1塊用作OCR,一塊用作VOTE，其他的用作數據盤。並且新的SCSI總線共享策略要設置為虛擬。磁盤必須選擇厚置備模式。
3.2 安裝數據庫軟件依賴包
使用安裝鏡像作為本地yum源，安裝ORACLE所需依賴包
yum -y install binutils compat-libstdc++-33 elfutils-libelf elfutils-libelf-devel elfutils-libelf-devel-static gcc gcc-c++ glibc glibc-common glibc-devel glibc-headers kernel-headers ksh libaio libaio-devel libgcc libgomp libstdc++ libstdc++-devel make sysstat unixODBC unixODBC-devel libXp
3.3 配置內核參數
# vim /etc/sysctl.conf kernel.shmall = 17179869184 kernel.shmmni = 4096 kernel.sem = 250 32000 100 128 fs.file-max = 65536 net.ipv4.ip_local_port_range = 1024 65000 net.core.rmem_default = 1048576 net.core.rmem_max = 1048576 net.core.wmem_default = 262144 net.core.wmem_max = 262144 # sysctl -p
3.4 配置用戶limit
vim /etc/security/limits.conf oracle soft nproc 2047 oracle hard nproc 16384 oracle soft nofile 1024 oracle hard nofile 65536
3.5 配置/etc/pam.d/login
# vim /etc/pam.d/login session required pam_limits.so
3.6 配置雙機時間同步
# /usr/sbin/ntpdate 172.44.3.101 && /sbin/hwclock –w # crontab -e * * * * * (/usr/sbin/ntpdate 172.44.3.101 && /sbin/hwclock -w) &> /dev/null # vim /etc/modprobe.conf options hangcheck-timer hangcheck_tick=30 hangcheck_margin=180 # modprobe -v hangcheck-timer
3.7 創建用戶和屬組
# groupadd -g 1000 oinstall # groupadd -g 1001 dba # useradd -g oinstall -G dba oracle
3.8 配置/etc/hosts
# vim /etc/hosts ## 添加以下信息 172.44.2.18 rac1 172.44.2.22 rac2 172.44.4.18 rac1priv 172.44.4.22 rac2priv 172.44.2.180 rac1vip 172.44.2.220 rac2vip
3.9 配置雙機ssh互信
在節點1上執行
[root@rac1 ~]# su - oracle [oracle@rac1 ~]$ /usr/bin/ssh-keygen -t rsa Generating public/private rsa key pair. Enter file in which to save the key (/home/oracle/.ssh/id_rsa): Created directory '/home/oracle/.ssh'. Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/oracle/.ssh/id_rsa. Your public key has been saved in /home/oracle/.ssh/id_rsa.pub. The key fingerprint is: f1:e5:45:34:68:d5:93:d6:af:bf:ee:d4:d8:dd:e5:97 oracle@rac1
在節點2上執行
[root@rac2 ~]# su - oracle [oracle@rac2 ~]$ /usr/bin/ssh-keygen -t rsa Generating public/private rsa key pair. Enter file in which to save the key (/home/oracle/.ssh/id_rsa): Created directory '/home/oracle/.ssh'. Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/oracle/.ssh/id_rsa. Your public key has been saved in /home/oracle/.ssh/id_rsa.pub. The key fingerprint is: e2:ce:11:97:04:d7:05:33:56:c6:aa:0c:89:c8:1c:c2 oracle@rac2 [oracle@rac2 ~]$
在節點1,2上執行
[oracle@rac2 ~]$ cd .ssh/ [oracle@rac2 .ssh]$ cat id_rsa.pub > authorized_keys [oracle@rac2 .ssh]$ vim authorized_keys
把節點1 authorized_keys文件的內容拷貝到節點2的authorized_keys文件中，把節點2 authorized_keys文件中的內容拷貝到節點1中。
[oracle@rac2 .ssh]$ vim authorized_keys ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4+8rN3x69Exzx5Y+8POGESZUGS2vew8iHgXRhEk1yI4vquENFmxZinTRsx+tlp2i7fpsIjgkPTqG4Z5UL4E6RYKSeOFJa9qy1VdfQnH6oO0A8fr0qaSrwqy3VzwsV6pFU5Rd0l+y/P7aMCrrWbIqboWdiuAj9ge14jRygY+ip/MwcVPgoXwx5HBzb7Ig7R73mEHAmAXPjoa8PabZmrvBKYt3o0hDAqUlURRV/hA1UPMJOnLP7gfZHEF3g4PiYux8rLIiMZGVSpXFpk8H9yvXqqhJPW780K4Qp15MLRwJW8kMMqDl/pRwwvfNZkgd8ZCtSiAnshtxGWk/VvnauEqI9w== oracle@rac2 ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA0JKof7JLP1/P2Yk0RbflGGihNArnRYt1dOSDgdllNULAEyA0X8I7IKV4rwkqXZkfEwirYKCtkdeOg56S/qddbpOa kJ1ibOHmrcavhfYeIyK6/fPon1TuJESuTdWcvk3H8XYergVTtWKmWoHs6xzL+Ms1dIUeywfg/7liWxprTpuyTW6kUB4Y7ilcxumVTKkUGs1oLWCN7xJbGKUV+yzo pGeDApK2IhdSKZeDzSJCeeagGNzh+K9r6tuoLdY/w5ahvQc8Rw9EKO2+Kv1P+lvEIhE6qsxTotJRQsO+hLVYT/U1dCMLjXkL0hm0C6ARsAh5s91xovxkmQ5Bc62s vHnFGQ== oracle@rac1
測試雙機ssh互信，在節點1，2上分別執行
[oracle@rac2 ~]$ ssh rac1 Last login: Wed Jan 18 17:53:09 2017 from rac1priv [oracle@rac1 ~]$ exit logout Connection to rac1 closed. [oracle@rac2 ~]$ ssh rac2 The authenticity of host 'rac2 (172.44.2.22)' can't be established. RSA key fingerprint is 01:bc:86:0e:77:04:41:9d:1d:ee:7d:ff:12:bb:8b:88. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'rac2,172.44.2.22' (RSA) to the list of known hosts. [oracle@rac2 ~]$ exit logout Connection to rac2 closed. [oracle@rac2 ~]$ ssh rac1priv The authenticity of host 'rac1priv (172.44.4.18)' can't be established. RSA key fingerprint is 01:bc:86:0e:77:04:41:9d:1d:ee:7d:ff:12:bb:8b:88. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'rac1priv,172.44.4.18' (RSA) to the list of known hosts. Last login: Wed Jan 18 17:54:06 2017 from rac2 [oracle@rac1 ~]$ exit logout Connection to rac1priv closed. [oracle@rac2 ~]$ ssh rac2priv The authenticity of host 'rac2priv (172.44.4.22)' can't be established. RSA key fingerprint is 01:bc:86:0e:77:04:41:9d:1d:ee:7d:ff:12:bb:8b:88. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'rac2priv,172.44.4.22' (RSA) to the list of known hosts. Last login: Wed Jan 18 17:54:13 2017 from rac2 [oracle@rac2 ~]$
3.10 配置oracle用戶環境變量
在節點1上
[oracle@rac1 ~]$ vim .bash_profile # .bash_profile # Get the aliases and functions if [ -f ~/.bashrc ]; then . ~/.bashrc fi # User specific environment and startup programs PATH=$PATH:$HOME/bin export PATH ORACLE_BASE=/u01/app/oracle export ORA_CRS_HOME=$ORACLE_BASE/product/10.2.0/crs export ORACLE_HOME=$ORACLE_BASE/product/10.2.0/db_1 export ORACLE_SID=test1 export PATH=$PATH:$ORA_CRS_HOME/bin:$ORACLE_HOME/bin:$ORACLE_HOME/OPatch:. alias sqlplus='rlwrap sqlplus' # oracle sqlpls alias rman='rlwrap rman' # oracle rman alias ggsci='rlwrap ggsci' # oracle goldengate stty erase ^h export NLS_LANG=AMERICAN_AMERICA.UTF8 export NLS_DATE_FORMAT='yyyymmdd hh24:mi:ss'
在節點2上
[oracle@rac2 ~]$ vim .bash_profile # .bash_profile # Get the aliases and functions if [ -f ~/.bashrc ]; then . ~/.bashrc fi # User specific environment and startup programs PATH=$PATH:$HOME/bin ORACLE_BASE=/u01/app/oracle export ORA_CRS_HOME=$ORACLE_BASE/product/10.2.0/crs export ORACLE_HOME=$ORACLE_BASE/product/10.2.0/db_1 export ORACLE_SID=test2 export PATH=$PATH:$ORA_CRS_HOME/bin:$ORACLE_HOME/bin:$ORACLE_HOME/OPatch:. alias sqlplus='rlwrap sqlplus' # oracle sqlpls alias rman='rlwrap rman' # oracle rman alias ggsci='rlwrap ggsci' # oracle goldengate stty erase ^h export NLS_LANG=AMERICAN_AMERICA.UTF8 export NLS_DATE_FORMAT='yyyymmdd hh24:mi:ss' export PATH
3.11 配置共享磁盤
在節點1上對磁盤進行分區
[root@rac1 network-scripts]# fdisk -l Disk /dev/sda: 32.2 GB, 32212254720 bytes 255 heads, 63 sectors/track, 3916 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sda1 * 1 13 104391 83 Linux /dev/sda2 14 1057 8385930 82 Linux swap / Solaris /dev/sda3 1058 3916 22964917+ 8e Linux LVM Disk /dev/sdb: 524 MB, 524288000 bytes 64 heads, 32 sectors/track, 500 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdb doesn't contain a valid partition table Disk /dev/sdc: 524 MB, 524288000 bytes 64 heads, 32 sectors/track, 500 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdc doesn't contain a valid partition table Disk /dev/sdd: 10.7 GB, 10737418240 bytes 255 heads, 63 sectors/track, 1305 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk /dev/sdd doesn't contain a valid partition table Disk /dev/sde: 10.7 GB, 10737418240 bytes 255 heads, 63 sectors/track, 1305 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk /dev/sde doesn't contain a valid partition table Disk /dev/sdf: 10.7 GB, 10737418240 bytes 255 heads, 63 sectors/track, 1305 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk /dev/sdf doesn't contain a valid partition table [root@rac1 network-scripts]# df -h Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup00-LogVol00 22G 2.8G 18G 14% / /dev/sda1 99M 13M 81M 14% /boot tmpfs 2.0G 0 2.0G 0% /dev/shm /dev/hdc 4.3G 4.3G 0 100% /mnt [root@rac1 network-scripts]# fdisk /dev/sdb Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel Building a new DOS disklabel. Changes will remain in memory only, until you decide to write them. After that, of course, the previous content won't be recoverable. Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite) Command (m for help): n Command action e extended p primary partition (1-4) p Partition number (1-4): Value out of range. Partition number (1-4): Value out of range. Partition number (1-4): 1 First cylinder (1-500, default 1): Using default value 1 Last cylinder or +size or +sizeM or +sizeK (1-500, default 500): Using default value 500 Command (m for help): w The partition table has been altered! Calling ioctl() to re-read partition table. WARNING: Re-reading the partition table failed with error 16: Device or resource busy. The kernel still uses the old table. The new table will be used at the next reboot. Syncing disks. [root@rac1 network-scripts]# fdisk /dev/sdc Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel Building a new DOS disklabel. Changes will remain in memory only, until you decide to write them. After that, of course, the previous content won't be recoverable. Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite) Command (m for help): n Command action e extended p primary partition (1-4) p Partition number (1-4): 1 First cylinder (1-500, default 1): Using default value 1 Last cylinder or +size or +sizeM or +sizeK (1-500, default 500): Using default value 500 Command (m for help): w The partition table has been altered! Calling ioctl() to re-read partition table. WARNING: Re-reading the partition table failed with error 16: Device or resource busy. The kernel still uses the old table. The new table will be used at the next reboot. Syncing disks. [root@rac1 network-scripts]# fdisk /dev/sdd Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel Building a new DOS disklabel. Changes will remain in memory only, until you decide to write them. After that, of course, the previous content won't be recoverable. The number of cylinders for this disk is set to 1305. There is nothing wrong with that, but this is larger than 1024, and could in certain setups cause problems with: 1) software that runs at boot time (e.g., old versions of LILO) 2) booting and partitioning software from other OSs (e.g., DOS FDISK, OS/2 FDISK) Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite) Command (m for help): n Command action e extended p primary partition (1-4) p Partition number (1-4): 1 First cylinder (1-1305, default 1): Using default value 1 Last cylinder or +size or +sizeM or +sizeK (1-1305, default 1305): Using default value 1305 Command (m for help): Command (m for help): w The partition table has been altered! Calling ioctl() to re-read partition table. WARNING: Re-reading the partition table failed with error 16: Device or resource busy. The kernel still uses the old table. The new table will be used at the next reboot. Syncing disks. [root@rac1 network-scripts]# fdisk /dev/sde Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel Building a new DOS disklabel. Changes will remain in memory only, until you decide to write them. After that, of course, the previous content won't be recoverable. The number of cylinders for this disk is set to 1305. There is nothing wrong with that, but this is larger than 1024, and could in certain setups cause problems with: 1) software that runs at boot time (e.g., old versions of LILO) 2) booting and partitioning software from other OSs (e.g., DOS FDISK, OS/2 FDISK) Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite) Command (m for help): n Command action e extended p primary partition (1-4) p Partition number (1-4): 1 First cylinder (1-1305, default 1): Using default value 1 Last cylinder or +size or +sizeM or +sizeK (1-1305, default 1305): Using default value 1305 Command (m for help): w The partition table has been altered! Calling ioctl() to re-read partition table. WARNING: Re-reading the partition table failed with error 16: Device or resource busy. The kernel still uses the old table. The new table will be used at the next reboot. Syncing disks. [root@rac1 network-scripts]# fdisk /dev/sdf Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel Building a new DOS disklabel. Changes will remain in memory only, until you decide to write them. After that, of course, the previous content won't be recoverable. The number of cylinders for this disk is set to 1305. There is nothing wrong with that, but this is larger than 1024, and could in certain setups cause problems with: 1) software that runs at boot time (e.g., old versions of LILO) 2) booting and partitioning software from other OSs (e.g., DOS FDISK, OS/2 FDISK) Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite) Command (m for help): n Command action e extended p primary partition (1-4) p Partition number (1-4): 1 First cylinder (1-1305, default 1): Using default value 1 Last cylinder or +size or +sizeM or +sizeK (1-1305, default 1305): Using default value 1305 Command (m for help): w The partition table has been altered! Calling ioctl() to re-read partition table. WARNING: Re-reading the partition table failed with error 16: Device or resource busy. The kernel still uses the old table. The new table will be used at the next reboot. Syncing disks. # partprobe [root@rac1 network-scripts]# fdisk -l Disk /dev/sda: 32.2 GB, 32212254720 bytes 255 heads, 63 sectors/track, 3916 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sda1 * 1 13 104391 83 Linux /dev/sda2 14 1057 8385930 82 Linux swap / Solaris /dev/sda3 1058 3916 22964917+ 8e Linux LVM Disk /dev/sdb: 524 MB, 524288000 bytes 64 heads, 32 sectors/track, 500 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Device Boot Start End Blocks Id System /dev/sdb1 1 500 511984 83 Linux Disk /dev/sdc: 524 MB, 524288000 bytes 64 heads, 32 sectors/track, 500 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Device Boot Start End Blocks Id System /dev/sdc1 1 500 511984 83 Linux Disk /dev/sdd: 10.7 GB, 10737418240 bytes 255 heads, 63 sectors/track, 1305 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdd1 1 1305 10482381 83 Linux Disk /dev/sde: 10.7 GB, 10737418240 bytes 255 heads, 63 sectors/track, 1305 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sde1 1 1305 10482381 83 Linux Disk /dev/sdf: 10.7 GB, 10737418240 bytes 255 heads, 63 sectors/track, 1305 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sdf1 1 1305 10482381 83 Linux [root@rac1 network-scripts]#
在節點1,2上執行
[root@rac1 network-scripts]# vim /etc/udev/rules.d/60-raw.rules ACTION=="add", KERNEL=="sdc3",RUN+="/bin/raw /dev/raw/raw6 %N" # Enter raw device bindings here. # # An example would be: # ACTION=="add", KERNEL=="sda", RUN+="/bin/raw /dev/raw/raw1 %N" # to bind /dev/raw/raw1 to /dev/sda, or # ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="1", RUN+="/bin/raw /dev/raw/raw2 %M %m" # to bind /dev/raw/raw2 to the device with major 8, minor 1. ACTION=="add", KERNEL=="sdb1",RUN+="/bin/raw /dev/raw/raw1 %N" ACTION=="add", KERNEL=="sdc1",RUN+="/bin/raw /dev/raw/raw2 %N" ACTION=="add", KERNEL=="sdd1",RUN+="/bin/raw /dev/raw/raw3 %N" ACTION=="add", KERNEL=="sde1",RUN+="/bin/raw /dev/raw/raw4 %N" ACTION=="add", KERNEL=="sdf1",RUN+="/bin/raw /dev/raw/raw5 %N" ACTION=="add",KERNEL=="raw[1-5]", OWNER="oracle", GROUP="oinstall", MODE="660" [root@rac1 network-scripts]# start_udev Starting udev: [ OK ] [root@rac1 network-scripts]# raw raw raw2tiff [root@rac1 network-scripts]# raw raw raw2tiff [root@rac1 network-scripts]# raw -qa /dev/raw/raw1: bound to major 8, minor 17 /dev/raw/raw2: bound to major 8, minor 33 /dev/raw/raw3: bound to major 8, minor 49 /dev/raw/raw4: bound to major 8, minor 65 /dev/raw/raw5: bound to major 8, minor 81 [root@rac1 network-scripts]#
3.12 創建安裝路徑
在節點1,2上執行
# mkdir -p /u01/app/oracle/product/10.2.0/crs # mkdir -p /u01/app/oracle/product/10.2.0/db_1 # mkdir -p /u01/oradata # chown -R oracle.oinstall /u01 # chown -R oracle.oinstall /u01
3.13 解壓ORACLE 集群軟件安裝包
在安裝ORACLE數據庫軟件前，需要先安裝ORACLE clusterware集群軟件
[root@rac1 src]# cpio -idcmv < 10201_clusterware_linux_x86_64.cpio
3.14 安裝clusterware集群軟件
1. 在節點1,2上執行
# /usr/local/src/clusterware/rootpre/rootpre.sh
2. 運行以下命令
$ ./runInstaller –ignoreSysPrereqs
3. 選擇crs路徑，注意別選擇了dbms的
4. 檢查安裝要求
5. 輸入另一個節點的信息
6. 確認兩個節點的信息無誤，選擇下一步
7. 修改網卡用途
8． 選擇OCR路徑
9. 選擇Voting Disk
10. 開始安裝
11. 安裝進度條
12. 使用root在兩個節點上執行腳本
在節點1 上執行 [root@rac1 ~]# /home/oracle/oraInventory/orainstRoot.sh 在節點2上執行 [root@rac2 ~]# /home/oracle/oraInventory/orainstRoot.sh Changing permissions of /home/oracle/oraInventory to 770. Changing groupname of /home/oracle/oraInventory to oinstall. The execution of the script is complete [root@rac2 ~]# 在節點1上執行 [root@rac1 ~]# /u01/app/oracle/product/10.2.0/crs/root.sh WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root WARNING: directory '/u01/app/oracle/product' is not owned by root WARNING: directory '/u01/app/oracle' is not owned by root WARNING: directory '/u01/app' is not owned by root WARNING: directory '/u01' is not owned by root Checking to see if Oracle CRS stack is already configured /etc/oracle does not exist. Creating it now. Setting the permissions on OCR backup directory Setting up NS directories Oracle Cluster Registry configuration upgraded successfully WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root WARNING: directory '/u01/app/oracle/product' is not owned by root WARNING: directory '/u01/app/oracle' is not owned by root WARNING: directory '/u01/app' is not owned by root WARNING: directory '/u01' is not owned by root Successfully accumulated necessary OCR keys. Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897. node <nodenumber>: <nodename> <private interconnect name> <hostname> node 1: rac1 rac1priv rac1 node 2: rac2 rac2priv rac2 Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. Now formatting voting device: /dev/raw/raw2 Format of 1 voting devices complete. Startup will be queued to init within 90 seconds. Adding daemons to inittab Expecting the CRS daemons to be up within 600 seconds. CSS is active on these nodes. rac1 CSS is inactive on these nodes. rac2 Local node checking complete. Run root.sh on remaining nodes to start CRS daemons. [root@rac1 ~]#
在節點2上執行，出現報錯
[root@rac2 ~]# /u01/app/oracle/product/10.2.0/crs/root.sh WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root WARNING: directory '/u01/app/oracle/product' is not owned by root WARNING: directory '/u01/app/oracle' is not owned by root WARNING: directory '/u01/app' is not owned by root WARNING: directory '/u01' is not owned by root Checking to see if Oracle CRS stack is already configured /etc/oracle does not exist. Creating it now. Setting the permissions on OCR backup directory Setting up NS directories Oracle Cluster Registry configuration upgraded successfully WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root WARNING: directory '/u01/app/oracle/product' is not owned by root WARNING: directory '/u01/app/oracle' is not owned by root WARNING: directory '/u01/app' is not owned by root WARNING: directory '/u01' is not owned by root clscfg: EXISTING configuration version 3 detected. clscfg: version 3 is 10G Release 2. Successfully accumulated necessary OCR keys. Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897. node <nodenumber>: <nodename> <private interconnect name> <hostname> node 1: rac1 rac1priv rac1 node 2: rac2 rac2priv rac2 clscfg: Arguments check out successfully. NO KEYS WERE WRITTEN. Supply -force parameter to override. -force is destructive and will destroy any previous cluster configuration. Oracle Cluster Registry for cluster has already been initialized Startup will be queued to init within 90 seconds. Adding daemons to inittab Expecting the CRS daemons to be up within 600 seconds. CSS is active on these nodes. rac1 rac2 CSS is active on all nodes. Waiting for the Oracle CRSD and EVMD to start Oracle CRS stack installed and running under init(1M) Running vipca(silent) for configuring nodeapps /u01/app/oracle/product/10.2.0/crs/jdk/jre//bin/java: error while loading shared libraries: libpthread.so.0: cannot open shared object file: No such file or directory [root@rac2 ~]#
備注：如果不希望看到報錯，可以先執行下面的vipca操作以及oifcfg操作后，再執行該腳本
在節點1上執行
$ cd /u01/app/oracle/product/10.2.0/crs/bin
$ vim vipca
在文件中添加unset LD_ASSUME_KERNEL，如下圖所示
在節點1上執行
[root@rac1 bin]# ./oifcfg setif -global eth0/172.44.2.0:public [root@rac1 bin]# ./oifcfg setif -global eth1/172.44.4.0:cluster_interconnect [root@rac1 bin]# ./oifcfg getif eth0 172.44.2.0 global public eth1 172.44.4.0 global cluster_interconnect [root@rac1 bin]#
在節點1上執行
# cd /u01/app/oracle/product/10.2.0/crs/bin # ./vipca
選擇NEXT
2． 選擇下一步
3. 輸入兩個節點的VIP信息
4. 確認兩個節點的VIP信息無誤
5. 等待安裝完成
6. 這時候返回之前安裝的界面，點擊OK
7. 如果配置有問題的話，點擊OK之后，后面會出現報錯。
8. 安裝完成。
3.15 安裝數據庫軟件
在節點1上執行
/usr/local/src/database/runInstaller
- 選擇下一步
- 選擇安裝企業版
- 注意這是是DB HOME
- 選擇兩個節點
- 檢查通過之后，選擇下一步
- 選擇只安裝軟件
- 選擇安裝
- 在兩個節點上執行腳本
[root@rac1 bin]# /u01/app/oracle/product/10.2.0/db_1/root.sh Running Oracle10 root.sh script... The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /u01/app/oracle/product/10.2.0/db_1 Enter the full pathname of the local bin directory: [/usr/local/bin]: Copying dbhome to /usr/local/bin ... Copying oraenv to /usr/local/bin ... Copying coraenv to /usr/local/bin ... Creating /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. [root@rac1 bin]# [root@rac2 ~]# /u01/app/oracle/product/10.2.0/db_1/root.sh Running Oracle10 root.sh script... The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /u01/app/oracle/product/10.2.0/db_1 Enter the full pathname of the local bin directory: [/usr/local/bin]: Copying dbhome to /usr/local/bin ... Copying oraenv to /usr/local/bin ... Copying coraenv to /usr/local/bin ... Creating /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. [root@rac2 ~]#
安裝完成。
3.16 安裝監聽
在節點1上執行
$ netca
2. 選擇集群配置
3. 選擇兩個節點
4. 選擇下一步
5. 選擇下一步
6. 選擇下一步
7. 選擇下一步
8. 選擇下一步
9. 選擇下一步
10 . 完成配置。
3.17 建庫
1. 在節點1上執行
$ dbca
2. 選擇下一步
3. 選擇創建數據庫
4. 選擇兩個節點
5. 選擇下一步
6. 輸入數據庫名稱
7. 選擇下一步
8. 配置密碼
9. 使用ASM
10. 配置ASM參數
11. 配置ASM 磁盤
12. 配置ASM
13. 選擇數據文件存放路徑
14. 選擇下一步
15. 選擇下一步
16. 選擇下一步
17. 配置數據庫字符集
18. 選擇下一步
19. 選擇下一步
20. 選擇Finish
21. 選擇OK ，開始安裝
22. 安裝完成
[oracle@rac1 ~]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora....SM1.asm application ONLINE ONLINE rac1 ora....C1.lsnr application ONLINE ONLINE rac1 ora.rac1.gsd application ONLINE ONLINE rac1 ora.rac1.ons application ONLINE ONLINE rac1 ora.rac1.vip application ONLINE ONLINE rac1 ora....SM2.asm application ONLINE ONLINE rac2 ora....C2.lsnr application ONLINE ONLINE rac2 ora.rac2.gsd application ONLINE ONLINE rac2 ora.rac2.ons application ONLINE ONLINE rac2 ora.rac2.vip application ONLINE ONLINE rac2 ora.test.db application ONLINE ONLINE rac1 ora....t1.inst application ONLINE ONLINE rac1 ora....t2.inst application ONLINE ONLINE rac2
3.18 升級CRS
在節點1執行
# unzip p8202632_10205_Linux-x86-64.zip # cd Disk1/
1. 選擇下一步
2. 選擇下一步
3. 選擇下一步
4. 檢查通過后，選擇下一步
5. 選擇安裝，安裝完成之后，在節點1,2執行以下語句
[root@rac1 Disk1]# /u01/app/oracle/product/10.2.0/crs/bin/crsctl stop crs Stopping resources. Successfully stopped CRS resources Stopping CSSD. Shutting down CSS daemon. Shutdown request successfully issued. [root@rac1 Disk1]# /u01/app/oracle/product/10.2.0/crs/install/root102.sh Creating pre-patch directory for saving pre-patch clusterware files Completed patching clusterware files to /u01/app/oracle/product/10.2.0/crs Relinking some shared libraries. Relinking of patched files is complete. WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root WARNING: directory '/u01/app/oracle/product' is not owned by root WARNING: directory '/u01/app/oracle' is not owned by root WARNING: directory '/u01/app' is not owned by root WARNING: directory '/u01' is not owned by root Preparing to recopy patched init and RC scripts. Recopying init and RC scripts. Startup will be queued to init within 30 seconds. Starting up the CRS daemons. Waiting for the patched CRS daemons to start. This may take a while on some systems. . 10205 patch successfully applied. clscfg: EXISTING configuration version 3 detected. clscfg: version 3 is 10G Release 2. Successfully deleted 1 values from OCR. Successfully deleted 1 keys from OCR. Successfully accumulated necessary OCR keys. Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897. node <nodenumber>: <nodename> <private interconnect name> <hostname> node 1: rac1 rac1priv rac1 Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. clscfg -upgrade completed successfully Creating '/u01/app/oracle/product/10.2.0/crs/install/paramfile.crs' with data used for CRS configuration Setting CRS configuration values in /u01/app/oracle/product/10.2.0/crs/install/paramfile.crs [root@rac1 Disk1]# [root@rac2 ~]# /u01/app/oracle/product/10.2.0/crs/bin/crsctl stop crs Stopping resources. Successfully stopped CRS resources Stopping CSSD. Shutting down CSS daemon. Shutdown request successfully issued. [root@rac2 ~]# /u01/app/oracle/product/10.2.0/crs/install/root102.sh Creating pre-patch directory for saving pre-patch clusterware files Completed patching clusterware files to /u01/app/oracle/product/10.2.0/crs Relinking some shared libraries. Relinking of patched files is complete. WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root WARNING: directory '/u01/app/oracle/product' is not owned by root WARNING: directory '/u01/app/oracle' is not owned by root WARNING: directory '/u01/app' is not owned by root WARNING: directory '/u01' is not owned by root Preparing to recopy patched init and RC scripts. Recopying init and RC scripts. Startup will be queued to init within 30 seconds. Starting up the CRS daemons. Waiting for the patched CRS daemons to start. This may take a while on some systems. . 10205 patch successfully applied. clscfg: EXISTING configuration version 3 detected. clscfg: version 3 is 10G Release 2. Successfully deleted 1 values from OCR. Successfully deleted 1 keys from OCR. Successfully accumulated necessary OCR keys. Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897. node <nodenumber>: <nodename> <private interconnect name> <hostname> node 2: rac2 rac2priv rac2 Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. clscfg -upgrade completed successfully Creating '/u01/app/oracle/product/10.2.0/crs/install/paramfile.crs' with data used for CRS configuration Setting CRS configuration values in /u01/app/oracle/product/10.2.0/crs/install/paramfile.crs [root@rac2 ~]#
查詢CRS版本
[oracle@rac2 ~]$ crsctl query crs softwareversion CRS software version on node [rac2] is [10.2.0.5.0]
3.19 升級數據庫軟件
升級數據庫軟件必須先停止數據庫
在節點1，2上執行
# /u01/app/oracle/product/10.2.0/crs/bin/crsctl stop crs
1. 選擇下一步
2. 選擇DB HOME
3. 選擇下一步
4. 選擇下一步
5. 選擇下一步
6. 選擇下一步
7. 選擇安裝
8. 在節點1,2上執行
[root@rac1 Disk1]# /u01/app/oracle/product/10.2.0/db_1/root.sh Running Oracle 10g root.sh script... The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /u01/app/oracle/product/10.2.0/db_1 Enter the full pathname of the local bin directory: [/usr/local/bin]: The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. [root@rac1 Disk1]# [root@rac2 ~]# /u01/app/oracle/product/10.2.0/db_1/root.sh Running Oracle 10g root.sh script... The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /u01/app/oracle/product/10.2.0/db_1 Enter the full pathname of the local bin directory: [/usr/local/bin]: The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. [root@rac2 ~]#
9. 安裝完成。
在節點1,2上執行
[root@rac1 Disk1]# /u01/app/oracle/product/10.2.0/crs/bin/crsctl start crs Attempting to start CRS stack The CRS stack will be started shortly [root@rac1 Disk1]# [root@rac2 ~]# /u01/app/oracle/product/10.2.0/crs/bin/crsctl start crs Attempting to start CRS stack The CRS stack will be started shortly [root@rac2 ~]# [oracle@rac1 ~]$ crs_stat -t Name Type Target State Host ------------------------------------------------------------ ora....SM1.asm application ONLINE ONLINE rac1 ora....C1.lsnr application ONLINE ONLINE rac1 ora.rac1.gsd application ONLINE ONLINE rac1 ora.rac1.ons application ONLINE ONLINE rac1 ora.rac1.vip application ONLINE ONLINE rac1 ora....SM2.asm application ONLINE ONLINE rac2 ora....C2.lsnr application ONLINE ONLINE rac2 ora.rac2.gsd application ONLINE ONLINE rac2 ora.rac2.ons application ONLINE ONLINE rac2 ora.rac2.vip application ONLINE ONLINE rac2 ora.test.db application ONLINE OFFLINE ora....t1.inst application ONLINE OFFLINE ora....t2.inst application ONLINE OFFLINE [oracle@rac1 ~]$
可以看出，在升級庫之前，數據庫是起不來的。
3.20 升級數據庫
在節點1上執行
[oracle@rac1 ~]$ cd /u01/app/oracle/product/10.2.0/db_1/dbs/ [oracle@rac1 dbs]$ ls ab_+ASM1.dat hc_+ASM1.dat hc_test1.dat init+ASM1.ora initdw.ora init.ora inittest1.ora orapw+ASM1 orapwtest1 [oracle@rac1 dbs]$ ll total 56 -rw-rw---- 1 oracle oinstall 1559 Jan 19 21:08 ab_+ASM1.dat -rw-rw---- 1 oracle oinstall 1552 Jan 19 21:09 hc_+ASM1.dat -rw-rw---- 1 oracle oinstall 1552 Jan 19 21:10 hc_test1.dat lrwxrwxrwx 1 oracle oinstall 61 Jan 18 21:20 init+ASM1.ora -> /u01/app/oracle/product/10.2.0/db_1/admin/+ASM/pfile/init.ora -rw-r--r-- 1 oracle oinstall 12920 May 3 2001 initdw.ora -rw-r----- 1 oracle oinstall 8385 Sep 11 1998 init.ora -rw-r----- 1 oracle oinstall 37 Jan 18 21:38 inittest1.ora -rw-r----- 1 oracle oinstall 1536 Jan 18 21:20 orapw+ASM1 -rw-r----- 1 oracle oinstall 1536 Jan 18 21:26 orapwtest1 [oracle@rac1 dbs]$ more inittest1.ora SPFILE='+DATADG/test/spfiletest.ora' [oracle@rac1 dbs]$
在節點1，2上，使用sqlplus登錄實例
[oracle@rac1 dbs]$ !sql sqlplus "/as sysdba" SQL*Plus: Release 10.2.0.5.0 - Production on Thu Jan 19 21:19:46 2017 Copyright (c) 1982, 2010, Oracle. All Rights Reserved. Connected to an idle instance. SQL> create pfile='/tmp/pfile.txt' from spfile='+DATADG/test/spfiletest.ora'; File created. SQL>
在節點1,2上，修改/tmp/pfile.txt，將*.cluster_database=true修改為*.cluster_database=false
在節點1，2上，以升級的方式打開數據庫
[oracle@rac1 dbs]$ !sql sqlplus "/as sysdba" SQL*Plus: Release 10.2.0.5.0 - Production on Thu Jan 19 21:22:40 2017 Copyright (c) 1982, 2010, Oracle. All Rights Reserved. Connected to an idle instance. SQL> startup upgrade pfile='/tmp/pfile.txt'; ORACLE instance started. Total System Global Area 1224736768 bytes Fixed Size 2095896 bytes Variable Size 335545576 bytes Database Buffers 872415232 bytes Redo Buffers 14680064 bytes Database mounted. Database opened. SQL>@?/rdbms/admin/catupgrd.sql
升級之后需要先關閉數據庫，再啟動
SQL> shutdown immediate; Database closed. Database dismounted. ORACLE instance shut down. SQL>startup; ORACLE instance started. Total System Global Area 1224736768 bytes Fixed Size 2095896 bytes Variable Size 335545576 bytes Database Buffers 872415232 bytes Redo Buffers 14680064 bytes Database mounted. Database
至此，ORACLE 10G RAC安裝完成。