************************************** errpt ************************************** [ph2oldb2:root]:/>errpt IDENTIFIER TIMESTAMP T C RESOURCE_NAME DESCRIPTION FE2DEE00 0726213218 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NET FE2DEE00 0726212818 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NET FE2DEE00 0726212018 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NET FE2DEE00 0726210918 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NET FE2DEE00 0726210018 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NET FE2DEE00 0726205418 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NET FE2DEE00 0726204918 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NET FE2DEE00 0726204118 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NET FE2DEE00 0726204018 P S SYSXAIXIF DUPLICATE IP ADDRESS DETECTED IN THE NET [ph2oldb2:root]:/>errpt -aj FE2DEE00|more [ph2oldb2:root]:/>errpt -aj FE2DEE00 --------------------------------------------------------------------------- LABEL: AIXIF_ARP_DUP_ADDR IDENTIFIER: FE2DEE00 Date/Time: Thu Jul 26 21:32:17 BEIST 2018 Sequence Number: 1612 Machine Id: 00F977EF4C00 Node Id: ph2oldb2 Class: S Type: PERM WPAR: Global Resource Name: SYSXAIXIF Description DUPLICATE IP ADDRESS DETECTED IN THE NET Failure Causes ARP RESPONSE RECEIVED FOR MY IP ADDRESS Recommended Actions CONTACT NETWORK ADMINISTRATOR Detail Data DUPLICATE IP ADDRESS A9FE 62C2 MAC ADDRESS 8EC2 E6E3 9D03 --------------------------------------------------------------------------- LABEL: AIXIF_ARP_DUP_ADDR IDENTIFIER: FE2DEE00 Date/Time: Thu Jul 26 21:28:17 BEIST 2018 Sequence Number: 1611 Machine Id: 00F977EF4C00 Node Id: ph2oldb2 Class: S Type: PERM WPAR: Global Resource Name: SYSXAIXIF Description DUPLICATE IP ADDRESS DETECTED IN THE NET Failure Causes ARP RESPONSE RECEIVED FOR MY IP ADDRESS Recommended Actions CONTACT NETWORK ADMINISTRATOR Detail Data DUPLICATE IP ADDRESS A9FE 62C2 MAC ADDRESS 8EC2 E6E3 9D03 Duplicates Number of duplicates 1 Time of first duplicate Thu Jul 26 21:27:58 BEIST 2018 Time of last duplicate Thu Jul 26 21:28:17 BEIST 2018 --------------------------------------------------------------------------- LABEL: AIXIF_ARP_DUP_ADDR IDENTIFIER: FE2DEE00 Date/Time: Thu Jul 26 21:20:57 BEIST 2018 Sequence Number: 1610 Machine Id: 00F977EF4C00 Node Id: ph2oldb2 Class: S Type: PERM WPAR: Global Resource Name: SYSXAIXIF Description DUPLICATE IP ADDRESS DETECTED IN THE NET Failure Causes ARP RESPONSE RECEIVED FOR MY IP ADDRESS Recommended Actions CONTACT NETWORK ADMINISTRATOR Detail Data DUPLICATE IP ADDRESS A9FE 62C2 MAC ADDRESS 8EC2 E6E3 9D03 Duplicates Number of duplicates 1 Time of first duplicate Thu Jul 26 21:20:47 BEIST 2018 Time of last duplicate Thu Jul 26 21:20:57 BEIST 2018 --------------------------------------------------------------------------- LABEL: AIXIF_ARP_DUP_ADDR IDENTIFIER: FE2DEE00 Date/Time: Thu Jul 26 21:09:27 BEIST 2018 Sequence Number: 1609 Machine Id: 00F977EF4C00 Node Id: ph2oldb2 Class: S Type: PERM WPAR: Global Resource Name: SYSXAIXIF Description DUPLICATE IP ADDRESS DETECTED IN THE NET Failure Causes ARP RESPONSE RECEIVED FOR MY IP ADDRESS Recommended Actions CONTACT NETWORK ADMINISTRATOR Detail Data DUPLICATE IP ADDRESS A9FE 62C2 MAC ADDRESS 8EC2 E6E3 9D03 --------------------------------------------------------------------------- LABEL: AIXIF_ARP_DUP_ADDR IDENTIFIER: FE2DEE00 Date/Time: Thu Jul 26 21:00:17 BEIST 2018 Sequence Number: 1608 Machine Id: 00F977EF4C00 Node Id: ph2oldb2 Class: S Type: PERM WPAR: Global Resource Name: SYSXAIXIF Description DUPLICATE IP ADDRESS DETECTED IN THE NET Failure Causes ARP RESPONSE RECEIVED FOR MY IP ADDRESS Recommended Actions CONTACT NETWORK ADMINISTRATOR Detail Data DUPLICATE IP ADDRESS A9FE 62C2 MAC ADDRESS 8EC2 E6E3 9D03 Duplicates Number of duplicates 2 Time of first duplicate Thu Jul 26 21:00:02 BEIST 2018 Time of last duplicate Thu Jul 26 21:00:17 BEIST 2018 --------------------------------------------------------------------------- LABEL: AIXIF_ARP_DUP_ADDR IDENTIFIER: FE2DEE00 Date/Time: Thu Jul 26 20:54:07 BEIST 2018 Sequence Number: 1607 Machine Id: 00F977EF4C00 Node Id: ph2oldb2 Class: S Type: PERM WPAR: Global Resource Name: SYSXAIXIF Description DUPLICATE IP ADDRESS DETECTED IN THE NET Failure Causes ARP RESPONSE RECEIVED FOR MY IP ADDRESS Recommended Actions CONTACT NETWORK ADMINISTRATOR Detail Data DUPLICATE IP ADDRESS A9FE 62C2 MAC ADDRESS 8EC2 E6E3 9D03 Duplicates Number of duplicates 2 Time of first duplicate Thu Jul 26 20:53:55 BEIST 2018 Time of last duplicate Thu Jul 26 20:54:07 BEIST 2018 --------------------------------------------------------------------------- LABEL: AIXIF_ARP_DUP_ADDR IDENTIFIER: FE2DEE00 Date/Time: Thu Jul 26 20:49:27 BEIST 2018 Sequence Number: 1606 Machine Id: 00F977EF4C00 Node Id: ph2oldb2 Class: S Type: PERM WPAR: Global Resource Name: SYSXAIXIF Description DUPLICATE IP ADDRESS DETECTED IN THE NET Failure Causes ARP RESPONSE RECEIVED FOR MY IP ADDRESS Recommended Actions CONTACT NETWORK ADMINISTRATOR Detail Data DUPLICATE IP ADDRESS A9FE 62C2 MAC ADDRESS 8EC2 E6E3 9D03 Duplicates Number of duplicates 4 Time of first duplicate Thu Jul 26 20:49:09 BEIST 2018 Time of last duplicate Thu Jul 26 20:49:27 BEIST 2018 --------------------------------------------------------------------------- LABEL: AIXIF_ARP_DUP_ADDR IDENTIFIER: FE2DEE00 Date/Time: Thu Jul 26 20:41:57 BEIST 2018 Sequence Number: 1605 Machine Id: 00F977EF4C00 Node Id: ph2oldb2 Class: S Type: PERM WPAR: Global Resource Name: SYSXAIXIF Description DUPLICATE IP ADDRESS DETECTED IN THE NET Failure Causes ARP RESPONSE RECEIVED FOR MY IP ADDRESS Recommended Actions CONTACT NETWORK ADMINISTRATOR Detail Data DUPLICATE IP ADDRESS A9FE 62C2 MAC ADDRESS 8EC2 E6E3 9D03 --------------------------------------------------------------------------- LABEL: AIXIF_ARP_DUP_ADDR IDENTIFIER: FE2DEE00 Date/Time: Thu Jul 26 20:40:46 BEIST 2018 Sequence Number: 1604 Machine Id: 00F977EF4C00 Node Id: ph2oldb2 Class: S Type: PERM WPAR: Global Resource Name: SYSXAIXIF Description DUPLICATE IP ADDRESS DETECTED IN THE NET Failure Causes ARP RESPONSE RECEIVED FOR MY IP ADDRESS Recommended Actions CONTACT NETWORK ADMINISTRATOR Detail Data DUPLICATE IP ADDRESS A9FE 62C2 MAC ADDRESS 8EC2 E6E3 9D03 ******************* ******************* A9FE 62C2 E*16^0=14 F*16^1=15*16=240 9*16^2=2304 10*16^3=40960 169.254.98.194 *************** 禁用haip服务及haip依赖 *************** [ora12c1:root]:/>crsctl modify res ora.cluster_interconnect.haip -attr "ENABLED=0" -init [ora12c1:root]:/>d(ora.cssd,ora.ctssd)pullup(ora.cssd,ora.ctssd)weak(ora.drivers.acfs)'" -init < [ora12c1:root]:/>crsctl modify res ora.asm -attr "STOP_DEPENDENCIES='hard(intermediate:ora.cssd)'" -init *************** 关闭集群 *************** [ora12c1:root]:/>crsctl stop crs CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ora12c1' CRS-2673: Attempting to stop 'ora.crsd' on 'ora12c1' CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'ora12c1' CRS-2673: Attempting to stop 'ora.oratest.db' on 'ora12c1' CRS-2677: Stop of 'ora.oratest.db' on 'ora12c1' succeeded CRS-2673: Attempting to stop 'ora.DATADG.dg' on 'ora12c1' CRS-2673: Attempting to stop 'ora.SYSTEMDG.dg' on 'ora12c1' CRS-2673: Attempting to stop 'ora.MGMT.dg' on 'ora12c1' CRS-2673: Attempting to stop 'ora.TESTDG.dg' on 'ora12c1' CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'ora12c1' CRS-2677: Stop of 'ora.SYSTEMDG.dg' on 'ora12c1' succeeded CRS-2677: Stop of 'ora.DATADG.dg' on 'ora12c1' succeeded CRS-2677: Stop of 'ora.MGMT.dg' on 'ora12c1' succeeded CRS-2677: Stop of 'ora.TESTDG.dg' on 'ora12c1' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'ora12c1' CRS-2677: Stop of 'ora.asm' on 'ora12c1' succeeded CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'ora12c1' CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'ora12c1' succeeded CRS-2673: Attempting to stop 'ora.ora12c1.vip' on 'ora12c1' CRS-2677: Stop of 'ora.ora12c1.vip' on 'ora12c1' succeeded CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'ora12c1' succeeded CRS-2672: Attempting to start 'ora.ora12c1.vip' on 'ora12c2' CRS-2676: Start of 'ora.ora12c1.vip' on 'ora12c2' succeeded CRS-2673: Attempting to stop 'ora.ons' on 'ora12c1' CRS-2677: Stop of 'ora.ons' on 'ora12c1' succeeded CRS-2673: Attempting to stop 'ora.net1.network' on 'ora12c1' CRS-2677: Stop of 'ora.net1.network' on 'ora12c1' succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'ora12c1' has completed CRS-2677: Stop of 'ora.crsd' on 'ora12c1' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'ora12c1' CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'ora12c1' CRS-2673: Attempting to stop 'ora.crf' on 'ora12c1' CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'ora12c1' CRS-2673: Attempting to stop 'ora.gpnpd' on 'ora12c1' CRS-2673: Attempting to stop 'ora.mdnsd' on 'ora12c1' CRS-2677: Stop of 'ora.drivers.acfs' on 'ora12c1' succeeded CRS-2677: Stop of 'ora.gpnpd' on 'ora12c1' succeeded CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'ora12c1' succeeded CRS-2677: Stop of 'ora.crf' on 'ora12c1' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'ora12c1' succeeded CRS-5017: The resource action "ora.asm stop" encountered the following error: ORA-03113: end-of-file on communication channel Process ID: 21102610 Session ID: 239 Serial number: 64014 . For details refer to "(:CLSN00108:)" in "/oracle/app/grid/diag/crs/ora12c1/crs/trace/ohasd_oraagent_grid.trc". CRS-2677: Stop of 'ora.asm' on 'ora12c1' succeeded CRS-2679: Attempting to clean 'ora.asm' on 'ora12c1' CRS-2681: Clean of 'ora.asm' on 'ora12c1' succeeded CRS-2673: Attempting to stop 'ora.ctssd' on 'ora12c1' CRS-2673: Attempting to stop 'ora.evmd' on 'ora12c1' CRS-2677: Stop of 'ora.ctssd' on 'ora12c1' succeeded CRS-2677: Stop of 'ora.evmd' on 'ora12c1' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'ora12c1' CRS-2677: Stop of 'ora.cssd' on 'ora12c1' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'ora12c1' CRS-2677: Stop of 'ora.gipcd' on 'ora12c1' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ora12c1' has completed CRS-4133: Oracle High Availability Services has been stopped. *************** 启动集群 *************** [ora12c1:root]:/>crsctl stat res -t -init -------------------------------------------------------------------------------- Name Target State Server State details -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.asm 1 ONLINE ONLINE ora12c1 STABLE ora.cluster_interconnect.haip 1 ONLINE OFFLINE STABLE ora.crf 1 ONLINE ONLINE ora12c1 STABLE ora.crsd 1 ONLINE ONLINE ora12c1 STABLE ora.cssd 1 ONLINE ONLINE ora12c1 STABLE ora.cssdmonitor 1 ONLINE ONLINE ora12c1 STABLE ora.ctssd 1 ONLINE ONLINE ora12c1 OBSERVER,STABLE ora.diskmon 1 OFFLINE OFFLINE STABLE ora.drivers.acfs 1 ONLINE ONLINE ora12c1 STABLE ora.evmd 1 ONLINE ONLINE ora12c1 STABLE ora.gipcd 1 ONLINE ONLINE ora12c1 STABLE ora.gpnpd 1 ONLINE ONLINE ora12c1 STABLE ora.mdnsd 1 ONLINE ONLINE ora12c1 STABLE ora.storage 1 ONLINE ONLINE ora12c1 STABLE -------------------------------------------------------------------------------- *************** 恢复haip服务,重启集群 *************** crsctl modify res ora.cluster_interconnect.haip -attr "ENABLED=1" -init [ora12c1:root]:/>crsctl stat res -t -init -------------------------------------------------------------------------------- Name Target State Server State details -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.asm 1 ONLINE ONLINE ora12c1 Started,STABLE ora.cluster_interconnect.haip 1 ONLINE ONLINE ora12c1 STABLE ora.crf 1 ONLINE ONLINE ora12c1 STABLE ora.crsd 1 ONLINE ONLINE ora12c1 STABLE ora.cssd 1 ONLINE ONLINE ora12c1 STABLE ora.cssdmonitor 1 ONLINE ONLINE ora12c1 STABLE ora.ctssd 1 ONLINE ONLINE ora12c1 OBSERVER,STABLE ora.diskmon 1 OFFLINE OFFLINE STABLE ora.drivers.acfs 1 ONLINE ONLINE ora12c1 STABLE ora.evmd 1 ONLINE ONLINE ora12c1 STABLE ora.gipcd 1 ONLINE ONLINE ora12c1 STABLE ora.gpnpd 1 ONLINE ONLINE ora12c1 STABLE ora.mdnsd 1 ONLINE ONLINE ora12c1 STABLE ora.storage 1 ONLINE ONLINE ora12c1 STABLE -------------------------------------------------------------------------------
2、haip的子网掩码是多少,能容纳多少个主机
p1p2:1 Link encap:Ethernet HWaddr B0:26:28:6D:43:C1 inet addr:169.254.251.235 Bcast:169.254.255.255 Mask:255.255.128.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
从以上信息可以看到haip的子网掩码是255.255.128.0,即网络位是17位(169.254.251.235/17),可容纳的主机数是2^15,可用的主机数是2^15-2。
官方建议:
1.Run "crsctl stop crs" on all nodes to stop CRS stack.2. 关闭HAIP
2. On one node, run the following commands:
$CRS_HOME/bin/crsctl start crs -excl -nocrs
$CRS_HOME/bin/crsctl stop res ora.asm -init
$CRS_HOME/bin/crsctl modify res ora.cluster_interconnect.haip -attr "ENABLED=0" -init
$CRS_HOME/bin/crsctl modify res ora.asm -attr "START_DEPENDENCIES='hard(ora.cssd,ora.ctssd)pullup(ora.cssd,ora.ctssd)weak(ora.drivers.acfs)',STOP_DEPENDENCIES='hard(intermediate:ora.cssd)'" -init
$CRS_HOME/bin/crsctl stop crs4. 进一步测试
3. Repeat Step(2) on other nodes.
4. Run "crsctl start crs" on all nodes to restart CRS stack.