scsi_id命令發出一個SCSI INQUIRY指令給設備，訪問vital product data (VPD)頁0x83的數據，那里包含設備的WWID和其他的信息，或者頁0x80的數據，那里包含單元序列號（unit serial number）。 scsi_id命令的執行結果（一長串字符）是設備的WWID，當前映射到/dev/sdc（/sys/block/sdc）。每一條到設備的路徑和設備上的每一個分區的WWID都是相同的。設備的WWID不會改變，即使將其他的設備添加到系統或者從系統中刪除。但是，映射到/dev/sdc的設備可能會改變。這就是為什么需要創建一個靜態的設備名。可以根據WWID創建設備名。
一、 如何獲取設備WWID
(1) Redhat 5 Enterprise Linux 如下：
#/sbin/scsi_id -g -u -s /dev/sdb
Or
#/sbin/scsi_id -g -u -s /block/sdb
Shell腳本
# for i in `cat /proc/partitions | awk {'print $4'} |grep sd`; do echo "### $i: `scsi_id -g -u -s /block/$i`"; done
(2) Redhat 6 Enterprise Linux 如下：
#/sbin/scsi_id -g -u /dev/sdb
Or
#/sbin/scsi_id -g -u /block/sdb
Or
#/sbin/scsi_id --whitelist [--replace-whitespace] [ --device=] /dev/sdb
Shell腳本
# for i in `cat /proc/partitions | awk {'print $4'} |grep sd`; do echo "### $i: `scsi_id --whitelist --replace-whitespace /dev/$i`"; done
二、 寫入udev .rules
(1) 對於整個盤的綁定寫入 99-oracle-asmdevices.rules (文件名，測試可以隨便命令)
RHEL5
for i in b c d e f ;
do
echo "KERNEL==\"sd*\", BUS==\"scsi\", PROGRAM==\"/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/\$name\", RESULT==\"`/sbin/scsi_id -g -u -s /dev/sd$i`\", NAME=\"asm-disk$i\", OWNER=\"grid\", GROUP=\"asmadmin\", MODE=\"0660\"" >> /etc/udev/rules.d/99-oracle-asmdevices.rules
done
RHEL6
for i in b c d e f ;
do
echo "KERNEL==\"sd*\", BUS==\"scsi\", PROGRAM==\"/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/\$name\", RESULT==\"`/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/sd$i`\", NAME=\"asm-disk$i\", OWNER=\"grid\", GROUP=\"asmadmin\", MODE=\"0660\"" >> /etc/udev/rules.d/99-oracle-asmdevices.rules
done
Kernel [2.6.32] and later
KERNEL=="sdc", BUS=="scsi", PROGRAM=="/sbin/scsi_id -gud /dev/$name" RESULT=="1ATA_VBOX_HARDDISK_VB93327385-145dda10", SYMLINK+="asmdisk/asm-crs1", OWNER="grid", GROUP="asmadmin", MODE="0660"
OR
KERNEL=="sdc", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name" RESULT=="1ATA_VBOX_HARDDISK_VB93327385-145dda10", SYMLINK+="asmdisk/asm-crs1", OWNER="grid", GROUP="asmadmin", MODE="0660"
(2) 對於磁盤子分區的綁定
Redhat Enterprise Linux 5 用如下參數
KERNEL=="sd?[1-2]", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p", RESULT=="1ATA_VBOX_HARDDISK_VBaef9fa71-c32978c8", NAME="asm-ocr%n", OWNER="grid", GROUP="asmdba", MODE="0660"
Redhat Enterprise Linux 6 用如下參數
KERNEL=="sd?[1-2]", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u /dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VBaef9fa71-c32978c8", NAME="asm-ocr%n", OWNER="grid", GROUP="asmdba", MODE="0660"
Or
KERNEL=="sdb1", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -d /dev/$parent" RESULT=="1ATA_VBOX_HARDDISK_VB8383313d-441fd502", NAME="asm-crs1", OWNER="grid", GROUP="asmadmin", MODE="0660"
(3) 只改權限
[root@rac01 oracle]# cat /etc/udev/rules.d/99-asm-multipath.rules
PROGRAM="/bin/chown oracle:oinstall /dev/mapper/back_mpath1p1"
PROGRAM="/bin/chown oracle:oinstall /dev/mapper/back_mpath2p1"
PROGRAM="/bin/chown oracle:oinstall /dev/mapper/data_mpath1p1"
PROGRAM="/bin/chown oracle:oinstall /dev/mapper/data_mpath2p1"
三、 udev管理
# udevadm -h
# udevadm control -h
# udevadm control --reload-rules
#############################################
SUSE Linux 使用UDEV配置ASMdisk
#############################################
vzwc1:~ # uname -a
Linux vzwc1 3.0.76-0.11-default #1 SMP Fri Jun 14 08:21:43 UTC 2013 (ccab990) x86_64 x86_64 x86_64 GNU/Linux
vzwc1:~ # cat /etc/issue
Welcome to SUSE Linux Enterprise Server 11 SP3 (x86_64) - Kernel \r (\l).
添加編輯/etc/scsi_id.config 文件
options=--whitelisted --replace-whitespace
添加編輯/etc/udev/rules.d/99-oracle-asmdevices.rules
for i in b c d e f g h i
do
echo "KERNEL==\"sd*\", SUBSYSTEM==\"block\", PROGRAM==\"/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/\$name\", RESULT==\"`/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/sd$i`\", NAME=\"asm-disk$i\", OWNER=\"grid\", GROUP=\"asmadmin\", MODE=\"0660\""
done
vzwc1:~ # cat /etc/udev/rules.d/99-oracle-asmdevices.rules
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB0221f2e9-f408ff4f", NAME="asm-diskb", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB49eb0a29-3c952001", NAME="asm-diskc", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB4aa82271-74ee0a90", NAME="asm-diskd", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB2f97c868-e1906340", NAME="asm-diske", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VBf82d24e5-0f7a2eaf", NAME="asm-diskf", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB6a27197b-c6c40e34", NAME="asm-diskg", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB9b039565-b8786d7f", NAME="asm-diskh", OWNER="grid", GROUP="asmadmin", MODE="0660"
KERNEL=="sd*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB06b0cef7-cc3e6c40", NAME="asm-diski", OWNER="grid", GROUP="asmadmin", MODE="0660"
啟動udev
vzwc1:~ # /etc/init.d/boot.udev status
vzwc1:~ # /etc/init.d/boot.udev restart
Restarting udevd:
SUSE和RedHat系列不同,需要使用udevadm test測試,例如 udevadm test /sys/block/sdb
建議配置完成后重啟
vzwc1:~ # fdisk -l
Disk /dev/sda: 42.9 GB, 42949672960 bytes
255 heads, 63 sectors/track, 5221 cylinders, total 83886080 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x0002a75e
Device Boot Start End Blocks Id System
/dev/sda1 2048 8386559 4192256 82 Linux swap / Solaris
/dev/sda2 * 8386560 8787967 200704 83 Linux
/dev/sda3 8787968 83886079 37549056 83 Linux
vzwc1:~ # ll /dev/sd*
brw-rw---- 1 root disk 8, 0 Dec 30 13:56 /dev/sda
brw-rw---- 1 root disk 8, 1 Dec 30 13:56 /dev/sda1
brw-rw---- 1 root disk 8, 2 Dec 30 13:56 /dev/sda2
brw-rw---- 1 root disk 8, 3 Dec 30 13:56 /dev/sda3
vzwc1:~ #
vzwc1:~ # l /dev/asm-disk*
brw-rw---- 1 grid asmadmin 8, 16 Dec 30 13:56 /dev/asm-diskb
brw-rw---- 1 grid asmadmin 8, 32 Dec 30 13:56 /dev/asm-diskc
brw-rw---- 1 grid asmadmin 8, 48 Dec 30 13:56 /dev/asm-diskd
brw-rw---- 1 grid asmadmin 8, 64 Dec 30 13:56 /dev/asm-diske
brw-rw---- 1 grid asmadmin 8, 80 Dec 30 13:56 /dev/asm-diskf
brw-rw---- 1 grid asmadmin 8, 96 Dec 30 13:56 /dev/asm-diskg
brw-rw---- 1 grid asmadmin 8, 112 Dec 30 13:56 /dev/asm-diskh
brw-rw---- 1 grid asmadmin 8, 128 Dec 30 13:56 /dev/asm-diski
#############################################
案例一則：IBM multipath多路徑+VCS雙機+udev方式+LVM
#############################################
1、查看多路徑
AEP11:/etc/multipath # multipath -ll | grep IBM
3600507680c800091180000000000022e dm-2 IBM ,2145
3600507680c800091180000000000022d dm-1 IBM ,2145
3600507680c800091180000000000022c dm-0 IBM ,2145
2、配置多路徑別名
備注：因機器上無/etc/multipath.conf(不明原因)，從其他主機(OS版本不同)拷貝/etc/multipath.conf，僅用multipath.conf配置文件中的別名部分配置，如下所示：
AEP11:/etc/multipath # cat /etc/multipath.conf
multipaths {
multipath {
wwid 3600507680c800091180000000000022c
alias aep_diska
}
multipath {
wwid 3600507680c800091180000000000022d
alias aep_diskb
}
multipath {
wwid 3600507680c800091180000000000022e
alias aep_diskc
}
}
重新生成多路徑設備：
multipath -F
multipath -v2
3、查看重新生成的多路徑設備
AEP11:~ # multipath -ll | grep aep
aep_diskc (3600507680c800091180000000000022e) dm-2 IBM ,2145
aep_diskb (3600507680c800091180000000000022d) dm-1 IBM ,2145
aep_diska (3600507680c800091180000000000022c) dm-0 IBM ,2145
4、udev方式綁定多路徑
AEP11:~ # cat /etc/udev/rules.d/99-aep-devices.rules
KERNEL=="dm*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="3600507680c800091180000000000022c", NAME="aep_diska"
KERNEL=="dm*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="3600507680c800091180000000000022d", NAME="aep_diskb"
KERNEL=="dm*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="3600507680c800091180000000000022e", NAME="aep_diskc"
備注：如加權限，則可類似如下：
KERNEL=="dm*", SUBSYSTEM=="block", PROGRAM=="/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="3600507680c800091180000000000022c", NAME="aep_diska", OWNER="grid", GROUP="asmadmin", MODE="0660"
-- 重新加載配置文件
AEP11:~ # udevadm control --reload-rules
-- 使規則生效，生成udev設備文件
AEP11:~ # udevadm trigger
5、查看綁定的設備：
# ls -lrt /dev/aep_disk*
6、創建pv
AEP11:~ # pvcreate /dev/aep_disk{a,b,c}
AEP11:~ # pvs
注意：因操作的主機AEP11是雙機，所以除去步驟6創建pv之外，其他步驟都需在主備機上操作。