AWS上SUSE Linux 11 SP4添加網卡遇到的坑

目標：

     給一台EC2增加一塊新的網卡，並讓所有Internet出口都從這塊網卡走。

環境：

     AWS 北京區，AMI：suse-sles-11-sp4-v20180104-hvm-ssd-x86_64 (ami-66dc010b)

問題：

1. 添加網絡接口（Network Interface）之后，系統找不到新的網卡

具體添加一個網絡接口的步驟可以參考：

http://docs.amazonaws.cn/en_us/AWSEC2/latest/UserGuide/using-eni.html#create_eni

添加完之后，由於SUSE無法使用AWS的ec2-net-utils，所以沒有辦法直接scan到新的網卡，必須要重啟。

 

2. 新網卡名字變成 rename3

重啟完之后，系統里面會把新網卡識別為 rename3

ip-172-31-188-206:~ # ifconfig -a
eth0      Link encap:Ethernet  HWaddr 02:28:1C:C2:71:92
          inet addr:172.31.188.206  Bcast:172.31.188.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:262 errors:0 dropped:0 overruns:0 frame:0
          TX packets:272 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:30586 (29.8 Kb)  TX bytes:29102 (28.4 Kb)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:2 errors:0 dropped:0 overruns:0 frame:0
          TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:100 (100.0 b)  TX bytes:100 (100.0 b)

rename3   Link encap:Ethernet  HWaddr 02:AA:54:AC:B2:E4
          BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

ip-172-31-188-206:~ #

　　可以通過編輯 /etc/udev/rules.d70-persistent-net.rules 來修改，具體修改成如下：

SUBSYSTEM=="net", ACTION=="add", DRIVERS=="ixgbevf", ATTR{dev_id}=="0x0", KERNELS=="0000:00:03.0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth0"
SUBSYSTEM=="net", ACTION=="add", DRIVERS=="ixgbevf", ATTR{dev_id}=="0x0", KERNELS=="0000:00:04.0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth1"

　　保持后重啟。起來后就可以看到新的eth1

ip-172-31-188-206:~ # ifconfig -a
eth0      Link encap:Ethernet  HWaddr 02:28:1C:C2:71:92
          inet addr:172.31.188.206  Bcast:172.31.188.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:239 errors:0 dropped:0 overruns:0 frame:0
          TX packets:270 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:28436 (27.7 Kb)  TX bytes:29150 (28.4 Kb)

eth1      Link encap:Ethernet  HWaddr 02:AA:54:AC:B2:E4
          BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:2 errors:0 dropped:0 overruns:0 frame:0
          TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:100 (100.0 b)  TX bytes:100 (100.0 b)

 

3. 給新網卡配置IP

　　因為EC2默認都是DHCP，所以這里就直接參照eth0的配置：

　　

ip-172-31-188-206:~ # cd /etc/sysconfig/network
ip-172-31-188-206:/etc/sysconfig/network # cat ifcfg-eth0
BOOTPROTO='dhcp'
MTU="9000"
REMOTE_IPADDR=''
STARTMODE='hotplug'
ip-172-31-188-206:/etc/sysconfig/network # cp ifcfg-eth0 ifcfg-eth1

　　然后重啟網絡服務：

ip-172-31-188-206:/etc/sysconfig/network # service network restart &
[1] 3666
ip-172-31-188-206:/etc/sysconfig/network # Shutting down network interfaces:
    eth0      device: Intel Corporation 82599 Ethernet Controller V                                                                        done
    eth1      device: Intel Corporation 82599 Ethernet Controller V                                                                        done
Shutting down service network  .  .  .  .  .  .  .  .  .                                                                                   done
Hint: you may set mandatory devices in /etc/sysconfig/network/config
Setting up network interfaces:
    eth0      device: Intel Corporation 82599 Ethernet Controller V
    eth0      Starting DHCP4 client.
    eth0      IP address: 172.31.188.206/24 (ip-172-31-188-206)                                                                            done
    eth1      device: Intel Corporation 82599 Ethernet Controller V
    eth1      Starting DHCP4 client.
    eth1      IP address: 172.31.189.38/24 (ip-172-31-189-38)                                                                              done
Setting up service network  .  .  .  .  .  .  .  .  .  .                                                                                   done

[1]+  Done                    service network restart

 

　　接下來就可以看到新的網卡得到了IP：

ip-172-31-188-206:/etc/sysconfig/network # ifconfig
eth0      Link encap:Ethernet  HWaddr 02:28:1C:C2:71:92
          inet addr:172.31.188.206  Bcast:172.31.188.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:645 errors:0 dropped:0 overruns:0 frame:0
          TX packets:517 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:62966 (61.4 Kb)  TX bytes:59731 (58.3 Kb)

eth1      Link encap:Ethernet  HWaddr 02:AA:54:AC:B2:E4
          inet addr:172.31.189.38  Bcast:172.31.189.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:3 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:783 (783.0 b)  TX bytes:963 (963.0 b)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:2 errors:0 dropped:0 overruns:0 frame:0
          TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:100 (100.0 b)  TX bytes:100 (100.0 b)

 

4. 最后一步就是完成新的路由

　　新的網卡默認是沒有public IP，就算它是放在public subnet里面。所以這里可以分配一個EIP，然后assign到這個新的網絡接口上。

　　我們先看當前的route表是:

ip-172-31-188-206:/etc/sysconfig/network # netstat -rn
Kernel IP routing table
Destination     Gateway         Genmask         Flags   MSS Window  irtt Iface
0.0.0.0         172.31.188.1    0.0.0.0         UG        0 0          0 eth0
127.0.0.0       0.0.0.0         255.0.0.0       U         0 0          0 lo
169.254.0.0     0.0.0.0         255.255.0.0     U         0 0          0 eth0
172.31.188.0    0.0.0.0         255.255.255.0   U         0 0          0 eth0
172.31.189.0    0.0.0.0         255.255.255.0   U         0 0          0 eth1

　　我們的目標是內部網絡走eth0， 外部走eth1，所以安裝下面方式修改 /etc/sysconfig/network/routes

ip-172-31-188-206:/etc/sysconfig/network # cat routes
172.31.0.0/16   172.31.188.1    -       eth0
default         172.31.189.1    -       eth1

　　然后需要再次重啟一下network服務：

ip-172-31-188-206:/etc/sysconfig/network # service network restart &
[1] 3666
ip-172-31-188-206:/etc/sysconfig/network # Shutting down network interfaces:
    eth0      device: Intel Corporation 82599 Ethernet Controller V                                                                        done
    eth1      device: Intel Corporation 82599 Ethernet Controller V                                                                        done
Shutting down service network  .  .  .  .  .  .  .  .  .                                                                                   done
Hint: you may set mandatory devices in /etc/sysconfig/network/config
Setting up network interfaces:
    eth0      device: Intel Corporation 82599 Ethernet Controller V
    eth0      Starting DHCP4 client.
    eth0      IP address: 172.31.188.206/24 (ip-172-31-188-206)                                                                            done
    eth1      device: Intel Corporation 82599 Ethernet Controller V
    eth1      Starting DHCP4 client.
    eth1      IP address: 172.31.189.38/24 (ip-172-31-189-38)                                                                              done
Setting up service network  .  .  .  .  .  .  .  .  .  .                                                                                   done

[1]+  Done                    service network restart

　　新的route表就變成如下：

ip-172-31-188-206:/etc/sysconfig/network # netstat -rn
Kernel IP routing table
Destination     Gateway         Genmask         Flags   MSS Window  irtt Iface
0.0.0.0         172.31.189.1    0.0.0.0         UG        0 0          0 eth1
127.0.0.0       0.0.0.0         255.0.0.0       U         0 0          0 lo
169.254.0.0     0.0.0.0         255.255.0.0     U         0 0          0 eth0
172.31.0.0      172.31.188.1    255.255.0.0     UG        0 0          0 eth0
172.31.188.0    0.0.0.0         255.255.255.0   U         0 0          0 eth0
172.31.189.0    0.0.0.0         255.255.255.0   U         0 0          0 eth1

 

 

備注：

　　以上操作步驟均通過本人測試，但並非官方解決方案，請勿直接在生產系統上操作。