...
| Network | IP Network | VLAN ID | Description |
|---|---|---|---|
| IPMI / Management | 10.11.3.0/24 GW: 10.11.3.1 | 3003 | Connections to all IPMI interfaces on each server and the switch management interface |
| Public | 10.11.4.0/24 GW: 10.11.4.1 | 3004 | Public network (able to reach the Internet), available to each server. |
Servers and Switches
The 3 Gigabyte R281-T91 have 3 sets of dual port interfaces:
- Mellanox Technologies MT27700 on PCI-e expansion slot - two ports on PCI addresses 0000:91:00.0 and 0000:91:00.0 (enp145s0f0 and enp14s0f1)
- QLogic Corp. FastLinQ QL41000 Series integrated on the main board - two ports on PCI addresses 0000:0c:00.0 and 0000:0c:00.1 (enp12s0f0 and enp12s0f1 or eno1 and eno2)
- Intel 10G X550T on PCI-e expansion slot - two ports on PCI address 0000:05:00.0 and 0000:05:00.1 (enp5s0f0 and enp5s0f1); not connected at the moment
In the table below, the switch ports for the 3 gigabyte servers are in the following order:
- Mellanox MT27700 port 1
- Mellanox MT27700 port 0
- QLogic FaslinQ QL41000 port 0
- QLogic FaslinQ QL41000 port 1
The ampere-jumphost2 has the following network interfaces:
- Mellanox MT27710 on PCI-e expansion slot - two ports at PCI addresses 0000:01:00.0 and 0000:01:00.1 (enp1s0f0 and enp1s0f1)
- Intel Gigabit I210 on PCI-e expansion slowt - one port at PCI address 0002:01:00.0 (enP2p1s0); not connected at the moment
In the table below, the switch ports are in the following order:
- MT27710 port 1
- MT27710 port 0
| Server Name | IPMI Address | IPMI VLAN ID | Public Network Address | Public Network VLAN ID | Switch Port(s) | Serial Connection | OS Installed |
|---|---|---|---|---|---|---|---|
| gigabyte4 | 10.11.3.14 | 3003 | 10.11.4.14 | 3004 | gigabyte-edgecore2: left 40Bbe Port 1, right 40Gbe Port 2, left 10Gbe Port 7 Breakout 1, right 10Gbe Port 7 Breakout 2 | Async 1/6 | CentOS 7.6 |
| gigabyte5 | 10.11.3.15 | 3003 | 10.11.4.15 | 3004 | gigabyte-edgecore2: left 40Bbe Port 3, right 40Gbe Port 4, left 10Gbe Port 7 Breakout 3, right 10Gbe Port 7 Breakout 4 | Async 1/7 | Ubuntu 18.04 |
| gigabyte6 | 10.11.3.16 | 3003 | 10.11.4.16 | 3004 | gigabyte-edgecore2: left 40Bbe Port 5, right 40Gbe Port 6, left 10Gbe Port 8 9 Breakout 1, right 10Gbe Port 8 9 Breakout 2 | Async 1/8 | Ubuntu 18.04 |
| ampere-jumphost2 | 10.11.3.18 | 3003 | 10.11.4.18 | 3004 | gigabyte-edgecore2: left 10 Gbe Port 9 breakout 43, right 10 Gbe Port 9 breakout 34 | N/A | Ubuntu 18.04 |
| Switch Name | Mgmt Address | VLAN ID | Serial Connection | OS Installed |
|---|---|---|---|---|
| gigabyte-egdecore2 | 10.11.3.9 | 3003 | Async 1/2 | SONiC |
...