Introduction
Unicycle pods are deployed from an existing Regional Controller and consist of 3 master nodes and 0 to 4 worker nodes. The number of nodes may be increased after validation in subsequent releases.
A number of different options exist including the choice of Dell or HP servers and whether to support tenant VM networking with an OVS-DPDK or SR-IOV data plane. The choice of which is deployed is achieved by simply creating different pod specific yaml input files.
In R1 the options include
Blueprint | Servers | Dataplane | Validated HW details | Validated by |
---|---|---|---|---|
Unicycle | Dell 740XD | OVS-DPDK | Dell 740XD Detailed Specification | Ericsson |
Unicycle | Dell 740XD | SR-IOV | <INSERT LINK TO ATT DELL SERVER SPEC> | AT&T |
Ericsson | ||||
Unicycle | HP 380 Gen10 | SR-IOV | <INSERT LINK TO ATT HP SERVER SPEC> | AT&T |
Preflight Requirements
Servers
Deployment has been validated on two types of servers, Dell and HP.
The exact server specifications used during validation activities are defined in links in the table above. Whilst the blueprint allows for variation in the servers, since the installation includes provisioning of BIOS and HW specific components such as NICs, SSDs, HDDs, CPUs etc only these exact server types are supported and validated in the R1 release.
A unicycle pod deployment consists of at least 3 servers for the master nodes (that can also run tenant VM workloads and 0 to 4 dedicated worker nodes.
Networking
The automated deployment process configures all aspects of the servers including BIOS, linux operating system and Network Cloud specific software. The deployment and configuration of all external switching components is outside the scope of the R1 release and must be completed as a pre-requisite before attempting a unicycle pods deployment.
Details of the networking is given in the Network Architecture section and that used during the validation in the ATT Validation Labs and Ericsson Validation Labs sections of the release documentation.
Software
When a unicycle pod's nodes are installed on a new bare metal server no software is required on the Target Server. All software will be installed from the Build Server and/or external repos via the internet.
Generate RC ssh Key Pair
In order for the RC to ssh into the Unicycle nodes during the deployment process a ssh key pair must be generated on the RC then the public key must be inserted into the Unicycle pods's site specific input file.
root@regional_server# ssh-keygen -t rsa ..... root@regional_server# cd /root/.ssh root@regional_server# ls -lrt total 12 -rw------- 1 root root 399 May 26 00:34 authorized_keys -rw-r--r-- 1 root root 395 May 26 00:55 id_rsa.pub -rw------- 1 root root 1679 May 26 00:55 id_rsa
Preflight Checks
Preflight Unicycle Pod Specific Input Data
Unicycle Pods with OVS-DPDK Dataplane
Unicycle Pods with SR-IOV Dataplane
Deploying a Unicycle Pod
Example Unicycle Pod Configuration Input Files
This section contains the input files used to build the Unicycle pods in ATT's and Ericsson's validation labs for the R1 release. Being pods and site specific the enumerated values will differ. Full details of the relevant validation lab setup that should be referenced when looking at these files is contained in the Validation Labs section of this documentation.
Unicycle Pods with OVS-DPDK Dataplane on Dell 740XD servers
This section includes a sample input file that was used in the Ericsson Validation Lab to deploy a Unicycle pod with an OVS_DPDK dataplane.
Please reference the following lab configuration Ericsson Unicycle OVS-DPDK Validation HW, Networking and IP plan.
site_name: akraino-ki20 site_type: ovsdpdk # Note this field defines the dataplane to be deployed as OVS-DPDK ipmi_admin: username: root password: calvin networks: bonded: yes primary: bond0 slaves: - name: enp95s0f0 - name: enp95s0f1 oob: vlan: 400 # Note this VID is not used by current network cloud deployment process interface: cidr: 10.51.35.128/27 # Note this subnet mask length is used by the deployment scripts netmask: 255.255.255.224 # Note this subnet mask is used by the deployment scripts routes: gateway: 10.51.35.129 ranges: reserved: start: 10.51.35.153 end: 10.51.35.158 static: start: 10.51.35.132 end: 10.51.35.152 host: vlan: 408 interface: bond0.408 cidr: 10.51.34.224/27 # Note this subnet mask length is used by the deployment scripts subnet: 10.51.34.224 netmask: 255.255.255.224 # Note this subnet mask is used by the deployment scripts routes: gateway: 10.51.34.225 ranges: reserved: start: 10.51.34.226 end: 10.51.34.228 static: start: 10.51.34.229 end: 10.51.34.235 storage: vlan: 23 interface: bond0.23 cidr: 10.224.174.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1 #netmask: 255.255.255.0 - Not Used ranges: reserved: start: 10.224.174.1 end: 10.224.174.10 static: start: 10.224.174.11 end: 10.224.174.254 pxe: vlan: 407 interface: eno3 cidr: 10.224.168.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1 #netmask: 255.255.255.0 - Not Used gateway: 10.224.168.1 routes: gateway: 10.224.168.12 #This address is the PXE interface of the Genesis Node. ranges: reserved: start: 10.224.168.1 end: 10.224.168.10 static: start: 10.224.168.11 end: 10.224.168.200 dhcp: start: 10.224.168.201 end: 10.224.168.254 ksn: vlan: 22 interface: bond0.22 cidr: 10.224.160.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1 #netmask: 255.255.255.0 - Not Used local_asnumber: 65531 # Note: this is the ASN of the k8s calico network ranges: static: start: 10.224.160.134 end: 10.224.160.254 additional_cidrs: - 10.224.160.200/29 ingress_cidr: 10.224.160.201/32 peers: - ip: 10.224.160.129 # Note: this is the IP address of the external fabric bgp router scope: global asnumber: 65001 # Note: this is the ASN of the external fabric bgp router vrrp_ip: 10.224.160.129 # keep peers ip address in case of only peer. neutron: vlan: 24 interface: bond0.24 cidr: 10.224.171.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1 #netmask: 255.255.255.0 - Not Used ranges: reserved: start: 10.224.171.1 end: 10.224.171.10 static: start: 10.224.171.11 end: 10.224.171.254 vxlan: vlan: 1 # Note this VID value defines that the dataplane interface is untagged and is the only supported option in R1 interface: enp134s0f0 #Note this is a single port and LAG is not support with an OVS-DPDK dataplane in r1 cidr: 10.224.169.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1 #netmask: 255.255.255.0 - Not Used ranges: reserved: start: 10.224.169.1 end: 10.224.169.10 static: start: 10.224.169.11 end: 10.224.169.254 dns: upstream_servers: - 10.64.73.100 - 10.64.73.101 - 10.51.40.100 ingress_domain: vran.k2.ericsson.se domain: vran.k2.ericsson.se ################################################################################################################# #Note: The 'dpdk' statement below defines the deployment of and OVS-DPDK dataplane instead of an SR-IOV dataplane dpdk: nics: - name: dpdk0 pci_id: '0000:86:00.0' bridge: br-phy migrate_ip: true ################################################################################################################# storage: osds: - data: /dev/sda journal: /var/lib/ceph/journal/journal-sda - data: /dev/sdb journal: /var/lib/ceph/journal/journal-sdb - data: /dev/sdc journal: /var/lib/ceph/journal/journal-sdc - data: /dev/sdd journal: /var/lib/ceph/journal/journal-sdd - data: /dev/sde journal: /var/lib/ceph/journal/journal-sde - data: /dev/sdf journal: /var/lib/ceph/journal/journal-sdf osd_count: 6 total_osd_count: 18 genesis: name : aknode23 oob: 10.51.35.143 host: 10.51.34.233 storage: 10.224.174.12 pxe: 10.224.168.12 ksn: 10.224.160.135 neutron: 10.224.171.12 vxlan: 10.224.169.12 root_password: akraino,d masters: - name: aknode31 oob: 10.51.35.147 host: 10.51.34.229 storage: 10.224.174.13 pxe: 10.224.168.13 ksn: 10.224.160.136 neutron: 10.224.171.13 vxlan: 10.224.169.13 oob_user: root oob_password: calvin - name : aknode25 oob: 10.51.35.144 host: 10.51.34.232 storage: 10.224.174.11 pxe: 10.224.168.11 ksn: 10.224.160.134 neutron: 10.224.171.11 vxlan: 10.224.169.11 oob_user: root oob_password: calvin #workers: # - name : aknode32 # Note not verified in this validation lab in R1 # oob: 10.51.35.148 # host: 10.51.34.234 # storage: 10.224.174.14 # pxe: 10.224.168.14 # ksn: 10.224.160.137 # neutron: 10.224.171.14 # oob_user: root # oob_password: calvin # - name : aknode33 # Note not verified in this validation lab in R1 # oob: 10.51.35.149 # host: 10.51.34.235 # storage: 10.224.174.15 # pxe: 10.224.168.15 # ksn: 10.224.160.138 # neutron: 10.224.171.15 # oob_user: root # oob_password: calvin platform: # vcpu_pin_set: "4-21,26-43,48-65,72-87" kernel_params: hugepagesz: '1G' hugepages: 32 # default_hugepagesz: '1G' # transparent_hugepage: 'never' iommu: 'pt' intel_iommu: 'on' # amd_iommu: 'on' # console: 'ttyS1,115200n8' ########################################################################################### #Note: This section defines the use of Dell servers and their installed HW and BIOS version hardware: vendor: DELL generation: '10' hw_version: '3' bios_version: '2.8' bios_template: dell_r740_g14_uefi_base.xml.template boot_template: dell_r740_g14_uefi_httpboot.xml.template http_boot_device: NIC.Slot.2-1-1 ########################################################################################### disks: - name : sdg labels: bootdrive: 'true' partitions: - name: root size: 20g mountpoint: / - name: boot size: 1g mountpoint: /boot - name: var size: 100g mountpoint: /var - name : sdh partitions: - name: ceph size: 300g mountpoint: /var/lib/ceph/journal disks_compute: - name : sdg labels: bootdrive: 'true' partitions: - name: root size: 20g mountpoint: / - name: boot size: 1g mountpoint: /boot - name: var size: '>300g' mountpoint: /var - name : sdh partitions: - name: nova size: '99%' mountpoint: /var/lib/nova # Note: the key below must be generate each time a new RC is installed and inserted intot he input file of any pods deployed by that RC genesis_ssh_public_key: "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+iukrMrXSPOnnz89BHQ0UWMb71OLhSb5byh4wPpjSHtqmTV7xsg0WWUId5K8ejqL+X1FKPdTlozY1Jy6LHq9yWu+nvSdCdcV5CnrodgNCIiY6z4B9Mhf3BoN9ADQtZKH7EpAzGiqYvncrZTwHlmIyc9ff8HxusWut1vKn8EJ96a07wybRpjOlblehSESTD6qyUxUGt6hrJZY/FXHJ+JvpogI55i0La9pt94RQVg8wOi1DqPWavOZzRT35A7bziKk79IoGOGnW9H+K5x7hiRFw1wrPoJrd1ixgLyg+UUwgZlDCf5AhDyajmb8rtDLckVFcw8KPuj7weGGFD7gqOw1N root@aknode29" kubernetes: api_service_ip: 10.96.0.1 etcd_service_ip: 10.96.0.2 pod_cidr: 10.98.0.0/16 service_cidr: 10.96.0.0/15 regional_server: ip: 10.51.34.230 # Note: this is the host IP address of the Regional Controller that is being used to deploy this unicycle pod
Unicycle Pods with SR-IOV Dataplane on Dell 740XD servers
This section includes a sample input file that was used in the Ericsson Validation Lab to deploy a Unicycle pod with a SR-IOV dataplane.
Please reference the following lab configuration Ericsson Unicycle SR-IOV Validation HW, Networking and IP plan.
site_name: akraino-ki20 ipmi_admin: username: root password: calvin networks: bonded: yes primary: bond0 slaves: - name: enp95s0f0 - name: enp95s0f1 oob: vlan: 400 # Note this VID is not used by current network cloud deployment process interface: cidr: 10.51.35.128/27 # Note this subnet mask length is used by the deployment scripts netmask: 255.255.255.224 routes: gateway: 10.51.35.129 ranges: reserved: start: 10.51.35.153 end: 10.51.35.158 static: start: 10.51.35.132 end: 10.51.35.152 host: vlan: 408 interface: bond0.408 cidr: 10.51.34.224/27 # Note this subnet mask length is used by the deployment scripts subnet: 10.51.34.224 netmask: 255.255.255.224 routes: gateway: 10.51.34.225 ranges: reserved: start: 10.51.34.226 end: 10.51.34.228 static: start: 10.51.34.229 end: 10.51.34.235 storage: vlan: 23 interface: bond0.23 cidr: 10.224.174.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1 #netmask: 255.255.255.0 - Not Used ranges: reserved: start: 10.224.174.1 end: 10.224.174.10 static: start: 10.224.174.11 end: 10.224.174.254 pxe: vlan: 407 interface: eno3 cidr: 10.224.168.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1 #netmask: 255.255.255.0 - Not Used gateway: 10.224.168.1 routes: gateway: 10.224.168.12 #This address is the PXE interface address of the Genesis Node. ranges: reserved: start: 10.224.168.2 end: 10.5224.168.10 static: start: 10.224.168.11 end: 10.224.168.200 dhcp: start: 10.224.168.201 end: 10.224.168.254 ksn: vlan: 22 interface: bond0.22 cidr: 10.224.160.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1 #netmask: 255.255.255.0 - Not Used local_asnumber: 65531 # Note: this is the ASN of the k8s calico network ranges: static: start: 10.224.160.134 end: 10.224.160.254 additional_cidrs: - 10.224.160.200/29 ingress_cidr: 10.224.160.201/32 peers: - ip: 10.224.160.129 # Note: this is the IP address of the external fabric bgp router scope: global asnumber: 65001 # Note: this is the ASN of the external fabric bgp router vrrp_ip: 10.224.160.129 # keep peers ip address in case of only peer. neutron: vlan: 24 interface: bond0.24 cidr: 10.224.171.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1 #netmask: 255.255.255.0 - Not Used ranges: reserved: start: 10.224.171.1 end: 10.224.171.10 static: start: 10.224.171.11 end: 10.224.171.254 dns: upstream_servers: - 10.64.73.100 - 10.64.73.101 - 10.51.40.100 ingress_domain: vran.k2.ericsson.se domain: vran.k2.ericsson.se #################################################################################################################### #Note: The 'sriovnets' statement below defines the deployment of a SR-IOV dataplane instead of an OVS-DPDK dataplane sriovnets: - physical: sriovnet1 interface: enp134s0f0 vlan_start: 2001 vlan_end: 3000 whitelists: - "address": "0000:86:02.0" - "address": "0000:86:02.1" - "address": "0000:86:03.2" - "address": "0000:86:03.3" - "address": "0000:86:03.4" - "address": "0000:86:03.5" - "address": "0000:86:03.6" - "address": "0000:86:03.7" - "address": "0000:86:04.0" - "address": "0000:86:04.1" - "address": "0000:86:04.2" - "address": "0000:86:04.3" - "address": "0000:86:02.2" - "address": "0000:86:04.4" - "address": "0000:86:04.5" - "address": "0000:86:04.6" - "address": "0000:86:04.7" - "address": "0000:86:05.0" - "address": "0000:86:05.1" - "address": "0000:86:05.2" - "address": "0000:86:05.3" - "address": "0000:86:05.4" - "address": "0000:86:05.5" - "address": "0000:86:02.3" - "address": "0000:86:05.6" - "address": "0000:86:05.7" - "address": "0000:86:02.4" - "address": "0000:86:02.5" - "address": "0000:86:02.6" - "address": "0000:86:02.7" - "address": "0000:86:03.0" - "address": "0000:86:03.1" - physical: sriovnet2 interface: enp134s0f1 vlan_start: 2001 vlan_end: 3000 whitelists: - "address": "0000:86:0a.0" - "address": "0000:86:0a.1" - "address": "0000:86:0b.2" - "address": "0000:86:0b.3" - "address": "0000:86:0b.4" - "address": "0000:86:0b.5" - "address": "0000:86:0b.6" - "address": "0000:86:0b.7" - "address": "0000:86:0c.0" - "address": "0000:86:0c.1" - "address": "0000:86:0c.2" - "address": "0000:86:0c.3" - "address": "0000:86:0a.2" - "address": "0000:86:0c.4" - "address": "0000:86:0c.5" - "address": "0000:86:0c.6" - "address": "0000:86:0c.7" - "address": "0000:86:0d.0" - "address": "0000:86:0d.1" - "address": "0000:86:0d.2" - "address": "0000:86:0d.3" - "address": "0000:86:0d.4" - "address": "0000:86:0d.5" - "address": "0000:86:0a.3" - "address": "0000:86:0d.6" - "address": "0000:86:0d.7" - "address": "0000:86:0a.4" - "address": "0000:86:0a.5" - "address": "0000:86:0a.6" - "address": "0000:86:0a.7" - "address": "0000:86:0b.0" - "address": "0000:86:0b.1" #################################################################################################################### storage: osds: - data: /dev/sda journal: /var/lib/ceph/journal/journal-sda - data: /dev/sdb journal: /var/lib/ceph/journal/journal-sdb - data: /dev/sdc journal: /var/lib/ceph/journal/journal-sdc - data: /dev/sdd journal: /var/lib/ceph/journal/journal-sdd - data: /dev/sde journal: /var/lib/ceph/journal/journal-sde - data: /dev/sdf journal: /var/lib/ceph/journal/journal-sdf osd_count: 6 total_osd_count: 18 genesis: name : aknode23 oob: 10.51.35.143 host: 10.51.34.233 storage: 10.224.174.12 pxe: 10.224.168.12 ksn: 10.224.160.135 neutron: 10.224.171.12 root_password: akraino,d masters: - name: aknode31 oob: 10.51.35.147 host: 10.51.34.229 storage: 10.224.174.13 pxe: 10.224.168.13 ksn: 10.224.160.136 neutron: 10.224.171.13 oob_user: root oob_password: calvin - name : aknode25 oob: 10.51.35.144 host: 10.51.34.232 storage: 10.224.174.11 pxe: 10.224.168.11 ksn: 10.224.160.134 neutron: 10.224.171.11 oob_user: root oob_password: calvin #workers: # - name : aknode32 # Note not verified in this validation lab in R1 # oob: 10.51.35.148 # host: 10.51.34.234 # storage: 10.224.174.14 # pxe: 10.224.168.14 # ksn: 10.224.160.137 # neutron: 10.224.171.14 # oob_user: root # oob_password: calvin # - name : aknode33 # Note not verified in this validation lab in R1 # oob: 10.51.35.149 # host: 10.51.34.235 # storage: 10.224.174.15 # pxe: 10.224.168.15 # ksn: 10.224.160.138 # neutron: 10.224.171.15 # oob_user: root # oob_password: calvin ########################################################################################### #Note: This section defines the use of Dell servers and their installed HW and BIOS version hardware: vendor: DELL generation: '10' hw_version: '3' bios_version: '2.8' bios_template: dell_r740_g14_uefi_base.xml.template boot_template: dell_r740_g14_uefi_httpboot.xml.template http_boot_device: NIC.Slot.2-1-1 ########################################################################################### disks: - name : sdg labels: bootdrive: 'true' partitions: - name: root size: 20g mountpoint: / - name: boot size: 1g mountpoint: /boot - name: var size: 100g mountpoint: /var - name : sdh partitions: - name: ceph size: 300g mountpoint: /var/lib/ceph/journal disks_compute: - name : sdg labels: bootdrive: 'true' partitions: - name: root size: 20g mountpoint: / - name: boot size: 1g mountpoint: /boot - name: var size: '>300g' mountpoint: /var - name : sdh partitions: - name: nova size: '99%' mountpoint: /var/lib/nova # Note: the key below must be generate each time a new RC is installed and inserted intot he input file of any pods deployed by that RC genesis_ssh_public_key: "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCos1E/53FhubxPOXncxByAI5WCyyt0UBhsBGCPlp5J5gM8vMZEX9pJI3uY/5R8z6crtuW9aneSQ9kZTkksGNoohWZDmLRymfJOOtfs5TlpRGvKAHMnYthDexeCKQixbrf0/9dzAUalzveM025D2ZJSM3mQ9kDr6Pn4220Lbsez50CzH9dKRNKzydDTvuwOi0unTQf9DNNc9WzDTO83UwmGVtR2mIq8ZXOd1G4To3cT0P487NezsRrCtscbdoe4YdAW9h7wxNC1saZNbx2kARIOjO79bKT1U+j9XQZTuHKbzhLxXqqUkEGfmqGvA1H6iAMPl4Hz8itM0veW63Zolwg/ root@aknode29" kubernetes: api_service_ip: 10.96.0.1 etcd_service_ip: 10.96.0.2 pod_cidr: 10.98.0.0/16 service_cidr: 10.96.0.0/15 regional_server: ip: 10.51.34.230 # Note: this is the host IP address of the Regional Controller that is being used to deploy this unicycle pod
Unicycle Pods with SR-IOV Dataplane on HP DL380 servers
This section includes a sample input file that was used in the ATT Validation Lab to deploy a Unicycle pod with an SR-IOV dataplane.
############################################################################## 3 # Copyright (c) 2018 AT&T Intellectual Property. All rights reserved. # 4 # # 5 # Licensed under the Apache License, Version 2.0 (the "License"); you may # 6 # not use this file except in compliance with the License. # 7 # # 8 # You may obtain a copy of the License at # 9 # http://www.apache.org/licenses/LICENSE-2.0 # 10 # # 11 # Unless required by applicable law or agreed to in writing, software # 12 # distributed under the License is distributed on an "AS IS" BASIS, WITHOUT # 13 # WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # 14 # See the License for the specific language governing permissions and # 15 # limitations under the License. # 16 ############################################################################## 17 18 site_name: hpgen10 19 site_type: sriov 20 ipmi_admin: 21 username: Administrator 22 password: Admin123 23 networks: 24 bonded: yes 25 primary: bond0 26 slaves: 27 - name: ens3f0 28 - name: ens3f1 29 oob: 30 vlan: 40 31 interface: 32 cidr: 192.168.41.0/24 33 routes: 34 gateway: 192.168.41.1 35 ranges: 36 reserved: 37 start: 192.168.41.2 38 end: 192.168.41.4 39 static: 40 start: 192.168.41.5 41 end: 192.168.41.254 42 host: 43 vlan: 41 44 interface: bond0.41 45 cidr: 192.168.2.0/24 46 routes: 47 gateway: 192.168.2.200 48 ranges: 49 reserved: 50 start: 192.168.2.84 51 end: 192.168.2.86 52 static: 53 start: 192.168.2.1 54 end: 192.168.2.83 55 storage: 56 vlan: 42 57 interface: bond0.42 58 cidr: 172.31.1.0/24 59 ranges: 60 static: 61 start: 172.31.1.2 62 end: 172.31.1.254 63 pxe: 64 vlan: 65 interface: eno1 66 cidr: 172.30.1.0/24 67 gateway: 172.30.1.1 68 routes: 69 gateway: 172.30.1.30 70 ranges: 71 reserved: 72 start: 172.30.1.1 73 end: 172.30.1.10 74 static: 75 start: 172.30.1.11 76 end: 172.30.1.200 77 dhcp: 78 start: 172.30.1.201 79 end: 172.30.1.254 80 ksn: 81 vlan: 44 82 interface: bond0.44 83 cidr: 172.29.1.0/24 84 local_asnumber: 65531 85 ranges: 86 static: 87 start: 172.29.1.5 88 end: 172.29.1.254 89 additional_cidrs: 90 - 172.29.1.136/29 91 ingress_cidr: 172.29.1.137/32 92 peers: 93 - ip: 172.29.1.1 94 scope: global 95 asnumber: 65001 96 vrrp_ip: 172.29.1.1 # keep peers ip address in case of only peer. 97 neutron: 98 vlan: 45 99 interface: bond0.45 100 cidr: 10.0.101.0/24 101 ranges: 102 static: 103 start: 10.0.101.2 104 end: 10.0.101.254 105 dns: 106 upstream_servers: 107 - 192.168.2.85 108 - 8.8.8.8 109 - 8.8.8.8 110 ingress_domain: hpgen10.akraino.org 111 domain: lab.akraino.org 112 gpu: 113 alias: 114 - name: "P4" 115 product_id: "1bb2" 116 vendor_id: "10de" 117 - name: "P40" 118 product_id: "1b38" 119 vendor_id: "10de" 120 - name: "P100" 121 product_id: "15f8" 122 vendor_id: "10de" 123 - name: "V100" 124 product_id: "1db4" 125 vendor_id: "10de" 126 sriov: 127 alias: 128 - name: "numa0" 129 product_id: "158b" 130 vendor_id: "8086" 131 nets: 132 - physical: sriovnet1 133 interface: ens6f0 134 vlan_start: 2001 135 vlan_end: 3000 136 whitelists: 137 - "address": "0000:af:02.0" 138 - "address": "0000:af:02.1" 139 - "address": "0000:af:02.2" 140 - "address": "0000:af:02.3" 141 - "address": "0000:af:02.4" 142 - "address": "0000:af:02.5" 143 - "address": "0000:af:02.6" 144 - "address": "0000:af:02.7" 145 - "address": "0000:af:03.0" 146 - "address": "0000:af:03.1" 147 - "address": "0000:af:03.2" 148 - "address": "0000:af:03.3" 149 - "address": "0000:af:03.4" 150 - "address": "0000:af:03.5" 151 - "address": "0000:af:03.6" 152 - "address": "0000:af:03.7" 153 - "address": "0000:af:04.0" 154 - "address": "0000:af:04.1" 155 - "address": "0000:af:04.2" 156 - "address": "0000:af:04.3" 157 - "address": "0000:af:04.4" 158 - "address": "0000:af:04.5" 159 - "address": "0000:af:04.6" 160 - "address": "0000:af:04.7" 161 - "address": "0000:af:05.0" 162 - "address": "0000:af:05.1" 163 - "address": "0000:af:05.2" 164 - "address": "0000:af:05.3" 165 - "address": "0000:af:05.4" 166 - "address": "0000:af:05.5" 167 - "address": "0000:af:05.6" 168 - "address": "0000:af:05.7" 169 - physical: sriovnet2 170 interface: ens6f1 171 vlan_start: 2001 172 vlan_end: 3000 173 whitelists: 174 - "address": "0000:af:0a.0" 175 - "address": "0000:af:0a.1" 176 - "address": "0000:af:0a.2" 177 - "address": "0000:af:0a.3" 178 - "address": "0000:af:0a.4" 179 - "address": "0000:af:0a.5" 180 - "address": "0000:af:0a.6" 181 - "address": "0000:af:0a.7" 182 - "address": "0000:af:0b.0" 183 - "address": "0000:af:0b.1" 184 - "address": "0000:af:0b.2" 185 - "address": "0000:af:0b.3" 186 - "address": "0000:af:0b.4" 187 - "address": "0000:af:0b.5" 188 - "address": "0000:af:0b.6" 189 - "address": "0000:af:0b.7" 190 - "address": "0000:af:0c.0" 191 - "address": "0000:af:0c.1" 192 - "address": "0000:af:0c.2" 193 - "address": "0000:af:0c.3" 194 - "address": "0000:af:0c.4" 195 - "address": "0000:af:0c.5" 196 - "address": "0000:af:0c.6" 197 - "address": "0000:af:0c.7" 198 - "address": "0000:af:0d.0" 199 - "address": "0000:af:0d.1" 200 - "address": "0000:af:0d.2" 201 - "address": "0000:af:0d.3" 202 - "address": "0000:af:0d.4" 203 - "address": "0000:af:0d.5" 204 - "address": "0000:af:0d.6" 205 - "address": "0000:af:0d.7" 206 storage: 207 osds: 208 - data: /dev/sdb 209 journal: /var/lib/ceph/journal/journal-sdb 210 - data: /dev/sdc 211 journal: /var/lib/ceph/journal/journal-sdc 212 - data: /dev/sdd 213 journal: /var/lib/ceph/journal/journal-sdd 214 - data: /dev/sde 215 journal: /var/lib/ceph/journal/journal-sde 216 - data: /dev/sdf 217 journal: /var/lib/ceph/journal/journal-sdf 218 - data: /dev/sdg 219 journal: /var/lib/ceph/journal/journal-sdg 220 - data: /dev/sdh 221 journal: /var/lib/ceph/journal/journal-sdh 222 - data: /dev/sdi 223 journal: /var/lib/ceph/journal/journal-sdi 224 osd_count: 8 225 total_osd_count: 24 226 genesis: 227 name: aknode30 228 oob: 192.168.41.130 229 host: 192.168.2.30 230 storage: 172.31.1.30 231 pxe: 172.30.1.30 232 ksn: 172.29.1.30 233 neutron: 10.0.101.30 234 root_password: akraino,d 235 mac_address: 3c:fd:fe:aa:90:b0 236 masters: 237 - name : aknode31 238 oob: 192.168.41.131 239 host: 192.168.2.31 240 storage: 172.31.1.31 241 pxe: 172.30.1.31 242 ksn: 172.29.1.31 243 neutron: 10.0.101.31 244 oob_user: Administrator 245 oob_password: Admin123 246 - name : aknode32 247 oob: 192.168.41.132 248 host: 192.168.2.32 249 storage: 172.31.1.32 250 pxe: 172.30.1.32 251 ksn: 172.29.1.32 252 neutron: 10.0.101.32 253 oob_user: Administrator 254 oob_password: Admin123 255 #workers: 256 # - name : aknode33 257 # oob: 192.168.41.133 258 # host: 192.168.2.33 259 # storage: 172.31.1.33 260 # pxe: 172.30.1.33 261 # ksn: 172.29.1.33 262 # neutron: 10.0.101.33 263 platform: 264 vcpu_pin_set: "4-21,26-43,48-65,72-87" 265 kernel_params: 266 hugepagesz: '1G' 267 hugepages: 32 268 # default_hugepagesz: '1G' 269 transparent_hugepage: 'never' 270 iommu: 'pt' 271 intel_iommu: 'on' 272 amd_iommu: 'on' 273 # console: 'ttyS1,115200n8' 274 hardware: 275 vendor: HP 276 generation: '10' 277 hw_version: '3' 278 bios_version: '2.8' 279 bios_template: hpe_dl380_g10_uefi_base.json.template 280 boot_template: hpe_dl380_g10_uefi_httpboot.json.template 281 http_boot_device: NIC.Slot.3-1-1 282 disks: 283 - name : sdj 284 labels: 285 bootdrive: 'true' 286 partitions: 287 - name: root 288 size: 20g 289 mountpoint: / 290 - name: boot 291 size: 1g 292 mountpoint: /boot 293 - name: var 294 size: '>300g' 295 mountpoint: /var 296 - name : sdk 297 partitions: 298 - name: ceph 299 size: 300g 300 mountpoint: /var/lib/ceph/journal 301 disks_compute: 302 - name : sdj 303 labels: 304 bootdrive: 'true' 305 partitions: 306 - name: root 307 size: 20g 308 mountpoint: / 309 - name: boot 310 size: 1g 311 mountpoint: /boot 312 - name: var 313 size: '>300g' 314 mountpoint: /var 315 - name : sdk 316 partitions: 317 - name: nova 318 size: '99%' 319 mountpoint: /var/lib/nova 320 genesis_ssh_public_key: "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/n4mNLAj3XKG2fcm+8eVe0NUlNH0g8DA8KJ53rSLKccm8gm4UgLmGOJyBfUloQZMuOpU6a+hexN4ECCliqI7+KUmgJgsvLkJ3OUMNTEVu9tDX5mdXeffsufaqFkAdmbJ/9PMPiPQ3/UqbbtyEcqoZAwUWf4ggAWSp00SGE1Okg+skPSbDzPVHb4810eXZT1yoIg29HAenJNNrsVxvnMT2kw2OYmLfxgEUh1Ev4c5LnUog4GXBDHQtHAwaIoTu9s/q8VIvGav62RJVFn3U1D0jkiwDLSIFn8ezORQ4YkSidwdSrtqsqa2TJ0E5w/n5h5IVGO9neY8YlXrgynLd4Y+7 root@pocnjrsv132" 321 kubernetes: 322 api_service_ip: 10.96.0.1 323 etcd_service_ip: 10.96.0.2 324 pod_cidr: 10.99.0.0/16 325 service_cidr: 10.96.0.0/14 326 regional_server: 327 ip: 135.16.101.85