You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 39 Next »


Introduction


Unicycle pods are deployed from an existing Regional Controller and consist of 3 master nodes and 0 to 4 worker nodes. The number of nodes may be increased after validation in subsequent releases.

A number of different options exist including the choice of Dell or HP servers and whether to support tenant VM networking with an OVS-DPDK or SR-IOV data plane. The choice of which is deployed is achieved by simply creating different pod specific yaml input files.

In R1 the options include

BlueprintServersDataplaneValidated HW detailsValidated by
UnicycleDell 740XDOVS-DPDKDell 740XD Detailed SpecificationEricsson
UnicycleDell 740XDSR-IOV<INSERT LINK TO ATT DELL SERVER SPEC>AT&T

Dell 740XD Detailed Specification

Ericsson
UnicycleHP 380 Gen10SR-IOV<INSERT LINK TO ATT HP SERVER SPEC>AT&T

Preflight Requirements

Servers

Deployment has been validated on two types of servers, Dell and HP.

The exact server specifications used during validation activities are defined in links in the table above. Whilst the blueprint allows for variation in the servers, since the installation includes provisioning of BIOS and HW specific components such as NICs, SSDs, HDDs, CPUs etc only these exact server types are supported and validated in the R1 release.

A unicycle pod deployment consists of at least 3 servers for the master nodes (that can also run tenant VM workloads and 0 to 4 dedicated worker nodes.

Networking

The automated deployment process configures all aspects of the servers including BIOS, linux operating system and Network Cloud specific software. The deployment and configuration of all external switching components is outside the scope of the R1 release and must be completed as a pre-requisite before attempting a unicycle pods deployment.

Details of the networking is given in the Network Architecture section and that used during the validation in the ATT Validation Labs and Ericsson Validation Labs sections of the release documentation.

Software

When a unicycle pod's nodes are installed on a new bare metal server no software is required on the Target Server. All software will be installed from the Build Server and/or external repos via the internet.

Generate RC ssh Key Pair

In order for the RC to ssh into the Unicycle nodes during the deployment process a ssh key pair must be generated on the RC then the public key must be inserted into the Unicycle pods's site specific input file.

root@regional_server# ssh-keygen -t rsa 
  
.....

root@regional_server# cd /root/.ssh 
root@regional_server# ls -lrt
total 12
-rw------- 1 root root  399 May 26 00:34 authorized_keys
-rw-r--r-- 1 root root  395 May 26 00:55 id_rsa.pub
-rw------- 1 root root 1679 May 26 00:55 id_rsa


Preflight Checks


Preflight Unicycle Pod Specific Input Data

Unicycle Pods with OVS-DPDK Dataplane


Unicycle Pods with SR-IOV Dataplane


Deploying a Unicycle Pod


Example Unicycle Pod Configuration Input Files

This section contains the input files used to build the Unicycle pods in ATT's and Ericsson's validation labs for the R1 release. Being pods and site specific the enumerated values will differ. Full details of the relevant validation lab setup that should be referenced when looking at these files is contained in the Validation Labs section of this documentation.

Unicycle Pods with OVS-DPDK Dataplane on Dell 740XD servers

This section includes a sample input file that was used in the Ericsson Validation Lab to deploy a Unicycle pod with an OVS_DPDK dataplane.

Please reference the following lab configuration Ericsson Unicycle OVS-DPDK Validation HW, Networking and IP plan.

site_name: akraino-ki20
site_type: ovsdpdk         # Note this field defines the dataplane to be deployed as OVS-DPDK

ipmi_admin:
  username: root
  password: calvin

networks:
  bonded: yes
  primary: bond0
  slaves:
    - name: enp95s0f0
    - name: enp95s0f1

  oob:
    vlan: 400 # Note this VID is not used by current network cloud deployment process
    interface:
    cidr: 10.51.35.128/27 # Note this subnet mask length is used by the deployment scripts
    netmask: 255.255.255.224 # Note this subnet mask is used by the deployment scripts
    routes:
      gateway: 10.51.35.129
    ranges:
      reserved:
        start: 10.51.35.153
        end: 10.51.35.158
      static:
        start: 10.51.35.132
        end: 10.51.35.152

  host:
    vlan: 408
    interface: bond0.408
    cidr: 10.51.34.224/27 # Note this subnet mask length is used by the deployment scripts
    subnet: 10.51.34.224 
    netmask: 255.255.255.224 # Note this subnet mask is used by the deployment scripts
    routes:
       gateway: 10.51.34.225
    ranges:
      reserved:
        start: 10.51.34.226
        end: 10.51.34.228
      static:
        start: 10.51.34.229
        end: 10.51.34.235

  storage:
    vlan: 23
    interface: bond0.23
    cidr: 10.224.174.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1
    #netmask: 255.255.255.0 - Not Used
    ranges:
      reserved:
        start: 10.224.174.1
        end: 10.224.174.10
      static:
        start: 10.224.174.11
        end: 10.224.174.254

  pxe:
    vlan: 407
    interface: eno3
    cidr: 10.224.168.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1
    #netmask: 255.255.255.0 - Not Used
    gateway: 10.224.168.1
    routes:
      gateway: 10.224.168.12 #This address is the PXE interface of the Genesis Node.
    ranges:
      reserved:
        start: 10.224.168.1
        end:  10.224.168.10
      static:
        start: 10.224.168.11
        end: 10.224.168.200
      dhcp:
        start: 10.224.168.201
        end: 10.224.168.254

  ksn:
    vlan: 22
    interface: bond0.22
    cidr: 10.224.160.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1
    #netmask: 255.255.255.0 - Not Used
    local_asnumber: 65531  # Note: this is the ASN of the k8s calico network
    ranges:
      static:
        start: 10.224.160.134
        end: 10.224.160.254
    additional_cidrs:
      -  10.224.160.200/29
    ingress_cidr: 10.224.160.201/32
    peers:
    - ip: 10.224.160.129 # Note: this is the IP address of the external fabric bgp router
      scope: global
      asnumber: 65001  # Note: this is the ASN of the external fabric bgp router
    vrrp_ip: 10.224.160.129 # keep peers ip address in case of only peer.

  neutron:
    vlan: 24
    interface: bond0.24
    cidr: 10.224.171.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1
    #netmask: 255.255.255.0 - Not Used
    ranges:
      reserved:
        start: 10.224.171.1
        end: 10.224.171.10
      static:
        start: 10.224.171.11
        end: 10.224.171.254

  vxlan:
    vlan: 1 # Note this VID value defines that the dataplane interface is untagged and is the only supported option in R1
    interface: enp134s0f0 #Note this is a single port and LAG is not support with an OVS-DPDK dataplane in r1
    cidr: 10.224.169.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1
    #netmask: 255.255.255.0 - Not Used
    ranges:
      reserved:
        start: 10.224.169.1
        end: 10.224.169.10
      static:
        start: 10.224.169.11
        end: 10.224.169.254

dns:
  upstream_servers:
    - 10.64.73.100
    - 10.64.73.101
    - 10.51.40.100
  ingress_domain: vran.k2.ericsson.se
  domain: vran.k2.ericsson.se

#################################################################################################################
#Note: The 'dpdk' statement below defines the deployment of and OVS-DPDK dataplane instead of an SR-IOV dataplane

dpdk:
  nics:
  - name: dpdk0
    pci_id: '0000:86:00.0'
    bridge: br-phy
    migrate_ip: true

#################################################################################################################

storage:
  osds:
    - data: /dev/sda
      journal: /var/lib/ceph/journal/journal-sda
    - data: /dev/sdb
      journal: /var/lib/ceph/journal/journal-sdb
    - data: /dev/sdc
      journal: /var/lib/ceph/journal/journal-sdc
    - data: /dev/sdd
      journal: /var/lib/ceph/journal/journal-sdd
    - data: /dev/sde
      journal: /var/lib/ceph/journal/journal-sde
    - data: /dev/sdf
      journal: /var/lib/ceph/journal/journal-sdf
  osd_count: 6
  total_osd_count: 18

genesis:
  name : aknode23
  oob: 10.51.35.143
  host: 10.51.34.233
  storage: 10.224.174.12
  pxe: 10.224.168.12
  ksn: 10.224.160.135
  neutron: 10.224.171.12
  vxlan: 10.224.169.12
  root_password: akraino,d

masters:
  - name: aknode31
    oob: 10.51.35.147
    host: 10.51.34.229
    storage: 10.224.174.13
    pxe: 10.224.168.13
    ksn: 10.224.160.136
    neutron: 10.224.171.13
    vxlan: 10.224.169.13
    oob_user: root
    oob_password: calvin
  - name : aknode25
    oob: 10.51.35.144
    host: 10.51.34.232
    storage: 10.224.174.11
    pxe: 10.224.168.11
    ksn: 10.224.160.134
    neutron: 10.224.171.11
    vxlan: 10.224.169.11
    oob_user: root
    oob_password: calvin

#workers:
#  - name : aknode32 # Note not verified in this validation lab in R1
#    oob: 10.51.35.148
#    host: 10.51.34.234
#    storage: 10.224.174.14
#    pxe: 10.224.168.14
#    ksn: 10.224.160.137
#    neutron: 10.224.171.14
#    oob_user: root
#    oob_password: calvin
#  - name : aknode33 # Note not verified in this validation lab in R1
#    oob: 10.51.35.149
#    host: 10.51.34.235
#    storage: 10.224.174.15
#    pxe: 10.224.168.15
#    ksn: 10.224.160.138
#    neutron: 10.224.171.15
#    oob_user: root
#    oob_password: calvin

platform:
#  vcpu_pin_set: "4-21,26-43,48-65,72-87"
  kernel_params:
    hugepagesz: '1G'
    hugepages: 32
#   default_hugepagesz: '1G'
#   transparent_hugepage: 'never'
    iommu: 'pt'
    intel_iommu: 'on'
#   amd_iommu: 'on'
#   console: 'ttyS1,115200n8'

###########################################################################################
#Note: This section defines the use of Dell servers and their installed HW and BIOS version

hardware:
  vendor: DELL
  generation: '10'
  hw_version: '3'
  bios_version: '2.8'
  bios_template: dell_r740_g14_uefi_base.xml.template
  boot_template: dell_r740_g14_uefi_httpboot.xml.template
  http_boot_device: NIC.Slot.2-1-1

###########################################################################################

disks:
  - name : sdg
    labels:
      bootdrive: 'true'
    partitions:
      - name: root
        size: 20g
        mountpoint: /
      - name: boot
        size: 1g
        mountpoint: /boot
      - name: var
        size: 100g
        mountpoint: /var
  - name : sdh
    partitions:
      - name: ceph
        size: 300g
        mountpoint: /var/lib/ceph/journal

disks_compute:
  - name : sdg
    labels:
      bootdrive: 'true'
    partitions:
      - name: root
        size: 20g
        mountpoint: /
      - name: boot
        size: 1g
        mountpoint: /boot
      - name: var
        size: '>300g'
        mountpoint: /var
  - name : sdh
    partitions:
      - name: nova
        size: '99%'
        mountpoint: /var/lib/nova

# Note: the key below must be generate each time a new RC is installed and inserted intot he input file of any pods deployed by that RC

genesis_ssh_public_key: "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+iukrMrXSPOnnz89BHQ0UWMb71OLhSb5byh4wPpjSHtqmTV7xsg0WWUId5K8ejqL+X1FKPdTlozY1Jy6LHq9yWu+nvSdCdcV5CnrodgNCIiY6z4B9Mhf3BoN9ADQtZKH7EpAzGiqYvncrZTwHlmIyc9ff8HxusWut1vKn8EJ96a07wybRpjOlblehSESTD6qyUxUGt6hrJZY/FXHJ+JvpogI55i0La9pt94RQVg8wOi1DqPWavOZzRT35A7bziKk79IoGOGnW9H+K5x7hiRFw1wrPoJrd1ixgLyg+UUwgZlDCf5AhDyajmb8rtDLckVFcw8KPuj7weGGFD7gqOw1N root@aknode29"

kubernetes:
  api_service_ip: 10.96.0.1
  etcd_service_ip: 10.96.0.2
  pod_cidr: 10.98.0.0/16
  service_cidr: 10.96.0.0/15

regional_server:
  ip: 10.51.34.230 # Note: this is the host IP address of the Regional Controller that is being used to deploy this unicycle pod


Unicycle Pods with SR-IOV Dataplane on Dell 740XD servers

This section includes a sample input file that was used in the Ericsson Validation Lab to deploy a Unicycle pod with a SR-IOV dataplane.

Please reference the following lab configuration Ericsson Unicycle SR-IOV Validation HW, Networking and IP plan.

site_name: akraino-ki20
ipmi_admin:
  username: root
  password: calvin
networks:
  bonded: yes
  primary: bond0
  slaves:
    - name: enp95s0f0
    - name: enp95s0f1
  oob:
    vlan: 400 # Note this VID is not used by current network cloud deployment process
    interface:
    cidr: 10.51.35.128/27 # Note this subnet mask length is used by the deployment scripts
    netmask: 255.255.255.224
    routes:
      gateway: 10.51.35.129
    ranges:
      reserved:
        start: 10.51.35.153
        end: 10.51.35.158
      static:
        start: 10.51.35.132
        end: 10.51.35.152
  host:
    vlan: 408
    interface: bond0.408
    cidr: 10.51.34.224/27 # Note this subnet mask length is used by the deployment scripts
    subnet: 10.51.34.224
    netmask: 255.255.255.224
    routes:
       gateway: 10.51.34.225
    ranges:
      reserved:
        start: 10.51.34.226
        end: 10.51.34.228
      static:
        start: 10.51.34.229
        end: 10.51.34.235
  storage:
    vlan: 23
    interface: bond0.23
    cidr: 10.224.174.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1
    #netmask: 255.255.255.0 - Not Used
    ranges:
      reserved:
        start: 10.224.174.1
        end: 10.224.174.10
      static:
        start: 10.224.174.11
        end: 10.224.174.254
  pxe:
    vlan: 407
    interface: eno3
    cidr: 10.224.168.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1
    #netmask: 255.255.255.0 - Not Used
    gateway: 10.224.168.1
    routes:
      gateway: 10.224.168.12 #This address is the PXE interface address of the Genesis Node.
    ranges:
      reserved:
        start: 10.224.168.2
        end:  10.5224.168.10
      static:
        start: 10.224.168.11
        end: 10.224.168.200
      dhcp:
        start: 10.224.168.201
        end: 10.224.168.254
  ksn:
    vlan: 22
    interface: bond0.22
    cidr: 10.224.160.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1
    #netmask: 255.255.255.0 - Not Used
    local_asnumber: 65531 # Note: this is the ASN of the k8s calico network
    ranges:
      static:
        start: 10.224.160.134
        end: 10.224.160.254
    additional_cidrs:
      -  10.224.160.200/29
    ingress_cidr: 10.224.160.201/32
    peers:
    - ip: 10.224.160.129 # Note: this is the IP address of the external fabric bgp router
      scope: global
      asnumber: 65001 # Note: this is the ASN of the external fabric bgp router
    vrrp_ip: 10.224.160.129 # keep peers ip address in case of only peer.
  neutron:
    vlan: 24
    interface: bond0.24
    cidr: 10.224.171.0/24 # Note this subnet mask length is not used by the deployment scripts and is hard coded to /24 in R1
    #netmask: 255.255.255.0 - Not Used
    ranges:
      reserved:
        start: 10.224.171.1
        end: 10.224.171.10
      static:
        start: 10.224.171.11
        end: 10.224.171.254
dns:
  upstream_servers:
    - 10.64.73.100
    - 10.64.73.101
    - 10.51.40.100
  ingress_domain: vran.k2.ericsson.se
  domain: vran.k2.ericsson.se

####################################################################################################################
#Note: The 'sriovnets' statement below defines the deployment of a SR-IOV dataplane instead of an OVS-DPDK dataplane

sriovnets:
- physical: sriovnet1
  interface: enp134s0f0
  vlan_start: 2001
  vlan_end: 3000
  whitelists:
  - "address": "0000:86:02.0"
  - "address": "0000:86:02.1"
  - "address": "0000:86:03.2"
  - "address": "0000:86:03.3"
  - "address": "0000:86:03.4"
  - "address": "0000:86:03.5"
  - "address": "0000:86:03.6"
  - "address": "0000:86:03.7"
  - "address": "0000:86:04.0"
  - "address": "0000:86:04.1"
  - "address": "0000:86:04.2"
  - "address": "0000:86:04.3"
  - "address": "0000:86:02.2"
  - "address": "0000:86:04.4"
  - "address": "0000:86:04.5"
  - "address": "0000:86:04.6"
  - "address": "0000:86:04.7"
  - "address": "0000:86:05.0"
  - "address": "0000:86:05.1"
  - "address": "0000:86:05.2"
  - "address": "0000:86:05.3"
  - "address": "0000:86:05.4"
  - "address": "0000:86:05.5"
  - "address": "0000:86:02.3"
  - "address": "0000:86:05.6"
  - "address": "0000:86:05.7"
  - "address": "0000:86:02.4"
  - "address": "0000:86:02.5"
  - "address": "0000:86:02.6"
  - "address": "0000:86:02.7"
  - "address": "0000:86:03.0"
  - "address": "0000:86:03.1"
- physical: sriovnet2
  interface: enp134s0f1
  vlan_start: 2001
  vlan_end: 3000
  whitelists:
  - "address": "0000:86:0a.0"
  - "address": "0000:86:0a.1"
  - "address": "0000:86:0b.2"
  - "address": "0000:86:0b.3"
  - "address": "0000:86:0b.4"
  - "address": "0000:86:0b.5"
  - "address": "0000:86:0b.6"
  - "address": "0000:86:0b.7"
  - "address": "0000:86:0c.0"
  - "address": "0000:86:0c.1"
  - "address": "0000:86:0c.2"
  - "address": "0000:86:0c.3"
  - "address": "0000:86:0a.2"
  - "address": "0000:86:0c.4"
  - "address": "0000:86:0c.5"
  - "address": "0000:86:0c.6"
  - "address": "0000:86:0c.7"
  - "address": "0000:86:0d.0"
  - "address": "0000:86:0d.1"
  - "address": "0000:86:0d.2"
  - "address": "0000:86:0d.3"
  - "address": "0000:86:0d.4"
  - "address": "0000:86:0d.5"
  - "address": "0000:86:0a.3"
  - "address": "0000:86:0d.6"
  - "address": "0000:86:0d.7"
  - "address": "0000:86:0a.4"
  - "address": "0000:86:0a.5"
  - "address": "0000:86:0a.6"
  - "address": "0000:86:0a.7"
  - "address": "0000:86:0b.0"
  - "address": "0000:86:0b.1"

####################################################################################################################

storage:
  osds:
    - data: /dev/sda
      journal: /var/lib/ceph/journal/journal-sda
    - data: /dev/sdb
      journal: /var/lib/ceph/journal/journal-sdb
    - data: /dev/sdc
      journal: /var/lib/ceph/journal/journal-sdc
    - data: /dev/sdd
      journal: /var/lib/ceph/journal/journal-sdd
    - data: /dev/sde
      journal: /var/lib/ceph/journal/journal-sde
    - data: /dev/sdf
      journal: /var/lib/ceph/journal/journal-sdf
  osd_count: 6
  total_osd_count: 18

genesis:
  name : aknode23
  oob: 10.51.35.143
  host: 10.51.34.233
  storage: 10.224.174.12
  pxe: 10.224.168.12
  ksn: 10.224.160.135
  neutron: 10.224.171.12
  root_password: akraino,d

masters:
  - name: aknode31
    oob: 10.51.35.147
    host: 10.51.34.229
    storage: 10.224.174.13
    pxe: 10.224.168.13
    ksn: 10.224.160.136
    neutron: 10.224.171.13
    oob_user: root
    oob_password: calvin
  - name : aknode25
    oob: 10.51.35.144
    host: 10.51.34.232
    storage: 10.224.174.11
    pxe: 10.224.168.11
    ksn: 10.224.160.134
    neutron: 10.224.171.11
    oob_user: root
    oob_password: calvin

#workers:
#  - name : aknode32 # Note not verified in this validation lab in R1
#    oob: 10.51.35.148
#    host: 10.51.34.234
#    storage: 10.224.174.14
#    pxe: 10.224.168.14
#    ksn: 10.224.160.137
#    neutron: 10.224.171.14
#    oob_user: root
#    oob_password: calvin
#  - name : aknode33 # Note not verified in this validation lab in R1
#    oob: 10.51.35.149
#    host: 10.51.34.235
#    storage: 10.224.174.15
#    pxe: 10.224.168.15
#    ksn: 10.224.160.138
#    neutron: 10.224.171.15
#    oob_user: root
#    oob_password: calvin

###########################################################################################
#Note: This section defines the use of Dell servers and their installed HW and BIOS version

hardware:
  vendor: DELL
  generation: '10'
  hw_version: '3'
  bios_version: '2.8'
  bios_template: dell_r740_g14_uefi_base.xml.template
  boot_template: dell_r740_g14_uefi_httpboot.xml.template
  http_boot_device: NIC.Slot.2-1-1

###########################################################################################

disks:
  - name : sdg
    labels:
      bootdrive: 'true'
    partitions:
      - name: root
        size: 20g
        mountpoint: /
      - name: boot
        size: 1g
        mountpoint: /boot
      - name: var
        size: 100g
        mountpoint: /var
  - name : sdh
    partitions:
      - name: ceph
        size: 300g
        mountpoint: /var/lib/ceph/journal

disks_compute:
  - name : sdg
    labels:
      bootdrive: 'true'
    partitions:
      - name: root
        size: 20g
        mountpoint: /
      - name: boot
        size: 1g
        mountpoint: /boot
      - name: var
        size: '>300g'
        mountpoint: /var
  - name : sdh
    partitions:
      - name: nova
        size: '99%'
        mountpoint: /var/lib/nova

# Note: the key below must be generate each time a new RC is installed and inserted intot he input file of any pods deployed by that RC

genesis_ssh_public_key: "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCos1E/53FhubxPOXncxByAI5WCyyt0UBhsBGCPlp5J5gM8vMZEX9pJI3uY/5R8z6crtuW9aneSQ9kZTkksGNoohWZDmLRymfJOOtfs5TlpRGvKAHMnYthDexeCKQixbrf0/9dzAUalzveM025D2ZJSM3mQ9kDr6Pn4220Lbsez50CzH9dKRNKzydDTvuwOi0unTQf9DNNc9WzDTO83UwmGVtR2mIq8ZXOd1G4To3cT0P487NezsRrCtscbdoe4YdAW9h7wxNC1saZNbx2kARIOjO79bKT1U+j9XQZTuHKbzhLxXqqUkEGfmqGvA1H6iAMPl4Hz8itM0veW63Zolwg/ root@aknode29"

kubernetes:
  api_service_ip: 10.96.0.1
  etcd_service_ip: 10.96.0.2
  pod_cidr: 10.98.0.0/16
  service_cidr: 10.96.0.0/15

regional_server:
  ip: 10.51.34.230 # Note: this is the host IP address of the Regional Controller that is being used to deploy this unicycle pod


Unicycle Pods with SR-IOV Dataplane on HP DL380 servers

This section includes a sample input file that was used in the ATT Validation Lab to deploy a Unicycle pod with an SR-IOV dataplane.

Please reference the following lab configuration ATT Unicycle SR-IOV Validation HW, Networking and IP plan.

##############################################################################
   3 # Copyright (c) 2018 AT&T Intellectual Property. All rights reserved.        #
   4 #                                                                            #
   5 # Licensed under the Apache License, Version 2.0 (the "License"); you may    #
   6 # not use this file except in compliance with the License.                   #
   7 #                                                                            #
   8 # You may obtain a copy of the License at                                    #
   9 #       http://www.apache.org/licenses/LICENSE-2.0                           #
  10 #                                                                            #
  11 # Unless required by applicable law or agreed to in writing, software        #
  12 # distributed under the License is distributed on an "AS IS" BASIS, WITHOUT  #
  13 # WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.           #
  14 # See the License for the specific language governing permissions and        #
  15 # limitations under the License.                                             #
  16 ##############################################################################
  17 
  18 site_name: hpgen10
  19 site_type: sriov
  20 ipmi_admin:
  21   username: Administrator
  22   password: Admin123
  23 networks:
  24   bonded: yes
  25   primary: bond0
  26   slaves:
  27     - name: ens3f0
  28     - name: ens3f1
  29   oob:
  30     vlan: 40
  31     interface:
  32     cidr: 192.168.41.0/24
  33     routes:
  34       gateway: 192.168.41.1
  35     ranges:
  36       reserved:
  37         start: 192.168.41.2
  38         end: 192.168.41.4
  39       static:
  40         start: 192.168.41.5
  41         end: 192.168.41.254
  42   host:
  43     vlan: 41
  44     interface: bond0.41
  45     cidr: 192.168.2.0/24
  46     routes:
  47        gateway: 192.168.2.200
  48     ranges:
  49       reserved:
  50         start: 192.168.2.84
  51         end: 192.168.2.86
  52       static:
  53         start: 192.168.2.1
  54         end: 192.168.2.83
  55   storage:
  56     vlan: 42
  57     interface: bond0.42
  58     cidr: 172.31.1.0/24
  59     ranges:
  60       static:
  61         start: 172.31.1.2
  62         end: 172.31.1.254
  63   pxe:
  64     vlan:
  65     interface: eno1
  66     cidr: 172.30.1.0/24
  67     gateway: 172.30.1.1
  68     routes:
  69        gateway: 172.30.1.30
  70     ranges:
  71       reserved:
  72         start: 172.30.1.1
  73         end:  172.30.1.10
  74       static:
  75         start: 172.30.1.11
  76         end: 172.30.1.200
  77       dhcp:
  78         start: 172.30.1.201
  79         end: 172.30.1.254
  80   ksn:
  81     vlan: 44
  82     interface: bond0.44
  83     cidr: 172.29.1.0/24
  84     local_asnumber: 65531
  85     ranges:
  86       static:
  87         start: 172.29.1.5
  88         end: 172.29.1.254
  89     additional_cidrs:
  90       -  172.29.1.136/29
  91     ingress_cidr: 172.29.1.137/32
  92     peers:
  93     - ip: 172.29.1.1
  94       scope: global
  95       asnumber: 65001
  96     vrrp_ip: 172.29.1.1 # keep peers ip address in case of only peer.
  97   neutron:
  98     vlan: 45
  99     interface: bond0.45
 100     cidr: 10.0.101.0/24
 101     ranges:
 102       static:
 103         start: 10.0.101.2
 104         end: 10.0.101.254
 105 dns:
 106   upstream_servers:
 107     - 192.168.2.85
 108     - 8.8.8.8
 109     - 8.8.8.8
 110   ingress_domain: hpgen10.akraino.org
 111   domain: lab.akraino.org
 112 gpu:
 113   alias:
 114     - name: "P4"
 115       product_id: "1bb2"
 116       vendor_id: "10de"
 117     - name: "P40"
 118       product_id: "1b38"
 119       vendor_id: "10de"
 120     - name: "P100"
 121       product_id: "15f8"
 122       vendor_id: "10de"
 123     - name: "V100"
 124       product_id: "1db4"
 125       vendor_id: "10de"
 126 sriov:
 127   alias:
 128     - name: "numa0"
 129       product_id: "158b"
 130       vendor_id: "8086"
 131   nets:
 132     - physical: sriovnet1
 133       interface: ens6f0
 134       vlan_start: 2001
 135       vlan_end: 3000
 136       whitelists:
 137       - "address": "0000:af:02.0"
 138       - "address": "0000:af:02.1"
 139       - "address": "0000:af:02.2"
 140       - "address": "0000:af:02.3"
 141       - "address": "0000:af:02.4"
 142       - "address": "0000:af:02.5"
 143       - "address": "0000:af:02.6"
 144       - "address": "0000:af:02.7"
 145       - "address": "0000:af:03.0"
 146       - "address": "0000:af:03.1"
 147       - "address": "0000:af:03.2"
 148       - "address": "0000:af:03.3"
 149       - "address": "0000:af:03.4"
 150       - "address": "0000:af:03.5"
 151       - "address": "0000:af:03.6"
 152       - "address": "0000:af:03.7"
 153       - "address": "0000:af:04.0"
 154       - "address": "0000:af:04.1"
 155       - "address": "0000:af:04.2"
 156       - "address": "0000:af:04.3"
 157       - "address": "0000:af:04.4"
 158       - "address": "0000:af:04.5"
 159       - "address": "0000:af:04.6"
 160       - "address": "0000:af:04.7"
 161       - "address": "0000:af:05.0"
 162       - "address": "0000:af:05.1"
 163       - "address": "0000:af:05.2"
 164       - "address": "0000:af:05.3"
 165       - "address": "0000:af:05.4"
 166       - "address": "0000:af:05.5"
 167       - "address": "0000:af:05.6"
 168       - "address": "0000:af:05.7"
 169     - physical: sriovnet2
 170       interface: ens6f1
 171       vlan_start: 2001
 172       vlan_end: 3000
 173       whitelists:
 174       - "address": "0000:af:0a.0"
 175       - "address": "0000:af:0a.1"
 176       - "address": "0000:af:0a.2"
 177       - "address": "0000:af:0a.3"
 178       - "address": "0000:af:0a.4"
 179       - "address": "0000:af:0a.5"
 180       - "address": "0000:af:0a.6"
 181       - "address": "0000:af:0a.7"
 182       - "address": "0000:af:0b.0"
 183       - "address": "0000:af:0b.1"
 184       - "address": "0000:af:0b.2"
 185       - "address": "0000:af:0b.3"
 186       - "address": "0000:af:0b.4"
 187       - "address": "0000:af:0b.5"
 188       - "address": "0000:af:0b.6"
 189       - "address": "0000:af:0b.7"
 190       - "address": "0000:af:0c.0"
 191       - "address": "0000:af:0c.1"
 192       - "address": "0000:af:0c.2"
 193       - "address": "0000:af:0c.3"
 194       - "address": "0000:af:0c.4"
 195       - "address": "0000:af:0c.5"
 196       - "address": "0000:af:0c.6"
 197       - "address": "0000:af:0c.7"
 198       - "address": "0000:af:0d.0"
 199       - "address": "0000:af:0d.1"
 200       - "address": "0000:af:0d.2"
 201       - "address": "0000:af:0d.3"
 202       - "address": "0000:af:0d.4"
 203       - "address": "0000:af:0d.5"
 204       - "address": "0000:af:0d.6"
 205       - "address": "0000:af:0d.7"
 206 storage:
 207   osds:
 208     - data: /dev/sdb
 209       journal: /var/lib/ceph/journal/journal-sdb
 210     - data: /dev/sdc
 211       journal: /var/lib/ceph/journal/journal-sdc
 212     - data: /dev/sdd
 213       journal: /var/lib/ceph/journal/journal-sdd
 214     - data: /dev/sde
 215       journal: /var/lib/ceph/journal/journal-sde
 216     - data: /dev/sdf
 217       journal: /var/lib/ceph/journal/journal-sdf
 218     - data: /dev/sdg
 219       journal: /var/lib/ceph/journal/journal-sdg
 220     - data: /dev/sdh
 221       journal: /var/lib/ceph/journal/journal-sdh
 222     - data: /dev/sdi
 223       journal: /var/lib/ceph/journal/journal-sdi
 224   osd_count: 8
 225   total_osd_count: 24
 226 genesis:
 227   name: aknode30
 228   oob: 192.168.41.130
 229   host: 192.168.2.30
 230   storage: 172.31.1.30
 231   pxe: 172.30.1.30
 232   ksn: 172.29.1.30
 233   neutron: 10.0.101.30
 234   root_password: akraino,d
 235   mac_address: 3c:fd:fe:aa:90:b0
 236 masters:
 237   - name : aknode31
 238     oob: 192.168.41.131
 239     host: 192.168.2.31
 240     storage: 172.31.1.31
 241     pxe: 172.30.1.31
 242     ksn: 172.29.1.31
 243     neutron: 10.0.101.31
 244     oob_user: Administrator
 245     oob_password: Admin123
 246   - name : aknode32
 247     oob: 192.168.41.132
 248     host: 192.168.2.32
 249     storage: 172.31.1.32
 250     pxe: 172.30.1.32
 251     ksn: 172.29.1.32
 252     neutron: 10.0.101.32
 253     oob_user: Administrator
 254     oob_password: Admin123
 255 #workers:
 256 #  - name : aknode33
 257 #    oob: 192.168.41.133
 258 #    host: 192.168.2.33
 259 #    storage: 172.31.1.33
 260 #    pxe: 172.30.1.33
 261 #    ksn: 172.29.1.33
 262 #    neutron: 10.0.101.33
 263 platform:
 264   vcpu_pin_set: "4-21,26-43,48-65,72-87"
 265   kernel_params:
 266     hugepagesz: '1G'
 267     hugepages: 32
 268 #    default_hugepagesz: '1G'
 269     transparent_hugepage: 'never'
 270     iommu: 'pt'
 271     intel_iommu: 'on'
 272     amd_iommu: 'on'
 273 #    console: 'ttyS1,115200n8'
 274 hardware:
 275   vendor: HP
 276   generation: '10'
 277   hw_version: '3'
 278   bios_version: '2.8'
 279   bios_template: hpe_dl380_g10_uefi_base.json.template
 280   boot_template: hpe_dl380_g10_uefi_httpboot.json.template
 281   http_boot_device: NIC.Slot.3-1-1
 282 disks:
 283   - name : sdj
 284     labels:
 285       bootdrive: 'true'
 286     partitions:
 287       - name: root
 288         size: 20g
 289         mountpoint: /
 290       - name: boot
 291         size: 1g
 292         mountpoint: /boot
 293       - name: var
 294         size: '>300g'
 295         mountpoint: /var
 296   - name : sdk
 297     partitions:
 298       - name: ceph
 299         size: 300g
 300         mountpoint: /var/lib/ceph/journal
 301 disks_compute:
 302   - name : sdj
 303     labels:
 304       bootdrive: 'true'
 305     partitions:
 306       - name: root
 307         size: 20g
 308         mountpoint: /
 309       - name: boot
 310         size: 1g
 311         mountpoint: /boot
 312       - name: var
 313         size: '>300g'
 314         mountpoint: /var
 315   - name : sdk
 316     partitions:
 317       - name: nova
 318         size: '99%'
 319         mountpoint: /var/lib/nova
 320 genesis_ssh_public_key: "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/n4mNLAj3XKG2fcm+8eVe0NUlNH0g8DA8KJ53rSLKccm8gm4UgLmGOJyBfUloQZMuOpU6a+hexN4ECCliqI7+KUmgJgsvLkJ3OUMNTEVu9tDX5mdXeffsufaqFkAdmbJ/9PMPiPQ3/UqbbtyEcqoZAwUWf4ggAWSp00SGE1Okg+skPSbDzPVHb4810eXZT1yoIg29HAenJNNrsVxvnMT2kw2OYmLfxgEUh1Ev4c5LnUog4GXBDHQtHAwaIoTu9s/q8VIvGav62RJVFn3U1D0jkiwDLSIFn8ezORQ4YkSidwdSrtqsqa2TJ0E5w/n5h5IVGO9neY8YlXrgynLd4Y+7 root@pocnjrsv132"
 321 kubernetes:
 322   api_service_ip: 10.96.0.1
 323   etcd_service_ip: 10.96.0.2
 324   pod_cidr: 10.99.0.0/16
 325   service_cidr: 10.96.0.0/14
 326 regional_server:
 327   ip: 135.16.101.85





  • No labels