Versions Compared

Old Version 23

changes.mady.by.user Peng He

Saved on

compared with

New Version 24

changes.mady.by.user Peng He

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Enable SR-IOV on FW (Optional):

mlxconfig -y -d /dev/mst/mt41682_pciconf0 s SRIOV_EN=1
mlxconfig -y -d /dev/mst/mt41682_pciconf0 s NUM_OF_VFS=8


  • Uncomment the following line in /etc/modprobe.d/rshim.conf to set the default RShim access method to the SmartNIC:

 options rshim backend_driver=rshim_usb


       Note

  1. When this line is commented, the first available driver will be used.
  2. When the mini USB cable is not used, the driver should be rshim_pcie

...

  • Create a file named ifcfg-tmfifo_net0 under /etc/sysconfig/network-scripts/ directory, with the following content:

NAME="tmfifo_net0"
HWADDR="00:1a:ca:ff:ff:02"
ONBOOT=yes
NETBOOT=yes
IPV6INIT=yes
BOOTPROTO=static
TYPE=Ethernet
IPADDR=192.168.100.1
NETMASK=255.255.255.0

  

  • ifcfg-tmfifo_net0 is the network interface used for IP communication between the x86 host and the SmartNIC with rshim_net driver.
  • Enable ip forwarding and set a NAT rule to allow the SmartNIC OS to communicate with the outer world via the host management interface:

sysctl -w net.ipv4.ip_forward=1
systemctl enable iptables
systemctl start iptables
iptables -F
iptables -t nat -A POSTROUTING -o <host_mgmt_interfac> -j MASQUERADE
service iptables save


  • Disable Firewall and Network Manager services

systemctl disable firewalld.service
systemctl disable NetworkManager


  • Reboot the server. Once server is up again, run some configuration sanity tests:
  • To verify BlueField FW version:

mlxfwmanager --query


  •  To verify RShim modules are loaded:

lsmod | grep -i rshim


  • To identify the backend active RShim driver:

 cat /dev/rshim0/misc


  • To verify the NAT rule for SmartNIC communication with the outer world:

iptables -L -n -t nat



cat /home/CentOS7.5ALT-aarch64-QuickStart.bfb > /dev/rshim0/boot

  

Use one of the console access methods described in the "SmartNIC Management Methods" section below to follow the image installation process.

 When When bfb image installation process is completed, connect to the SmartNIC with the console or SSH, as described below, and test connectivity from the SmarNIC OS to the outer world.

...

Console over USB-Serial / Serial Port properties: Rate 115200, HW Flow Control OFF.

minicom -D /dev/ttyUSB0

Console over USB (rshim_usb) / Serial Port properties: Rate 115200, HW Flow Control OFF

minicom -D /dev/rshim0/console

SSH (rshim_net)

ssh root@192.168.100.2

Note
       SmartNIC OS is configured to obtain internet access via its hosting server.

...

Issue the following command on the server:

 echo "SW_RESET 1" > /dev/rshim0/misc

...

Issue the following command on the server:

 cat <image>.bfb > /dev/rshim0/boot

...

Special Requirements for Virtual Deployments

N/A

Install Jump Host

N/A

Verifying the Setup - VMs

...

N/A

Upstream Deployment Guide

N/A

Upstream Deployment Key Features

...

Special Requirements for Upstream Deployments

N/A 

Scenarios and Deploy Settings for Upstream Deployments

...

N/A

Including Upstream Patches with DeploymentNA

...