Introduction
<Details about Additional tests required for this Blue Print in addition to the Akraino Validation Feature Project>
Akarino Test Group Information
<The Testing Ecosystem>
Testing Working Group Resources
Overall Test Architecture
Describe the components of Test set up
We are interested in the benefits of hardware offloading provided by the SmartNIC, and the overall performance benefits for the Edge Cloud brought by the SmartNICs offload.
Thus the purpose of this test is to evaluate the performance of SmartNIC offloaded servers, including the PPS (packet per seconds) as well as the TCP throughput in a virtualized environment.
To fully test the PPS performance brought by the SmartNICs, we will use DPDK application running in the VM to avoid the overhead induced by the hypervisor and guest kernels.
To evaluate the performance of the normal network applications, we will also use tools like IPerf to evaluate the TCP throughput as well as the network latency.
We will also test the performance of the SmartNICs when some network function exists, such as firewall. The offloading performance for the Connection-tracking will be evaluated.
Test Bed
The testbed setup is shown in the above diagram. DUT stands for Device Under Test
Type | Description |
---|---|
SmartNICs | BlueField, 25Gbps |
DPDK | version 19.11 |
vSwitch | OVS-DPDK 2.12 with CT offload enabled. |
Test Framework
Traffic Generator
We will use DPDK pktgen as the Traffic Generator.
Test API description
<Akraino common tests>
The Test inputs
Test Procedure
Expected output
Test Results
<Blueprint extension tests>
The Test inputs
Test Procedure
Expected output
Test Results
<Feature Project Tests>
The Test inputs
Test Procedure
Expected output
Test Results
Test Dashboards
Single pane view of how the test score looks like for the Blue print.
Total Tests | Test Executed | Pass | Fail | In Progress |
---|---|---|---|---|