Table of Contents

Introduction

This document describes tests that were performed for PCEI R4:

1. PCEI Deployment Tests
2. PCEI End-to-End Validation Tests
3. BluVal Tests

Overall Test Architecture

Describe  the components of Test set up

Test Bed

Image AddedImage Removed

Test Framework

1. PCEI Deployment Tests

Described in the PCEI R5 Installation Guide

...

Described in the BluVal Test section of this document.

Traffic Generator

Not used.

For end-to-end functional verification, a simulated IoT Client was provided. Please refer to PCEI R5 End-to-End Validation Guide.

Test API description

Test APIs NOT USED (except BluVal Robot)

Akraino common tests

NOT PERFORMED

The Test inputs

Test Procedure

Expected output

Test Results

Blueprint extension tests

The Test inputs

Test Procedure

PCEI R5 Installation Guide

PCEI R5 End-to-End Validation Guide.

Expected output

All tests pass

Test Results

Refer to sections of the following documents for detailed test results:

...

PCEI R5 End-to-End Validation Guide.

Feature Project Tests

NOT PERFORMED

The Test inputs

Test Procedure

Expected output

Test Results

BluVal Tests

The Test inputs

BluVal Test Environment setup according to:

Bluval User Guide

Test Procedure

1. Deploy a Test VM
2. Install Docker: https://docs.docker.com/engine/install/ubuntu/
3. Clone BluVal Validation Framework into the Test VM:
4. Copy SUT's .kube/config file and SSH key to the Test VM
5. Configure validation environment:

...

# Create .netrc file
vi .netrc
machine nexus.akraino.org
login <LF ID>
password <Password>

# Archive log files
zip -r results.zip ./results

# Push logs to Nexus
NEXUS_PATH="/pcei/job/v2"
NEXUS_URL="https://nexus.akraino.org/"
/home/onaplab/.local/bin/lftools deploy nexus-zip $NEXUS_URL logs $NEXUS_PATH results.zip

Expected output

Test Results

https://nexus.akraino.org/content/sites/logs/pcei/job/v2/results/

Vuls

Image RemovedImage Added

CVEs Found:

Lynis

Image RemovedImage Added

Fixes for Lynis:

...

sysctl -w net.ipv4.conf.all.accept_source_route=0

K8S Conformance

Image RemovedImage Added

Exception Requested:

Image RemovedImage Added

Kube-Hunter

Image RemovedImage Added

Vulnerabilities found

...

kubectl replace -f - <<EOF
apiVersion: v1
kind: ServiceAccount
metadata:
  name: default
  namespace: default
automountServiceAccountToken: false
EOF

Test Dashboards

Single pane view of how the test score looks like for the Blue print.

Additional Testing

None

Bottlenecks/Errata

Please refer to PCEI R5 Release Notes