...
Test | Robot case exists | Docker for AMD64 | Docker for ARM64 | Tested on x86_64/AMD64 | Tested on ARM64 | Integrated with Bluval |
---|---|---|---|---|---|---|
Redfish | Ok | Ok | Ok | Ran on OpenEdge hw (failures to be investigated) | NA | Waiting for testing to complete |
LTP | Ok | Ok | Ok | Needs to be installed by the test setup phase | Works | |
k8s | Ok | Ok | Ok | Works with k3s, Rover and REC | Works with IEC | Works |
OpenStack (Tempest) | Ok | Ok | Ok | Works with Airship | https://gerrit.akraino.org/r/c/validation/+/1602 |
October 30, 2019
- Ken Yi wants to discuss the mandatory security testing requirements
- Jenkins update https://gerrit.akraino.org/r/c/ci-management/+/1657
- Initial patch made but had some issues
- Needs some more testing and documentation
- We need to check where we are rst. Release 2. Seems like Sonobuyo and Tempest are working fine, LTP and Redfish have issues
- Redfish tests have upstream bugs → propose to drop
- LTP testing requires sudo - is this acceptable?
- LTP is also somewhat broken at the moment
- Sonobuyo is failing to run on some blueprints
- WIll prioritize the Rel.2 bugs
- UI update
- Bug reports
October 23, 2019
- Release 2: Redfish update https://gerrit.akraino.org/r/c/validation/+/1781
- Testing with OpenEdge is ongoing
- OpenStack integration: copy bluval-rec.yaml to bluval-unicycle.yaml and leave OpenStack tests out from bluval-rec.yaml
- Add remote session to etcd HA testcases https://gerrit.akraino.org/r/c/validation/+/1793
- Will be modified to follow the The Principle: Whenever possible, use testing tools on the container to connect to the SUT. When this is not possible, ssh connection to the SUT can be used
- Indu will fix this so that the kubectl in the container will connect to the SUT using a modified kubeconfig file (replace localhost with real IP address)
- Fix for LTP: https://gerrit.akraino.org/r/c/validation/+/1752
Jira server Akraino JIRA serverId 604c99be-f414-323d-84e4-c9d70fa2bcdf key VAL-66 - Will build binaries out of the source files and using those for testing
- The binaries will be copied to the SUT, run, and deleted afterwards
- The full LTP requires sudo rights which is a security risk. Need to investigate if there is a subset of LTP that can work without special rights
- Versioning of Bluval code and Docker hub
- Use tags to mark releases
- Need separate Jenkins jobs for released/stable version and master
- The UI project needs separate versioning
- Could request a new repo for UI?
- CI jobs: https://gerrit.akraino.org/r/c/ci-management/+/1657
- Still has a "-1" but getting there
- Need to create instructions once the patch is merged (AP: Vali)
- Does not cover uploading the results
- Logging container: https://gerrit.akraino.org/r/c/validation/+/1767
- Will be part of service layer
- NTP and DNS tests
- UI status update
- Almost there, but some problems remain
...