...
* Green=Akraino dependencies, Orange=system under test, Blue=components created
Test Framework
For the moment, the deployment tests are just consisting on deploying a cluster and running workloads on top of it, checking that they are successfully deployed.
In the future, validation tests will be executed: https://gerrit.akraino.org/r/admin/repos/validationTestings in validation lab are executed manually for the moment
Automated test deploy
The validation of KNI-PAE blueprint is currently based on deploying our cluster and applying workloads on top of it, every time that there is a change on the blueprint repo .
Additionally test can be run manually to verify deployment at a certain stage.
Validation on the blueprint is done for AWS, GCP and virtual baremetal.
At the end of the tests, the deployed cluster is destroyed.
Sample tests can be seen at:
https://jenkins.akraino.org/view/kni/job/kni-blueprint-pae-verify-deploy-aws/
https://jenkins.akraino.org/view/kni/job/kni-blueprint-pae-verify-deploy-baremetal/
https://jenkins.akraino.org/view/kni/job/kni-blueprint-pae-verify-deploy-gcp/
Conformance Test
This is performed through Akraino Blueprint Validation project framework.
However the tests are currently launched manually after a cluster is deployed, integration with the CI is still pending, as we are hitting issues with the framework itself:
https://jira.akraino.org/projects/VAL/issues/VAL-108
https://jira.akraino.org/projects/VAL/issues/VAL-109
https://jira.akraino.org/projects/VAL/issues/VAL-110
The test that could be run are OS and conformance testing:
https://logs.akraino.org/redhat-kni/bluval_results/blueprint-pae/20200423-061750/results/os/
https://logs.akraino.org/redhat-kni/bluval_results/blueprint-pae/20200423-061750/results/k8s/conformance/
Test Dashboards
https://jenkins.akraino.org/view/kni/