action #113501
closedcoordination #103323: [epic] BCI testing
Merge Base Image tests for 15-SP3 and 15-SP4 with BCI tests
0%
Description
We are currently testing Base image with our tests in os-autoinst-distri-opensuse
15-SP3
15-SP4
This coverage has be ok so far, but we need to extend it to use BCI-tests, specially test_base.py as it contains further coverage for this image.
In order to run both tests in the same job, we need to do the following things:
1) Remove the former job groups
- https://gitlab.suse.de/qac/qac-openqa-yaml/-/blob/master/containers/image_updates/sle15sp3.yaml
- https://gitlab.suse.de/qac/qac-openqa-yaml/-/blob/master/containers/image_updates/sle15sp4.yaml
2) In the container bot, move base image for 15-SP3 and 15-SP4 from
https://gitlab.suse.de/qac/container-release-bot/-/blob/main/containers/sle15.yaml
to
https://gitlab.suse.de/qac/container-release-bot/-/blob/main/containers/bci15sp3.yaml
https://gitlab.suse.de/qac/container-release-bot/-/blob/main/containers/bci15sp4.yaml
Also, change the job group ID to the groups 378 and 395 accordingly.
3) New jobs should have:
BCI_TESTS: "1"
BCI_TESTS_REPO: "https://github.com/SUSE/BCI-tests.git"
BCI_TIMEOUT: "5400" # some tests take very long, specially in aarch64
but we need to tweak the conditional schedule in main_containers.pm to also run load_image_tests_podman
and load_image_tests_docker
for 15-SP3 and beyond.
Acceptance criteria¶
Move 15-SP3 and 15-SP4 jobs to https://openqa.suse.de/group_overview/442 and https://openqa.suse.de/group_overview/443 respectively and execute both:
1) Current perl module tests
2) BCI-tests base tests
Updated by jlausuch almost 2 years ago
- Status changed from Workable to In Progress
- Assignee set to jlausuch
Updated by jlausuch almost 2 years ago
We already have mediums created with BCI-Updates
flavor for 15-SP3 and 15-SP4, so let's use them as well for Base images.
Updated by jlausuch almost 2 years ago
PR for the scheduling: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/15232
Updated by jlausuch almost 2 years ago
and MR in the container bot to move the images to bci yamls, and also flavor change to BCI-Updates
and group change to 442 and 443.
https://gitlab.suse.de/qac/container-release-bot/-/merge_requests/81
Updated by jlausuch almost 2 years ago
I have detected 2 issues with running BCI-tests for the first time with the base image:
- Image size limits needs update for aarch64 and ppc images: https://github.com/SUSE/BCI-tests/pull/160
- Error on
openssl gost
command with old podman version: https://github.com/SUSE/BCI-tests/pull/161
Updated by jlausuch almost 2 years ago
This one to remove obsolete jobs https://gitlab.suse.de/qac/qac-openqa-yaml/-/merge_requests/893
Updated by jlausuch almost 2 years ago
- Status changed from In Progress to Feedback
Updated by jlausuch almost 2 years ago
- Status changed from Feedback to In Progress
Updated by jlausuch almost 2 years ago
This is my attempt to do this:
https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/15270
Updated by jlausuch almost 2 years ago
And the last part for the job groups: https://gitlab.suse.de/qac/qac-openqa-yaml/-/merge_requests/910
Updated by jlausuch almost 2 years ago
- Status changed from In Progress to Feedback
Updated by slo-gin almost 2 years ago
This ticket was set to High priority but was not updated within the SLO period. Please consider picking up this ticket or just set the ticket to the next lower priority.
Updated by jlausuch almost 2 years ago
- Status changed from Feedback to Resolved
Example of job with this feature: https://openqa.suse.de/tests/9407251