Project

General

Profile

Actions
Copy link

action #113501

closed

coordination #103323: [epic] BCI testing

Merge Base Image tests for 15-SP3 and 15-SP4 with BCI tests

Added by jlausuch almost 2 years ago. Updated almost 2 years ago.

Status:
Resolved
Priority:
High
Assignee:
jlausuch
Target version:
-
Start date:
2022-07-12
Due date:
% Done:

0%

Estimated time:

Description

We are currently testing Base image with our tests in os-autoinst-distri-opensuse
15-SP3
15-SP4

This coverage has be ok so far, but we need to extend it to use BCI-tests, specially test_base.py as it contains further coverage for this image.

In order to run both tests in the same job, we need to do the following things:
1) Remove the former job groups

2) In the container bot, move base image for 15-SP3 and 15-SP4 from
https://gitlab.suse.de/qac/container-release-bot/-/blob/main/containers/sle15.yaml
to
https://gitlab.suse.de/qac/container-release-bot/-/blob/main/containers/bci15sp3.yaml
https://gitlab.suse.de/qac/container-release-bot/-/blob/main/containers/bci15sp4.yaml
Also, change the job group ID to the groups 378 and 395 accordingly.

3) New jobs should have:

BCI_TESTS: "1"
BCI_TESTS_REPO: "https://github.com/SUSE/BCI-tests.git"
BCI_TIMEOUT: "5400" # some tests take very long, specially in aarch64

but we need to tweak the conditional schedule in main_containers.pm to also run load_image_tests_podman and load_image_tests_docker for 15-SP3 and beyond.

Acceptance criteria

Move 15-SP3 and 15-SP4 jobs to https://openqa.suse.de/group_overview/442 and https://openqa.suse.de/group_overview/443 respectively and execute both:
1) Current perl module tests
2) BCI-tests base tests

Actions
Copy link
 #1

Updated by jlausuch almost 2 years ago

  • Priority changed from Normal to High
Actions
Copy link
 #2

Updated by jlausuch almost 2 years ago

  • Status changed from Workable to In Progress
  • Assignee set to jlausuch
Actions
Copy link
 #3

Updated by jlausuch almost 2 years ago

We already have mediums created with BCI-Updates flavor for 15-SP3 and 15-SP4, so let's use them as well for Base images.

Actions
Copy link
 #5

Updated by jlausuch almost 2 years ago

and MR in the container bot to move the images to bci yamls, and also flavor change to BCI-Updates and group change to 442 and 443.
https://gitlab.suse.de/qac/container-release-bot/-/merge_requests/81

Actions
Copy link
 #6

Updated by jlausuch almost 2 years ago

I have detected 2 issues with running BCI-tests for the first time with the base image:

Actions
Copy link
 #8

Updated by jlausuch almost 2 years ago

  • Status changed from In Progress to Feedback
Actions
Copy link
 #9

Updated by jlausuch almost 2 years ago

  • Status changed from Feedback to In Progress
Actions
Copy link
 #11

Updated by jlausuch almost 2 years ago

Actions
Copy link
 #12

Updated by jlausuch almost 2 years ago

  • Status changed from In Progress to Feedback
Actions
Copy link
 #13

Updated by slo-gin almost 2 years ago

This ticket was set to High priority but was not updated within the SLO period. Please consider picking up this ticket or just set the ticket to the next lower priority.

Actions
Copy link
 #14

Updated by jlausuch almost 2 years ago

  • Status changed from Feedback to Resolved

Example of job with this feature: https://openqa.suse.de/tests/9407251

Actions
Copy link

Also available in: Atom PDF