Project

General

Profile

Actions

action #116269

closed

coordination #90086: [epic] Refactor container tests

Automate creation of HDDs in qac-openqa-yaml pipeline

Added by jlausuch almost 2 years ago. Updated over 1 year ago.

Status:
Resolved
Priority:
Normal
Assignee:
Target version:
-
Start date:
2022-09-06
Due date:
% Done:

100%

Estimated time:

Description

The HDDs (qcow2's) that are used by BCI tests and other container tests are created here:
https://openqa.suse.de/group_overview/377

However, there is no automation on this. I trigger them on regular basis, but this has some risks if I am on leave or vacation, because having outdated HDDs might cause some timeouts in the BCI jobs while updating the system or things like this. Besides, it takes more time to run the tests. If we have regularly-updated HDDs, the BCI jobs take less time to update the system which results in an overall time execution.

The script to be run is already created:
https://gitlab.suse.de/qac/qac-openqa-yaml/-/blob/master/containers/create_hdd_isos_post.sh

This task is about automating this script in the gitlab-ci pipeline once a week (e.g. during the weekends).

After the HDDs are created, there are few steps to be done manually in OSD after the openqa jobs need to be completed and green:

cd /var/lib/openqa/share/factory/hdd
mv centOS-Stream-8-x86_64-20220128-minimal_new.qcow2 ./fixed/centOS-Stream-8-x86_64-20220128-minimal.qcow2
mv opensuse-15.2-x86_64-695.1-textmode@64bit_new.qcow2 ./fixed/opensuse-15.2-x86_64-695.1-textmode@64bit.qcow2
mv opensuse-15.3-x86_64-20210906-4-textmode@64bit_new.qcow2 ./fixed/opensuse-15.3-x86_64-20210906-4-textmode@64bit.qcow2
mv opensuse-15.4-x86_64-20220626-1-textmode@64bit_new.qcow2 ./fixed/opensuse-15.4-x86_64-20220626-1-textmode@64bit.qcow2
mv sles-es-7.9_new.qcow2 ./fixed/sles-es-7.9.qcow2
mv sles-es-8.5_new.qcow2 ./fixed/sles-es-8.5.qcow2
mv ubuntu-22.04_new.qcow2 ./fixed/ubuntu-22.04.qcow2
mv SUSE-MicroOS.aarch64-5.1.0-Default-GM-Updated.qcow2 ./fixed/
mv SUSE-MicroOS.aarch64-5.2.0-Default-GM-Updated.qcow2 ./fixed/
mv SUSE-MicroOS.s390x-5.1.0-Default-kvm-GM-Updated.qcow2 ./fixed/
mv SUSE-MicroOS.s390x-5.2.0-Default-kvm-GM-Updated.qcow2 ./fixed/
mv SUSE-MicroOS.x86_64-5.1.0-Default-GM-Updated.qcow2 ./fixed/
mv SUSE-MicroOS.x86_64-5.2.0-Default-GM-Updated.qcow2 ./fixed/

I don't really know how to automate this, as we need to wait for jobs to be done and completed. Maybe we can have another schedule a couple of hours after first one to do these operations... Or maybe schedule the job triggering on Saturdays and these commands on Sundays? I'm open to ideas.

Acceptance criteria

  • Create a new stage/job in gitlab-ci.yml to execute the hdd creation script.
  • Create a new schedule in the pipeline that triggers the openQA jobs once a week (e.g. on Saturdays).

Files

new-hdds.png (173 KB) new-hdds.png ph03nix, 2022-10-18 13:40

Related issues 4 (0 open4 closed)

Related to Containers - action #116443: test fails in host_configuration on 15-SP4 BCIResolvedph03nix2022-09-12

Actions
Related to Containers - action #108102: Create autoyast installation to create HDD for containers.Rejected2022-03-10

Actions
Has duplicate Containers - action #117517: Automate the container host image generation processRejectedph03nix2022-10-04

Actions
Has duplicate Containers - action #93588: Improve trigger create hdd scriptClosed2021-06-07

Actions
Actions

Also available in: Atom PDF