Project

General

Profile

Actions

action #161741

closed

Enable BCI tests for Factory (Tumbleweed containers) in openqa.opensuse.org

Added by jlausuch 26 days ago. Updated 24 days ago.

Status:
Resolved
Priority:
Normal
Assignee:
Target version:
-
Start date:
2024-06-04
Due date:
% Done:

0%

Estimated time:

Description

To have some testing feedback about Tumbleweed BCI containers, we shall enable the tests on O3.

However, there is no need to use the current container bot. The tests shall be triggered for daily Tumbleweed Snapshots, so we can re-use one of the DVD tests which installs the Tumbleweed ISO and creates an HDD.
Then, use that qcow image to boot Tumbleweed a run all the BCI-test suite using the following env variables:

TARGET=factory-totest
OS_VERSION=tumbleweed

There is no need to specify a specific tag like we do for BCI in SLE (-k flag) where we test each container separately. In this case, we can test all in one command. So, the final command could look something like:
TARGET=factory-totest && OS_VERSION=tumbleweed && tox -e all -- -rxX -n auto.

https://github.com/SUSE/BCI-tests/blob/main/bci_tester/data.py#L137


Related issues 1 (0 open1 closed)

Related to Containers - action #132338: Enable BCI-tests for openSUSE TumbleweedResolvedmloviska2023-07-05

Actions
Actions #1

Updated by mloviska 26 days ago

  • Status changed from New to In Progress
  • Assignee set to mloviska
Actions #2

Updated by mloviska 26 days ago

  • Related to action #132338: Enable BCI-tests for openSUSE Tumbleweed added
Actions #3

Updated by mloviska 26 days ago

Current BCI test setup ( from last good of busybox ) https://openqa.opensuse.org/tests/4102385#

"BCI_IMAGE_MARKER": "bci-busybox_latest",
  "BCI_TARGET": "factory-totest",
  "BCI_TESTS": "1",
  "BCI_TESTS_REPO": "https://github.com/SUSE/BCI-tests.git",
  "BCI_TEST_ENVS": "busybox",
  "BCI_TIMEOUT": "5400",

Cmd:

timeout 5400 tox -e all -- -rxX -n auto -k "bci-busybox_latest" --reruns 3 --reruns-delay 10| tee tox_output.txt; echo ayD3n-$?-
Actions #4

Updated by mloviska 26 days ago

missing BCI_PREPARE=1

Actions #5

Updated by mloviska 26 days ago

works in http://kepler.suse.cz/tests/23440#

Current BCI jg setup

.bci: &bci
  BOOT_HDD_IMAGE: "1"
  DESKTOP: "textmode"
  NOVIDEO: "1"
  VIDEOMODE: "text"
  MAX_JOB_TIME: '10800'
  BCI_TESTS: "1"
  BCI_PREPARE: "1"
  BCI_TESTS_REPO: "https://github.com/SUSE/BCI-tests.git"
  BCI_TIMEOUT: "5400"  # some tests take very long, specially in aarch64
  # BCI_TEST_ENVS: "all,base,init,dotnet,python,node,go,openjdk,openjdk_devel,minimal,repository,multistage"
  QEMUCPUS: "2"
  QEMURAM: "4096"
  START_AFTER_TEST: "create_hdd_textmode"
  CONTAINER_RUNTIMES: "podman"
  BCI_TARGET: "factory-totest"
  HDD_1: '%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2'
Actions #6

Updated by mloviska 26 days ago

Testing with new var

❯ for i in {4246372,4246373,4246374,4246375,4246376,4246380,4246381,4246382}; do /usr/bin/openqa-clone-job $i --within-instance "https://openqa.opensuse.org" --skip-chained-deps BCI_PREPARE=1; done
Cloning parents of opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_busybox_podman@64bit
1 job has been created:
 - opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_busybox_podman@64bit -> https://openqa.opensuse.org/tests/4247620
Cloning parents of opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_golang_podman@64bit
1 job has been created:
 - opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_golang_podman@64bit -> https://openqa.opensuse.org/tests/4247621
Cloning parents of opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_init_podman@64bit
1 job has been created:
 - opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_init_podman@64bit -> https://openqa.opensuse.org/tests/4247622
Cloning parents of opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_micro_podman@64bit
1 job has been created:
 - opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_micro_podman@64bit -> https://openqa.opensuse.org/tests/4247623
Cloning parents of opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_minimal_podman@64bit
1 job has been created:
 - opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_minimal_podman@64bit -> https://openqa.opensuse.org/tests/4247624
Cloning parents of opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_postgres_podman@64bit
1 job has been created:
 - opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_postgres_podman@64bit -> https://openqa.opensuse.org/tests/4247625
Cloning parents of opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_ruby_podman@64bit
1 job has been created:
 - opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_ruby_podman@64bit -> https://openqa.opensuse.org/tests/4247626
Cloning parents of opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_rust_podman@64bit
1 job has been created:
 - opensuse-Tumbleweed-DVD-x86_64-Build20240603-bci_rust_podman@64bit -> https://openqa.opensuse.org/tests/4247627
Actions #7

Updated by mloviska 26 days ago

  • Status changed from In Progress to Feedback
Actions

Also available in: Atom PDF