action #89569
closed[qe-core] Unschedule suse_patches-systemd_testsuite from openqa.opensuse.org and openqa.suse.de
0%
Description
Observation¶
As a result of collaboration between "QA-SLE" and "System Boot & Init" team, "System Boot & Init" expressed the need to have aarch64, ppc64le and s390x machines. They only had x86_64 machines and Orthos machines weren't realiable.
To workaround that problem, tsaupe created an OBS project containing a modified version of the upstream systemd testsuite to be run on openQA. Being executed in openqa.opensuse.org and openqa.suse.de, we could verify at QA stage if systemd was ok for arch64, ppc64le and s390x.
Of course they needed to be able to execute those tests on DEV stage, before QA stage, so eventually they got aarch64, ppc64le and s390x machines and got help from "QE-SLE" to setup their team-wide openQA instance to run those tests.
By that time, the tests were running for so long on QA stage, that other QA teams were also using it and started making requests to maintain the test suites for already released products. In some discussion in a GitHub PR, Thomas accepted to do that. After some time Eli started contributing to fix the systemd test suite for openqa.opensuse.org and openqa.suse.de.
In a recent discussion with Eli, George and Sergio, we failed to find a reason to keep that test suite on openqa.opensuse.org and openqa.suse.de:
- It is an upstream test suite that doesn't add value at QA stage, because it is already covered and maintained by "System Boot & Init"'s openQA instance.
- "System Boot & Init" team seems to have stopped fixing the test suite for openqa.opensuse.org and openqa.suse.de.
- The test suite is failing for a long time wasting resources.
- There are already acceptance test modules in openqa.opensuse.org and openqa.suse.de that cover systemd.
Proposal¶
- Unschedule from openqa.opensuse.org and openqa.suse.de?
Resources¶
- e.g. upstream test suite adapted for Tumbleweed: https://build.opensuse.org/package/show/devel:openSUSE:QA:Tumbleweed/systemd-v245-testsuite
- e.g. openqa.opensuse.org test suite jobs: https://openqa.opensuse.org/tests/1656744#next_previous
- e.g. upstream test suite adapted for SLE15-SP3: https://build.suse.de/package/show/QA:Head:SLE15/systemd-v246-testsuite
- I don't find it in openqa.suse.de. Was it already decided to be removed for SLE15-SP3?
Updated by eroca about 3 years ago
- Related to action #66352: [qe-core][opensuse] opensuse-Tumbleweed-DVD-aarch64-suse_patches-systemd_testsuite@aarch64 test fails in binary_tests, never completed added
Updated by tjyrinki_suse about 3 years ago
- Status changed from New to Workable
- Start date deleted (
2021-03-05)
Updated by dheidler about 3 years ago
- Status changed from Workable to In Progress
- Assignee set to dheidler
On OSD this seems to be scheduled in the following jobgroups:
https://openqa.suse.de/admin/job_templates/291 (this one seems to belong to sergio but since he left I think we can completely delete it)
https://openqa.suse.de/admin/job_templates/132
The YAML testsuite schedule should be this one: schedule/systemd/suse_patches-systemd_testsuite.yaml
Updated by dheidler about 3 years ago
Updated by dheidler about 3 years ago
BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDD_1=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%.qcow2
ISO=
NUMDISKS=2
QEMURAM=2048
START_AFTER_TEST=create_hdd_textmode
SYSTEMD_TESTSUITE=noqemu
UEFI_PFLASH_VARS=%DISTRI%-%VERSION%-%ARCH%-%BUILD%-%DESKTOP%@%MACHINE%-uefi-vars.qcow2
Updated by dheidler about 3 years ago
@@ -79,7 +79,6 @@
scenarios:
aarch64:
sle-12-SP5-Server-DVD-aarch64:
- - suse_patches-systemd_testsuite
- cryptlvm+cancel_existing+force_recompute:
priority: 90
- lvm_thin_provisioning
@@ -87,7 +86,6 @@
ppc64le:
sle-12-SP5-Server-DVD-ppc64le:
- extra_tests_filesystem
- - suse_patches-systemd_testsuite
- wicked_advanced_ref: &wicked_settings
settings:
DESKTOP: textmode
Updated by dheidler about 3 years ago
@ -7,7 +7,4 @@
distri: opensuse
flavor: DVD
version: '15.2'
-scenarios:
+scenarios: {}
- x86_64:
- opensuse-15.2-DVD-x86_64:
- - suse_patches-systemd_testsuite
Updated by dheidler about 3 years ago
@@ -112,7 +112,6 @@
priority: 60
- repo_inst
- create_hdd_textmode_ext4
- - suse_patches-systemd_testsuite
- desktopapps-firefox-x11:
settings:
DESKTOP: gnome
@@ -245,7 +244,6 @@
- samba_ncurses
- gnome+do_not_import_ssh_keys
- external_iso
- - suse_patches-systemd_testsuite
- desktopapps-message-wayland:
machine: 64bit_virtio
- repo_inst
Updated by dheidler about 3 years ago
% openqa-client --host openqa.suse.de job_groups/291 DELETE
{ id => 291 }
Updated by dheidler about 3 years ago
Updated by dheidler about 3 years ago
- Status changed from In Progress to Feedback
Updated by szarate almost 3 years ago
- Target version changed from Ready to QE-Core: Ready