action #89569
closed[qe-core] Unschedule suse_patches-systemd_testsuite from openqa.opensuse.org and openqa.suse.de
0%
Description
Observation¶
As a result of collaboration between "QA-SLE" and "System Boot & Init" team, "System Boot & Init" expressed the need to have aarch64, ppc64le and s390x machines. They only had x86_64 machines and Orthos machines weren't realiable.
To workaround that problem, tsaupe created an OBS project containing a modified version of the upstream systemd testsuite to be run on openQA. Being executed in openqa.opensuse.org and openqa.suse.de, we could verify at QA stage if systemd was ok for arch64, ppc64le and s390x.
Of course they needed to be able to execute those tests on DEV stage, before QA stage, so eventually they got aarch64, ppc64le and s390x machines and got help from "QE-SLE" to setup their team-wide openQA instance to run those tests.
By that time, the tests were running for so long on QA stage, that other QA teams were also using it and started making requests to maintain the test suites for already released products. In some discussion in a GitHub PR, Thomas accepted to do that. After some time Eli started contributing to fix the systemd test suite for openqa.opensuse.org and openqa.suse.de.
In a recent discussion with Eli, George and Sergio, we failed to find a reason to keep that test suite on openqa.opensuse.org and openqa.suse.de:
- It is an upstream test suite that doesn't add value at QA stage, because it is already covered and maintained by "System Boot & Init"'s openQA instance.
- "System Boot & Init" team seems to have stopped fixing the test suite for openqa.opensuse.org and openqa.suse.de.
- The test suite is failing for a long time wasting resources.
- There are already acceptance test modules in openqa.opensuse.org and openqa.suse.de that cover systemd.
Proposal¶
- Unschedule from openqa.opensuse.org and openqa.suse.de?
Resources¶
- e.g. upstream test suite adapted for Tumbleweed: https://build.opensuse.org/package/show/devel:openSUSE:QA:Tumbleweed/systemd-v245-testsuite
- e.g. openqa.opensuse.org test suite jobs: https://openqa.opensuse.org/tests/1656744#next_previous
- e.g. upstream test suite adapted for SLE15-SP3: https://build.suse.de/package/show/QA:Head:SLE15/systemd-v246-testsuite
- I don't find it in openqa.suse.de. Was it already decided to be removed for SLE15-SP3?