action #64285
open
[qe-core][qem] Aggregate tests with GM base image
Added by MDoucha about 4 years ago.
Updated about 2 months ago.
Description
This is a test scenario designed to detect weak dependency breakage which caused certificate issues on SLE-12. https://bugzilla.suse.com/show_bug.cgi?id=1165915
Scenario:
- Start with GM base image of target SLE (only packages from GM pool)
- Collect package names from incident repos
- Install corresponding packages from GM pool repos
- Enable both update repos AND incident repos
- Do full system update
- Run package-specific tests
If you don't install old packages from GM pool first, zypper will order packages correctly through transitive dependencies. We're specifically trying to break transitive dependencies here.
If you separate system update from incident installation (splitting step 4), you may accidentally force correct ordering of transitive dependencies through release timing. In that case, dependency bugs will show up only if the packages with broken weak dependency both end up in testing queue at the same time (not guaranteed), of after both have been released (oh sh*t).
Single incidents testsuite qam-minimal-full can detect this type of problem in core system packages: https://openqa.suse.de/tests/3968930#step/install_patterns/32
Testsuite added into OpenQA schedule for CA certificate toolchain. This should prevent severe system breakage but a new test scenario is still needed for checking weak dependencies between non-core packages.
- Status changed from New to Resolved
This test should be done in Aggregate tests, for packages which don't have incidents-minimal test.
- Status changed from Resolved to New
- Status changed from New to Workable
- Subject changed from [qam] Aggregate tests with GM base image to [qe-core][qam] Aggregate tests with GM base image
- Subject changed from [qe-core][qam] Aggregate tests with GM base image to [qe-core][qem] Aggregate tests with GM base image
- Status changed from Workable to New
- Priority changed from High to Normal
- Status changed from New to Resolved
- Status changed from Resolved to New
dzedro wrote:
This should be solved last ca-certificates-mozilla https://build.suse.de/request/show/229547 did run full update within Incidents-Minimal.
This ticket isn't about one package.
MDoucha wrote:
Single incidents testsuite qam-minimal-full can detect this type of problem in core system packages: https://openqa.suse.de/tests/3968930#step/install_patterns/32
Testsuite added into OpenQA schedule for CA certificate toolchain. This should prevent severe system breakage but a new test scenario is still needed for checking weak dependencies between non-core packages.
This ticket was set to Normal priority but was not updated within the SLO period. Please consider picking up this ticket or just set the ticket to the next lower priority.
This ticket was set to Normal priority but was not updated within the SLO period. Please consider picking up this ticket or just set the ticket to the next lower priority.
Also available in: Atom
PDF