action #64285
open[qe-core][qem] Aggregate tests with GM base image
0%
Description
This is a test scenario designed to detect weak dependency breakage which caused certificate issues on SLE-12. https://bugzilla.suse.com/show_bug.cgi?id=1165915
Scenario:
- Start with GM base image of target SLE (only packages from GM pool)
- Collect package names from incident repos
- Install corresponding packages from GM pool repos
- Enable both update repos AND incident repos
- Do full system update
- Run package-specific tests
If you don't install old packages from GM pool first, zypper will order packages correctly through transitive dependencies. We're specifically trying to break transitive dependencies here.
If you separate system update from incident installation (splitting step 4), you may accidentally force correct ordering of transitive dependencies through release timing. In that case, dependency bugs will show up only if the packages with broken weak dependency both end up in testing queue at the same time (not guaranteed), of after both have been released (oh sh*t).
Updated by MDoucha about 4 years ago
Single incidents testsuite qam-minimal-full
can detect this type of problem in core system packages: https://openqa.suse.de/tests/3968930#step/install_patterns/32
Testsuite added into OpenQA schedule for CA certificate toolchain. This should prevent severe system breakage but a new test scenario is still needed for checking weak dependencies between non-core packages.
Updated by dzedro almost 4 years ago
- Status changed from New to Resolved
This have been solved by @osukup, added Incidents-Minimal to ca-certificates-mozilla e.g. https://build.suse.de/request/show/214718
Updated by dzedro almost 4 years ago
This test should be done in Aggregate tests, for packages which don't have incidents-minimal test.
Updated by tjyrinki_suse over 3 years ago
- Subject changed from [qam] Aggregate tests with GM base image to [qe-core][qam] Aggregate tests with GM base image
Updated by tjyrinki_suse over 3 years ago
- Subject changed from [qe-core][qam] Aggregate tests with GM base image to [qe-core][qem] Aggregate tests with GM base image
Updated by dzedro about 3 years ago
- Status changed from New to Resolved
This should be solved last ca-certificates-mozilla
https://build.suse.de/request/show/229547 did run full update within Incidents-Minimal.
Updated by MDoucha about 3 years ago
- Status changed from Resolved to New
dzedro wrote:
This should be solved last
ca-certificates-mozilla
https://build.suse.de/request/show/229547 did run full update within Incidents-Minimal.
This ticket isn't about one package.
MDoucha wrote:
Single incidents testsuite
qam-minimal-full
can detect this type of problem in core system packages: https://openqa.suse.de/tests/3968930#step/install_patterns/32Testsuite added into OpenQA schedule for CA certificate toolchain. This should prevent severe system breakage but a new test scenario is still needed for checking weak dependencies between non-core packages.
Updated by slo-gin over 1 year ago
This ticket was set to Normal priority but was not updated within the SLO period. Please consider picking up this ticket or just set the ticket to the next lower priority.