Project

General

Profile

action #64285

[qe-core][qem] Aggregate tests with GM base image

Added by MDoucha over 1 year ago. Updated 7 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
New test
Target version:
-
Start date:
2020-03-06
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

This is a test scenario designed to detect weak dependency breakage which caused certificate issues on SLE-12. https://bugzilla.suse.com/show_bug.cgi?id=1165915

Scenario:

  1. Start with GM base image of target SLE (only packages from GM pool)
  2. Collect package names from incident repos
  3. Install corresponding packages from GM pool repos
  4. Enable both update repos AND incident repos
  5. Do full system update
  6. Run package-specific tests

If you don't install old packages from GM pool first, zypper will order packages correctly through transitive dependencies. We're specifically trying to break transitive dependencies here.

If you separate system update from incident installation (splitting step 4), you may accidentally force correct ordering of transitive dependencies through release timing. In that case, dependency bugs will show up only if the packages with broken weak dependency both end up in testing queue at the same time (not guaranteed), of after both have been released (oh sh*t).

History

#1 Updated by MDoucha over 1 year ago

Single incidents testsuite qam-minimal-full can detect this type of problem in core system packages: https://openqa.suse.de/tests/3968930#step/install_patterns/32

Testsuite added into OpenQA schedule for CA certificate toolchain. This should prevent severe system breakage but a new test scenario is still needed for checking weak dependencies between non-core packages.

#2 Updated by dzedro over 1 year ago

  • Status changed from New to Resolved

This have been solved by osukup, added Incidents-Minimal to ca-certificates-mozilla e.g. https://build.suse.de/request/show/214718

#3 Updated by dzedro over 1 year ago

This test should be done in Aggregate tests, for packages which don't have incidents-minimal test.

#4 Updated by dzedro over 1 year ago

  • Status changed from Resolved to New

#5 Updated by tjyrinki_suse about 1 year ago

  • Status changed from New to Workable

#6 Updated by tjyrinki_suse 11 months ago

  • Subject changed from [qam] Aggregate tests with GM base image to [qe-core][qam] Aggregate tests with GM base image

#7 Updated by tjyrinki_suse 10 months ago

  • Subject changed from [qe-core][qam] Aggregate tests with GM base image to [qe-core][qem] Aggregate tests with GM base image

#8 Updated by szarate 7 months ago

  • Status changed from Workable to New

#9 Updated by tjyrinki_suse 7 months ago

  • Priority changed from High to Normal

#10 Updated by dzedro 7 months ago

  • Status changed from New to Resolved

This should be solved last ca-certificates-mozilla https://build.suse.de/request/show/229547 did run full update within Incidents-Minimal.

#11 Updated by MDoucha 7 months ago

  • Status changed from Resolved to New

dzedro wrote:

This should be solved last ca-certificates-mozilla https://build.suse.de/request/show/229547 did run full update within Incidents-Minimal.

This ticket isn't about one package.

MDoucha wrote:

Single incidents testsuite qam-minimal-full can detect this type of problem in core system packages: https://openqa.suse.de/tests/3968930#step/install_patterns/32

Testsuite added into OpenQA schedule for CA certificate toolchain. This should prevent severe system breakage but a new test scenario is still needed for checking weak dependencies between non-core packages.

Also available in: Atom PDF