Project

General

Profile

Actions

action #64285

open

[qe-core][qem] Aggregate tests with GM base image

Added by MDoucha about 4 years ago. Updated over 1 year ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
New test
Target version:
-
Start date:
2020-03-06
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

This is a test scenario designed to detect weak dependency breakage which caused certificate issues on SLE-12. https://bugzilla.suse.com/show_bug.cgi?id=1165915

Scenario:

  1. Start with GM base image of target SLE (only packages from GM pool)
  2. Collect package names from incident repos
  3. Install corresponding packages from GM pool repos
  4. Enable both update repos AND incident repos
  5. Do full system update
  6. Run package-specific tests

If you don't install old packages from GM pool first, zypper will order packages correctly through transitive dependencies. We're specifically trying to break transitive dependencies here.

If you separate system update from incident installation (splitting step 4), you may accidentally force correct ordering of transitive dependencies through release timing. In that case, dependency bugs will show up only if the packages with broken weak dependency both end up in testing queue at the same time (not guaranteed), of after both have been released (oh sh*t).

Actions #1

Updated by MDoucha about 4 years ago

Single incidents testsuite qam-minimal-full can detect this type of problem in core system packages: https://openqa.suse.de/tests/3968930#step/install_patterns/32

Testsuite added into OpenQA schedule for CA certificate toolchain. This should prevent severe system breakage but a new test scenario is still needed for checking weak dependencies between non-core packages.

Actions #2

Updated by dzedro almost 4 years ago

  • Status changed from New to Resolved

This have been solved by @osukup, added Incidents-Minimal to ca-certificates-mozilla e.g. https://build.suse.de/request/show/214718

Actions #3

Updated by dzedro almost 4 years ago

This test should be done in Aggregate tests, for packages which don't have incidents-minimal test.

Actions #4

Updated by dzedro almost 4 years ago

  • Status changed from Resolved to New
Actions #5

Updated by tjyrinki_suse over 3 years ago

  • Status changed from New to Workable
Actions #6

Updated by tjyrinki_suse over 3 years ago

  • Subject changed from [qam] Aggregate tests with GM base image to [qe-core][qam] Aggregate tests with GM base image
Actions #7

Updated by tjyrinki_suse over 3 years ago

  • Subject changed from [qe-core][qam] Aggregate tests with GM base image to [qe-core][qem] Aggregate tests with GM base image
Actions #8

Updated by szarate about 3 years ago

  • Status changed from Workable to New
Actions #9

Updated by tjyrinki_suse about 3 years ago

  • Priority changed from High to Normal
Actions #10

Updated by dzedro about 3 years ago

  • Status changed from New to Resolved

This should be solved last ca-certificates-mozilla https://build.suse.de/request/show/229547 did run full update within Incidents-Minimal.

Actions #11

Updated by MDoucha about 3 years ago

  • Status changed from Resolved to New

dzedro wrote:

This should be solved last ca-certificates-mozilla https://build.suse.de/request/show/229547 did run full update within Incidents-Minimal.

This ticket isn't about one package.

MDoucha wrote:

Single incidents testsuite qam-minimal-full can detect this type of problem in core system packages: https://openqa.suse.de/tests/3968930#step/install_patterns/32

Testsuite added into OpenQA schedule for CA certificate toolchain. This should prevent severe system breakage but a new test scenario is still needed for checking weak dependencies between non-core packages.

Actions #12

Updated by slo-gin over 1 year ago

This ticket was set to Normal priority but was not updated within the SLO period. Please consider picking up this ticket or just set the ticket to the next lower priority.

Actions

Also available in: Atom PDF