Project

General

Profile

action #67357

[qem][packageinstallation][qe-core] Add validation step that checks the version of the updated binaries

Added by apappas over 1 year ago. Updated 2 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Infrastructure
Target version:
-
Start date:
2020-05-27
Due date:
% Done:

100%

Estimated time:
Difficulty:

Description

This relates to #65666 in that a check should be made on whether the installation succeeded, according to the following criteria.

  1. All the L3 binaries of the packages contained in the incident are installed and their version number has changed.
  2. All the L2 binaries of the packages contained in the incident are installed and their version number is ignored.
  3. New L2 and L3 binaries are installed after applying the update. The status of unsupported binaries is logged, but does not affect test failure or success. L2, L3 and unsupported are levels as exist in the SUSE:Channels.

This does not change the way an update is installed.

History

#2 Updated by tjyrinki_suse over 1 year ago

  • Subject changed from Add validation step that checks the version of the updated binaries to [qam] [packageinstallation] Add validation step that checks the version of the updated binaries
  • Status changed from New to In Progress

#3 Updated by apappas over 1 year ago

  • Status changed from In Progress to Resolved

PR merged

#4 Updated by apappas over 1 year ago

  • % Done changed from 80 to 100

#5 Updated by apappas over 1 year ago

  • Project changed from QAM to openQA Tests

#6 Updated by openqa_review over 1 year ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-sap
https://openqa.suse.de/tests/4482720

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#7 Updated by openqa_review over 1 year ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-sap
https://openqa.suse.de/tests/4564637

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#8 Updated by okurz about 1 year ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-ha
https://openqa.suse.de/tests/4658452

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#9 Updated by okurz about 1 year ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall@aarch64-virtio
https://openqa.suse.de/tests/4854065

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#10 Updated by okurz about 1 year ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-ha
https://openqa.suse.de/tests/5012256

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#11 Updated by okurz 12 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-ha
https://openqa.suse.de/tests/5114145

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#12 Updated by okurz 12 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall
https://openqa.suse.de/tests/5174557

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#13 Updated by okurz 11 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall
https://openqa.suse.de/tests/5231489

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#14 Updated by okurz 11 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-ha
https://openqa.suse.de/tests/5256799

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#15 Updated by okurz 10 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-ha
https://openqa.suse.de/tests/5055581

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#16 Updated by okurz 10 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-ha
https://openqa.suse.de/tests/5419595

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#17 Updated by okurz 9 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-ha
https://openqa.suse.de/tests/5451134

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#18 Updated by openqa_review 9 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-ha
https://openqa.suse.de/tests/5581749

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#19 Updated by okurz 8 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-ha
https://openqa.suse.de/tests/5581749

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#20 Updated by openqa_review 8 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-ha
https://openqa.suse.de/tests/5581749

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#21 Updated by okurz 8 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall
https://openqa.suse.de/tests/5795937

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#22 Updated by openqa_review 6 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall
https://openqa.suse.de/tests/6078201

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#23 Updated by okurz 6 months ago

  • Status changed from Resolved to Feedback

Reopening due to the above report

#24 Updated by tjyrinki_suse 6 months ago

  • Category set to Infrastructure

#25 Updated by openqa_review 5 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall
https://openqa.suse.de/tests/6408612

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed

#26 Updated by openqa_review 4 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-ha
https://openqa.suse.de/tests/6425208

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed

#27 Updated by okurz 4 months ago

  • Subject changed from [qam] [packageinstallation] Add validation step that checks the version of the updated binaries to [qam] [packageinstallation][qe-core] Add validation step that checks the version of the updated binaries

#28 Updated by openqa_review 4 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-incidentinstall-ha
https://openqa.suse.de/tests/6425208

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed

#29 Updated by tjyrinki_suse 4 months ago

  • Subject changed from [qam] [packageinstallation][qe-core] Add validation step that checks the version of the updated binaries to [qem][packageinstallation][qe-core] Add validation step that checks the version of the updated binaries

#30 Updated by okurz 3 months ago

  • Priority changed from Urgent to Normal

This ticket showed up in the SLO related queries from https://progress.opensuse.org/projects/openqatests/wiki/Wiki#SLOs-service-level-objectives and also there had been multiple reminder comments. As the last automatic reminder comment was actually from 20 days ago for a seemingly released product and no further automatic reminder comment since then I at least don't consider it "Urgent" so reducing prio.

apappas you created the ticket and assigned to yourself already on creation time but then have not worked on the ticket since then. Maybe this was a mistake and should be unassigned?

#31 Updated by apappas 3 months ago

The version check part of the ticket was completed. As part of that, I added a softfail where updates where installed but not for all packages in the update as reported by SMELT/IBS. This is expected as the install test has limited to no depedency resolution. Eventually dependency resolution will be added and I assumed this record of softfailures would fail.

I think that the ticket should move to being resolved, unless you disagree with the soft-failure.

I am sorry for not responding earlier, I am fixing my progress tooling and etiquette.

#32 Updated by apappas 2 months ago

  • Status changed from Feedback to Resolved

Also available in: Atom PDF