Project

General

Profile

action #122296

Fix openqa-trigger-bisect-jobs to actually remove incidents from bisection tests again

Added by okurz 3 months ago. Updated about 1 month ago.

Status:
New
Priority:
Normal
Assignee:
Category:
Concrete Bugs
Target version:
Start date:
2022-12-21
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Motivation

Originally brought up in #97118#note-10 by okurz and mgrifalconi.
https://github.com/os-autoinst/scripts/blob/master/openqa-trigger-bisect-jobs originally removed individual incidents from a list to conduct tests excluding specific incidents to be able to bisect with/without individual incidents. Seems like something was changed in the test architecture to install all updates in the image generation jobs meaning that the repos and packages from the repos are not removed by just changing the test variable content within bisection jobs. The test code needs to be changed to account for that. Maybe as simple as removing the according zypper repo and calling zypper dup or zypper rm or something.

Impact

All results of "openqa-trigger-bisect-jobs" are invalid as the mentioned incidents are not actually excluded. Without correct results also "openqa-trigger-bisect-jobs" can not be used for any automatic decisions which would help in the daily work of openQA reviewers concerning SLE maintenance update testing.

Acceptance criteria

Suggestions


Related issues

Related to QA - action #97118: enhance bot automatic approval: check multiple daysNew2021-08-18

Blocks openQA Tests - action #124379: [qe-core] geekotest bisect is broken for child test runsBlocked2023-02-13

Blocks openQA Tests - action #124370: [qe-core] geekotest bisect is not removing the issue from all test repositoriesBlocked2023-02-13

History

#1 Updated by okurz 3 months ago

  • Related to action #97118: enhance bot automatic approval: check multiple days added

#2 Updated by okurz 3 months ago

  • Description updated (diff)

fixed "included/excluded"

#3 Updated by slo-gin 2 months ago

This ticket was set to High priority but was not updated within the SLO period. Please consider picking up this ticket or just set the ticket to the next lower priority.

#4 Updated by okurz about 1 month ago

  • Blocks action #124379: [qe-core] geekotest bisect is broken for child test runs added

#5 Updated by okurz about 1 month ago

  • Blocks action #124370: [qe-core] geekotest bisect is not removing the issue from all test repositories added

#6 Updated by szarate about 1 month ago

  • Project changed from openQA Tests to openQA Project
  • Subject changed from [qe-core] Fix openqa-trigger-bisect-jobs to actually remove incidents from bisection tests again to Fix openqa-trigger-bisect-jobs to actually remove incidents from bisection tests again
  • Category changed from Bugs in existing tests to Concrete Bugs
  • Assignee set to okurz

QE-Core didnĀ“t implement the feature, while we might be one of the consumers, atm to the best of my knowledge we don't have know-how on this, and since it's an important thing for reviewers, tools team is better equipped to fix the problem. We can take over when working on: https://progress.opensuse.org/issues/106930#note-21

#7 Updated by szarate about 1 month ago

  • Category deleted (Concrete Bugs)

See my comment on #124379, If you plan to reassign the ticket again, better reject it, and bring the topic to the Wednesday Sync meeting.

#8 Updated by okurz about 1 month ago

  • Tags set to scripts, tests, bisect, maintenance
  • Category set to Concrete Bugs
  • Assignee deleted (okurz)
  • Priority changed from High to Normal
  • Target version set to future

szarate wrote:

See my comment on #124379, If you plan to reassign the ticket again, better reject it, and bring the topic to the Wednesday Sync meeting.

uh, I don't see a comment by you on #124379. Which one do you mean?

The reason why I do not consider this ticket for the tools team is that the approach of openqa-trigger-bisect-jobs worked just fine until os-autoinst-distri-opensuse together with schedules have been restructured. I doubt it's an efficient approach if I ask people within the SUSE QE Tools team to follow changes done by QE Core and integrate fixes without introducing regressions. Also the changes would need to be done within os-autoinst-distri-opensuse.

#9 Updated by szarate about 1 month ago

  • Tags deleted (scripts, tests, bisect, maintenance)
  • Assignee set to okurz
  • Priority changed from Normal to High
  • Target version deleted (future)

okurz wrote:

szarate wrote:

See my comment on #124379, If you plan to reassign the ticket again, better reject it, and bring the topic to the Wednesday Sync meeting.

uh, I don't see a comment by you on #124379. Which one do you mean?

My bad, copy pasted in the wrong place :) I meant the comment on #122296#note-6

#10 Updated by szarate about 1 month ago

  • Tags set to scripts, tests, bisect, maintenance
  • Priority changed from High to Normal
  • Target version set to future

Sometimes, I don't love redmine.

Also available in: Atom PDF