action #122296
open
Fix openqa-trigger-bisect-jobs to actually remove incidents from bisection tests again
Added by okurz almost 2 years ago.
Updated 11 months ago.
Category:
Regressions/Crashes
Description
Motivation¶
Originally brought up in #97118#note-10 by okurz and mgrifalconi.
https://github.com/os-autoinst/scripts/blob/master/openqa-trigger-bisect-jobs originally removed individual incidents from a list to conduct tests excluding specific incidents to be able to bisect with/without individual incidents. Seems like something was changed in the test architecture to install all updates in the image generation jobs meaning that the repos and packages from the repos are not removed by just changing the test variable content within bisection jobs. The test code needs to be changed to account for that. Maybe as simple as removing the according zypper repo and calling zypper dup
or zypper rm
or something.
Impact¶
All results of "openqa-trigger-bisect-jobs" are invalid as the mentioned incidents are not actually excluded. Without correct results also "openqa-trigger-bisect-jobs" can not be used for any automatic decisions which would help in the daily work of openQA reviewers concerning SLE maintenance update testing.
Acceptance criteria¶
Suggestions¶
- Related to action #97118: enhance bot automatic approval: check multiple days added
- Description updated (diff)
fixed "included/excluded"
This ticket was set to High priority but was not updated within the SLO period. Please consider picking up this ticket or just set the ticket to the next lower priority.
- Blocks action #124379: [qe-core] geekotest bisect is broken for child test runs added
- Blocks action #124370: [qe-core] geekotest bisect is not removing the issue from all test repositories added
- Project changed from openQA Tests (public) to openQA Project (public)
- Subject changed from [qe-core] Fix openqa-trigger-bisect-jobs to actually remove incidents from bisection tests again to Fix openqa-trigger-bisect-jobs to actually remove incidents from bisection tests again
- Category changed from Bugs in existing tests to Regressions/Crashes
- Assignee set to okurz
QE-Core didnĀ“t implement the feature, while we might be one of the consumers, atm to the best of my knowledge we don't have know-how on this, and since it's an important thing for reviewers, tools team is better equipped to fix the problem. We can take over when working on: https://progress.opensuse.org/issues/106930#note-21
- Category deleted (
Regressions/Crashes)
See my comment on #124379, If you plan to reassign the ticket again, better reject it, and bring the topic to the Wednesday Sync meeting.
- Tags set to scripts, tests, bisect, maintenance
- Category set to Regressions/Crashes
- Assignee deleted (
okurz)
- Priority changed from High to Normal
- Target version set to future
szarate wrote:
See my comment on #124379, If you plan to reassign the ticket again, better reject it, and bring the topic to the Wednesday Sync meeting.
uh, I don't see a comment by you on #124379. Which one do you mean?
The reason why I do not consider this ticket for the tools team is that the approach of openqa-trigger-bisect-jobs worked just fine until os-autoinst-distri-opensuse together with schedules have been restructured. I doubt it's an efficient approach if I ask people within the SUSE QE Tools team to follow changes done by QE Core and integrate fixes without introducing regressions. Also the changes would need to be done within os-autoinst-distri-opensuse.
- Tags deleted (
scripts, tests, bisect, maintenance)
- Assignee set to okurz
- Priority changed from Normal to High
- Target version deleted (
future)
okurz wrote:
szarate wrote:
See my comment on #124379, If you plan to reassign the ticket again, better reject it, and bring the topic to the Wednesday Sync meeting.
uh, I don't see a comment by you on #124379. Which one do you mean?
My bad, copy pasted in the wrong place :) I meant the comment on #122296#note-6
- Tags set to scripts, tests, bisect, maintenance
- Priority changed from High to Normal
- Target version set to future
Sometimes, I don't love redmine.
- Related to action #131204: openqa-trigger-bisect-jobs is called on passed jobs size:M added
- Blocks deleted (action #124379: [qe-core] geekotest bisect is broken for child test runs)
- Assignee set to szarate
- Start date changed from 2022-12-21 to 2022-12-13
Not moving to the core backlog but planning to pick it up by then
You want to start 14 months ago? ;)
- Start date changed from 2022-12-13 to 2024-02-13
Also available in: Atom
PDF