Project

General

Profile

Actions

action #122296

open

Fix openqa-trigger-bisect-jobs to actually remove incidents from bisection tests again

Added by okurz almost 2 years ago. Updated 8 months ago.

Status:
New
Priority:
Normal
Assignee:
Category:
Regressions/Crashes
Target version:
Start date:
2024-02-13
Due date:
% Done:

0%

Estimated time:

Description

Motivation

Originally brought up in #97118#note-10 by okurz and mgrifalconi.
https://github.com/os-autoinst/scripts/blob/master/openqa-trigger-bisect-jobs originally removed individual incidents from a list to conduct tests excluding specific incidents to be able to bisect with/without individual incidents. Seems like something was changed in the test architecture to install all updates in the image generation jobs meaning that the repos and packages from the repos are not removed by just changing the test variable content within bisection jobs. The test code needs to be changed to account for that. Maybe as simple as removing the according zypper repo and calling zypper dup or zypper rm or something.

Impact

All results of "openqa-trigger-bisect-jobs" are invalid as the mentioned incidents are not actually excluded. Without correct results also "openqa-trigger-bisect-jobs" can not be used for any automatic decisions which would help in the daily work of openQA reviewers concerning SLE maintenance update testing.

Acceptance criteria

Suggestions


Related issues 3 (1 open2 closed)

Related to QA - action #97118: enhance bot automatic approval: check multiple daysResolvedmgrifalconi2021-08-18

Actions
Related to openQA Project - action #131204: openqa-trigger-bisect-jobs is called on passed jobs size:MResolveddheidler2023-06-212023-07-04

Actions
Blocks openQA Tests - action #124370: [qe-core] geekotest bisect is not removing the issue from all test repositoriesBlockedszarate2023-02-13

Actions
Actions #1

Updated by okurz almost 2 years ago

  • Related to action #97118: enhance bot automatic approval: check multiple days added
Actions #2

Updated by okurz almost 2 years ago

  • Description updated (diff)

fixed "included/excluded"

Actions #3

Updated by slo-gin over 1 year ago

This ticket was set to High priority but was not updated within the SLO period. Please consider picking up this ticket or just set the ticket to the next lower priority.

Actions #4

Updated by okurz over 1 year ago

  • Blocks action #124379: [qe-core] geekotest bisect is broken for child test runs added
Actions #5

Updated by okurz over 1 year ago

  • Blocks action #124370: [qe-core] geekotest bisect is not removing the issue from all test repositories added
Actions #6

Updated by szarate over 1 year ago

  • Project changed from openQA Tests to openQA Project
  • Subject changed from [qe-core] Fix openqa-trigger-bisect-jobs to actually remove incidents from bisection tests again to Fix openqa-trigger-bisect-jobs to actually remove incidents from bisection tests again
  • Category changed from Bugs in existing tests to Regressions/Crashes
  • Assignee set to okurz

QE-Core didnĀ“t implement the feature, while we might be one of the consumers, atm to the best of my knowledge we don't have know-how on this, and since it's an important thing for reviewers, tools team is better equipped to fix the problem. We can take over when working on: https://progress.opensuse.org/issues/106930#note-21

Actions #7

Updated by szarate over 1 year ago

  • Category deleted (Regressions/Crashes)

See my comment on #124379, If you plan to reassign the ticket again, better reject it, and bring the topic to the Wednesday Sync meeting.

Actions #8

Updated by okurz over 1 year ago

  • Tags set to scripts, tests, bisect, maintenance
  • Category set to Regressions/Crashes
  • Assignee deleted (okurz)
  • Priority changed from High to Normal
  • Target version set to future

szarate wrote:

See my comment on #124379, If you plan to reassign the ticket again, better reject it, and bring the topic to the Wednesday Sync meeting.

uh, I don't see a comment by you on #124379. Which one do you mean?

The reason why I do not consider this ticket for the tools team is that the approach of openqa-trigger-bisect-jobs worked just fine until os-autoinst-distri-opensuse together with schedules have been restructured. I doubt it's an efficient approach if I ask people within the SUSE QE Tools team to follow changes done by QE Core and integrate fixes without introducing regressions. Also the changes would need to be done within os-autoinst-distri-opensuse.

Actions #9

Updated by szarate over 1 year ago

  • Tags deleted (scripts, tests, bisect, maintenance)
  • Assignee set to okurz
  • Priority changed from Normal to High
  • Target version deleted (future)

okurz wrote:

szarate wrote:

See my comment on #124379, If you plan to reassign the ticket again, better reject it, and bring the topic to the Wednesday Sync meeting.

uh, I don't see a comment by you on #124379. Which one do you mean?

My bad, copy pasted in the wrong place :) I meant the comment on #122296#note-6

Actions #10

Updated by szarate over 1 year ago

  • Tags set to scripts, tests, bisect, maintenance
  • Priority changed from High to Normal
  • Target version set to future

Sometimes, I don't love redmine.

Actions #11

Updated by okurz over 1 year ago

  • Assignee deleted (okurz)
Actions #12

Updated by okurz over 1 year ago

  • Related to action #131204: openqa-trigger-bisect-jobs is called on passed jobs size:M added
Actions #13

Updated by szarate 8 months ago

  • Blocks deleted (action #124379: [qe-core] geekotest bisect is broken for child test runs)
Actions #14

Updated by szarate 8 months ago

  • Assignee set to szarate
  • Start date changed from 2022-12-21 to 2022-12-13

Not moving to the core backlog but planning to pick it up by then

Actions #15

Updated by okurz 8 months ago

You want to start 14 months ago? ;)

Actions #16

Updated by szarate 8 months ago

  • Start date changed from 2022-12-13 to 2024-02-13
Actions

Also available in: Atom PDF