Project

General

Profile

Actions
Copy link

action #151399

closed

coordination #102915: [saga][epic] Automated classification of failures

QA (public) - coordination #94105: [epic] Use feedback from openqa-investigate to automatically inform on github pull requests, open tickets, weed out automatically failed tests

Identify reproducible *infrastructure* issues using openqa-investigate size:M

Added by okurz about 1 year ago. Updated 8 months ago.

Status:
Resolved
Priority:
High
Assignee:
tinita
Category:
Feature requests
Target version:
Ready
Start date:
2023-11-24
Due date:
% Done:

0%

Estimated time:

Description

Motivation

With #109920 openqa-investigate can identify clear PRODUCT REGRESSIONS and with #132272 we identify TEST REGRESSIONS. We can extend that same concept to now clearly identify infrastructure regressions and inform us about it

Acceptance criteria

  • AC1: On failed openQA jobs with openqa-investigate info "S0: retry X, last_good_test X, last_good_build X, last_good_test+build X" (X: failed, V: passed) a comment is written pointing to a likely infrastructure regression
  • AC2: No such comment is written on other jobs

Suggestions

Related issues 4 (1 open — 3 closed)

Copied from openQA Project (public) - action #132272: Identify reproducible *TEST* issues (not product issues anymore) using openqa-investigate size:MResolvedtinita

Actions
Copied to openQA Project (public) - action #151402: [spike solution][timeboxed:20h] Allow to search for tests by comment on the UI size:MResolvedmkittler2023-11-24

Actions
Copied to openQA Project (public) - action #152851: Notify about reproducible *infrastructure* issues using openqa-investigateNew2023-11-24

Actions
Copied to openQA Project (public) - action #152853: Prevent faulty openQA workers causing wrong openqa-investigate conclusions size:MResolvedybonatakis

Actions
Actions
Copy link
 #1

Updated by okurz about 1 year ago

  • Copied from action #132272: Identify reproducible *TEST* issues (not product issues anymore) using openqa-investigate size:M added
Actions
Copy link
 #2

Updated by okurz about 1 year ago

  • Description updated (diff)
Actions
Copy link
 #3

Updated by okurz about 1 year ago

  • Copied to action #151402: [spike solution][timeboxed:20h] Allow to search for tests by comment on the UI size:M added
Actions
Copy link
 #4

Updated by okurz about 1 year ago

  • Target version changed from Tools - Next to Ready
Actions
Copy link
 #5

Updated by okurz about 1 year ago

  • Subject changed from Identify reproducible *infrastructure* issues using openqa-investigate size:M to Identify reproducible *infrastructure* issues using openqa-investigate
Actions
Copy link
 #6

Updated by tinita 12 months ago

  • Copied to action #152851: Notify about reproducible *infrastructure* issues using openqa-investigate added
Actions
Copy link
 #7

Updated by tinita 12 months ago

  • Subject changed from Identify reproducible *infrastructure* issues using openqa-investigate to Identify reproducible *infrastructure* issues using openqa-investigate size:M
  • Description updated (diff)
  • Status changed from New to Workable
Actions
Copy link
 #8

Updated by okurz 12 months ago

  • Copied to action #152853: Prevent faulty openQA workers causing wrong openqa-investigate conclusions size:M added
Actions
Copy link
 #9

Updated by livdywan 11 months ago

This was flaged due to the SLO. Brought it up on workadventu.re and there's no further questions.

Actions
Copy link
 #10

Updated by okurz 10 months ago

  • Priority changed from Normal to High
Actions
Copy link
 #11

Updated by tinita 10 months ago

  • Status changed from Workable to In Progress
  • Assignee set to tinita
Actions
Copy link
 #12

Updated by tinita 10 months ago

https://github.com/os-autoinst/scripts/pull/293 Identify reproducible infrastructure issues

Actions
Copy link
 #13

Updated by openqa_review 10 months ago

  • Due date set to 2024-03-07

Setting due date based on mean cycle time of SUSE QE Tools

Actions
Copy link
 #14

Updated by tinita 10 months ago ยท Edited

  • Status changed from In Progress to Feedback
Actions
Copy link
 #15

Updated by tinita 10 months ago

  • Status changed from Feedback to Resolved

I found the new comment several times on osd. gru journals look ok.

Actions
Copy link
 #16

Updated by okurz 8 months ago

  • Due date deleted (2024-03-07)
Actions
Copy link

Also available in: Atom PDF