Project

General

Profile

Actions
Copy link

action #151399

closed

coordination #102915: [saga][epic] Automated classification of failures

QA (public) - coordination #94105: [epic] Use feedback from openqa-investigate to automatically inform on github pull requests, open tickets, weed out automatically failed tests

Identify reproducible *infrastructure* issues using openqa-investigate size:M

Added by okurz about 1 year ago. Updated 8 months ago.

Status:
Resolved
Priority:
High
Assignee:
tinita
Category:
Feature requests
Target version:
Ready
Start date:
2023-11-24
Due date:
% Done:

0%

Estimated time:

Description

Motivation

With #109920 openqa-investigate can identify clear PRODUCT REGRESSIONS and with #132272 we identify TEST REGRESSIONS. We can extend that same concept to now clearly identify infrastructure regressions and inform us about it

Acceptance criteria

  • AC1: On failed openQA jobs with openqa-investigate info "S0: retry X, last_good_test X, last_good_build X, last_good_test+build X" (X: failed, V: passed) a comment is written pointing to a likely infrastructure regression
  • AC2: No such comment is written on other jobs

Suggestions

Related issues 4 (1 open — 3 closed)

Copied from openQA Project (public) - action #132272: Identify reproducible *TEST* issues (not product issues anymore) using openqa-investigate size:MResolvedtinita

Actions
Copied to openQA Project (public) - action #151402: [spike solution][timeboxed:20h] Allow to search for tests by comment on the UI size:MResolvedmkittler2023-11-24

Actions
Copied to openQA Project (public) - action #152851: Notify about reproducible *infrastructure* issues using openqa-investigateNew2023-11-24

Actions
Copied to openQA Project (public) - action #152853: Prevent faulty openQA workers causing wrong openqa-investigate conclusions size:MResolvedybonatakis

Actions
Actions
Copy link

Also available in: Atom PDF