Project

General

Profile

Actions
Copy link

coordination #102915

open

[saga][epic] Automated classification of failures

Added by okurz about 2 years ago. Updated 3 days ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Feature requests
Target version:
QA - future
Start date:
2021-07-20
Due date:
% Done:

86%

Estimated time:
(Total: 40.00 h)
Difficulty:

Description

User Story

As a reviewer of failed openQA tests I want failures of jobs to be automatically classified for example "test regression", "product regression", "infrastructure issue" to not waste time on bisecting failures

Acceptance criteria

  • AC1: If a job fails or incompletes a classification is provided so that at best no further "test review" effort is needed by human reviewers to triage the issue

Subtasks 16 (3 open — 13 closed)

QA - coordination #94105: [epic] Use feedback from openqa-investigate to automatically inform on github pull requests, open tickets, weed out automatically failed testsBlockedokurz2021-07-20

Actions
QA - action #95742: In openqa-investigate jobs add URL to original job as settingResolvedokurz2021-07-20

Actions
QA - action #95746: Identify likely "sporadic" openQA tests with "openqa-investigate" size:MResolvedXiaojing_liu2021-07-20

Actions
action #98862: Comment about intermittent/sporadic test issues on original job if openqa-investigate retry job passes size:MResolvedtinita2021-09-18

Actions
action #109920: Identify reproducible product issues using openqa-investigate size:MResolvedtinita2023-03-23

Actions
QA - action #110176: [spike solution] [timeboxed:10h] Restart hook script in delayed minion job based on exit code size:MResolvedkraih2022-06-15

Actions
action #110518: Call job_done_hooks if requested by test setting (not only openQA config as done so far) size:MResolvedmkittler2021-09-18

Actions
action #110530: Do NOT call job_done_hooks if requested by test settingResolvedmkittler2021-09-18

Actions
action #112523: Make hook scripts restartable with a special exit codeResolvedkraih2022-06-15

Actions
action #124991: Copy ids of other investigate jobs to retry jobRejectedokurz2023-02-23

Actions
action #126527: [spike] Parse comments to identify reproducible product issues using openqa-investigate size:MResolvedtinita2023-03-23

Actions
action #132272: Identify reproducible *TEST* issues (not product issues anymore) using openqa-investigate size:MResolvedtinita

Actions
action #132332: Multiple investigation comments for multimachine tests size:MResolvedtinita2023-03-23

Actions
action #138299: Make the final aggregation messages from openqa-investigate more prominent size:SResolveddheidler

Actions
action #151399: Identify reproducible *infrastructure* issues using openqa-investigate size:MNew2023-11-24

Actions
action #151402: Allow to search for tests by comment on the UINew2023-11-24

Actions

Related issues 3 (3 open — 0 closed)

Related to openQA Project - action #45011: Allow detection of known failures at the autoinst-log.txtWorkable2018-12-11

Actions
Related to openQA Project - coordination #89095: [epic] Provide openqa-investigate information on job detailsNew2021-02-25

Actions
Copied from openQA Project - coordination #102906: [saga][epic] Increased stability of tests with less "known failures", known incompletes handled automatically within openQANew2018-04-16

Actions
Actions
Copy link
 #1

Updated by okurz about 2 years ago

  • Copied from coordination #102906: [saga][epic] Increased stability of tests with less "known failures", known incompletes handled automatically within openQA added
Actions
Copy link
 #2

Updated by okurz about 2 years ago

  • Related to action #45011: Allow detection of known failures at the autoinst-log.txt added
Actions
Copy link
 #4

Updated by okurz about 1 year ago

  • Related to coordination #89095: [epic] Provide openqa-investigate information on job details added
Actions
Copy link

Also available in: Atom PDF