Project

General

Profile

Actions
Copy link

action #80414

closed

openQA Project - coordination #39719: [saga][epic] Detection of "known failures" for stable tests, easy test results review and easy tracking of known issues

coordination #77899: [epic] Extend "auto-review" for failed jobs as well

[proof-of-concept] Extend "auto-review" for failed jobs as well, start with o3

Added by okurz over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
okurz
Target version:
openQA Project - Ready
Start date:
2020-11-26
Due date:
% Done:

0%

Estimated time:

Description

Motivation

See #77899

Acceptance criteria

  • AC1: proof-of-concept running on o3
Actions
Copy link
 #1

Updated by okurz over 3 years ago

  • Status changed from Workable to In Progress
  • Assignee set to okurz

While helping mkittler with the urgent ticket #80412 I had an idea how we should be able to easily couple openqa-monitor-incompletes+openqa-label-known-issues+openqa-investigate

Actions
Copy link
 #2

Updated by okurz over 3 years ago

  • Status changed from In Progress to Feedback
Actions
Copy link
 #3

Updated by okurz over 3 years ago

Instead of putting a bigger command line within .gitlab-ci.yml which might interfer with YAML parsing I decided to put the one-line-call into it's own script https://github.com/os-autoinst/scripts/pull/47

Also created https://gitlab.suse.de/openqa/auto-review/-/merge_requests/6 to call the new combined script ./openqa-review-failed for o3 Tumbleweed.

Actions
Copy link
 #4

Updated by okurz over 3 years ago

  • Status changed from Feedback to Resolved

with https://gitlab.suse.de/openqa/auto-review/-/merge_requests/6 merged and a new pipeline triggered there is now
https://gitlab.suse.de/openqa/auto-review/-/jobs/294774
which shows (unfortunately) only comment ids of created openQA comments, e.g. "98634". With

ssh o3 "sudo -u geekotest psql openqa -c 'select job_id from comments where id=98634;'"

one could found out that the corresponding openQA job where the comment was posted and the according comment is
https://openqa.opensuse.org/t1486111#comment-98634

with content:

Automatic investigation jobs:

* gnome:investigate:retry: https://openqa.opensuse.org/t1486465
* gnome:investigate:last_good_tests:e8223ff26cf73d8dfa4a62358cafd592310d31e9: https://openqa.opensuse.org/t1486466
* gnome:investigate:last_good_build:20201125: https://openqa.opensuse.org/t1486467
* gnome:investigate:last_good_tests_and_build:e8223ff26cf73d8dfa4a62358cafd592310d31e9+20201125: https://openqa.opensuse.org/t1486468

AFAICS no "known issue" was detected which is expected as there are not many (or any?) progress tickets with a proper auto-review regex for failed jobs.

With this I see the proof-of-concept succesfully in place and we can regard this ticket as "Resolved". As next steps in the epic I recommend to extend the approach to a selected product or job group on osd as well as all "non-development" job groups on o3.

Actions
Copy link

Also available in: Atom PDF