action #80414
closed
openQA Project - coordination #39719: [saga][epic] Detection of "known failures" for stable tests, easy test results review and easy tracking of known issues
coordination #77899: [epic] Extend "auto-review" for failed jobs as well
[proof-of-concept] Extend "auto-review" for failed jobs as well, start with o3
Added by okurz over 3 years ago.
Updated over 3 years ago.
Description
Motivation¶
See #77899
Acceptance criteria¶
- AC1: proof-of-concept running on o3
- Status changed from Workable to In Progress
- Assignee set to okurz
While helping mkittler with the urgent ticket #80412 I had an idea how we should be able to easily couple openqa-monitor-incompletes+openqa-label-known-issues+openqa-investigate
- Status changed from In Progress to Feedback
- Status changed from Feedback to Resolved
with https://gitlab.suse.de/openqa/auto-review/-/merge_requests/6 merged and a new pipeline triggered there is now
https://gitlab.suse.de/openqa/auto-review/-/jobs/294774
which shows (unfortunately) only comment ids of created openQA comments, e.g. "98634". With
ssh o3 "sudo -u geekotest psql openqa -c 'select job_id from comments where id=98634;'"
one could found out that the corresponding openQA job where the comment was posted and the according comment is
https://openqa.opensuse.org/t1486111#comment-98634
with content:
Automatic investigation jobs:
* gnome:investigate:retry: https://openqa.opensuse.org/t1486465
* gnome:investigate:last_good_tests:e8223ff26cf73d8dfa4a62358cafd592310d31e9: https://openqa.opensuse.org/t1486466
* gnome:investigate:last_good_build:20201125: https://openqa.opensuse.org/t1486467
* gnome:investigate:last_good_tests_and_build:e8223ff26cf73d8dfa4a62358cafd592310d31e9+20201125: https://openqa.opensuse.org/t1486468
AFAICS no "known issue" was detected which is expected as there are not many (or any?) progress tickets with a proper auto-review regex for failed jobs.
With this I see the proof-of-concept succesfully in place and we can regard this ticket as "Resolved". As next steps in the epic I recommend to extend the approach to a selected product or job group on osd as well as all "non-development" job groups on o3.
Also available in: Atom
PDF