Project

General

Profile

action #94762

QA - coordination #91646: [saga][epic] SUSE Maintenance QA workflows with fully automated testing, approval and release

coordination #91467: [epic] Surface openQA failures per squad in a single place

openqa-review: Add mode of single-line todo lists size:M

Added by okurz 5 months ago. Updated 4 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Feature requests
Target version:
Start date:
2021-05-21
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Motivation

#91467#note-29

Acceptance criteria

  • AC1: openqa-review can be configured to only show "TODO review" items
  • AC2: Every TODO-list item has all relevant information in a single line, i.e. no section headers

Suggestions

  • Render it like so, or similar: * **existing:** 0: [i586-ssh-X@i586--l3](https://openqa.opensuse.org/tests/384325 "Failed modules: bootloader_i586")
todo-only-enabled.png (28.4 KB) todo-only-enabled.png With --todo-only tinita, 2021-07-13 19:01
todo-only-disabled.png (44.4 KB) todo-only-disabled.png Original tinita, 2021-07-13 19:01
11674
11677

Related issues

Copied from openQA Project - action #92960: Add option to openqa-review to section by flavorWorkable2021-05-21

History

#1 Updated by okurz 5 months ago

  • Copied from action #92960: Add option to openqa-review to section by flavor added

#2 Updated by okurz 5 months ago

  • Priority changed from High to Normal

#3 Updated by mkittler 5 months ago

I'm wondering what's wanted here exactly. Which "items" should be added to the TODO list? How should this "single-line todo list" look like?

#4 Updated by okurz 5 months ago

Take a look on a generic report like https://openqa.io.suse.de/openqa-review/openqa_suse_de_status.html . There are sections like "Existing Product bugs:", "New Test issues:", "Skipped tests", etc. And there is also a section "TODO: review" sub-sectioned into "new" and "existing" issues. The ticket is about only the last section. So a report like https://github.com/os-autoinst/openqa_review/blob/master/tests/tags_labels/report25_T_bugrefs_softfails.md with content

# 0


**Date:** 2017-07-07 - 14:36
**Build:** 1507 (reference 1500)

---

**Arch:** i586
**Status: <span style="color: red;">Red</span>**

**New Product bugs:**

* soft fails: [custom_bugref](https://openqa.opensuse.org/tests/1316928) -> [boo#1126782](https://bugzilla.opensuse.org/show_bug.cgi?id=1126782)
* [toolchain_zypper](https://openqa.opensuse.org/tests/384324 "Failed modules: install") -> [boo#931571](https://bugzilla.opensuse.org/show_bug.cgi?id=931571)
* [toolchain_zypper@bar](https://openqa.opensuse.org/tests/3843245 "Failed modules: install") -> [boo#9315715](https://bugzilla.opensuse.org/show_bug.cgi?id=9315715)
* soft fails: [create_hdd_textmode](https://openqa.opensuse.org/tests/447901) -> [boo#931572](https://bugzilla.opensuse.org/show_bug.cgi?id=931572)
* soft fails: [soft_fail_without_bugref](https://openqa.opensuse.org/tests/684839) -> for Leap:15.0:Ports aarch64 and ppc64le, do not enable source repo, waiting for [https://progress.opensuse.org/issues/36256](https://progress.opensuse.org/issues/36256) to be solved, and also [http://fate.suse.com/12345](http://fate.suse.com/12345) ✓


**Existing Product bugs:**

* [allpatterns](https://openqa.opensuse.org/tests/384333 "Failed modules: xterm"), [ext4@i586--l2](https://openqa.opensuse.org/tests/384634 "Failed modules: install_and_reboot"), [gnome](https://openqa.opensuse.org/tests/384344 "Failed modules: xterm"), [minimal+base](https://openqa.opensuse.org/tests/384329 "Failed modules: dns_srv") -> [bsc#822770](https://bugzilla.opensuse.org/show_bug.cgi?id=822770)
* soft fails: [btrfs](https://openqa.opensuse.org/tests/384330), [zfcp@i586-zfcp](https://openqa.opensuse.org/tests/384707) -> [bsc1029660](https://bugzilla.suse.com/show_bug.cgi?id=1029660)


**Existing openQA-issues:**

* [textmode](https://openqa.opensuse.org/tests/384342 "Failed modules: dns_srv") -> [poo#11948](https://progress.opensuse.org/issues/11948)
* [allpatterns@i586--l2](https://openqa.opensuse.org/tests/384335) -> [poo#9772](https://progress.opensuse.org/issues/9772)


**TODO: review**

***existing issues***

* [ssh-X@i586--l3](https://openqa.opensuse.org/tests/384325 "Failed modules: bootloader_i586")

could look something like this to have only single-line entries:

* **existing:** 0: [i586-ssh-X@i586--l3](https://openqa.opensuse.org/tests/384325 "Failed modules: bootloader_i586")

#5 Updated by cdywan 5 months ago

  • Subject changed from openqa-review: Add mode of single-line todo lists to openqa-review: Add mode of single-line todo lists size:M
  • Description updated (diff)
  • Status changed from New to Workable

#6 Updated by tinita 5 months ago

  • Status changed from Workable to In Progress
  • Assignee set to tinita

#7 Updated by tinita 5 months ago

11674
11677

okurz here is a screenshot.
Does that go in the right direction?

#8 Updated by okurz 5 months ago

tinita wrote:

okurz here is a screenshot.
Does that go in the right direction?

Yes, looks good! Goes in the right direction :)

#9 Updated by openqa_review 5 months ago

  • Due date set to 2021-07-28

Setting due date based on mean cycle time of SUSE QE Tools

#10 Updated by tinita 5 months ago

okurz
Your proposal was:

* **existing:** 0: [i586-ssh-X@i586--l3](https://openqa.opensuse.org/tests/384325 "Failed modules: bootloader_i586")

Now I wonder what the 0: here stands for. In the original report that was the Job Group.
But I don't get how the complete report should look like then.
Should all headings be skipped and we only have one list? Then the single items should also contain the architecture.

#11 Updated by okurz 5 months ago

tinita wrote:

[…]
Should all headings be skipped and we only have one list? Then the single items should also contain the architecture.

yes, try to skip all headings. I have not included the architecture because the "machine" is always architecture specific so we might not need the architecture at all when we have the machine. Let's try without. But consider what is feasible from implementation point of view. Feel free to propose a PR with a new mode that only does a part and not yet all. We can go step-wise

#12 Updated by tinita 5 months ago

That's going to change a lot, because that deep in the report generation there is no info about the number (group) anymore.

I think it doesn't really make sense to continue my first approach, if in the end the whole thing has to be rewritten.

#13 Updated by okurz 5 months ago

well, I can't make promises here even if users would accept the feature. We need to try it out with least effort possible and see if it will meet the demand.

#15 Updated by okurz 5 months ago

PR merged. Please add an according configuration in gitlab.suse.de/openqa/openqa-review/

#16 Updated by okurz 5 months ago

  • Parent task changed from #91914 to #91467

#17 Updated by tinita 5 months ago

  • Status changed from In Progress to Feedback

Added

  - html_target_file: openqa_suse_de_todo_only.html
    extra_args: --todo-only

to the settings.

#18 Updated by tinita 5 months ago

Apparently I added it to the wrong settings (https://gitlab.suse.de/openqa/openqa-review/-/settings/ci_cd -> Variables)

Now I added it directly to the pipeline settings:

https://gitlab.suse.de/openqa/openqa-review/-/pipeline_schedules

#19 Updated by tinita 5 months ago

  • Status changed from Feedback to In Progress

The output is showing headers without todo items finished builds it seems:
https://openqa.io.suse.de/openqa-review/openqa_suse_de_todo_only.html

* existing mau-extratests-zypper
* Maintenance: QR / Maintenance - QR - JeOS15SP3: Not enough finished builds found* Maintenance: QR / Maintenance - QR - SLE15SP2:
* new ha_alpha_node02

#21 Updated by tinita 5 months ago

  • Status changed from In Progress to Feedback

#22 Updated by tinita 5 months ago

  • Status changed from Feedback to Resolved

#23 Updated by okurz 5 months ago

The headers like in

* existing mau-extratests-zypper
* Maintenance: QR / Maintenance - QR - JeOS15SP3: Not enough finished builds found* Maintenance: QR / Maintenance - QR - SLE15SP2:
* new ha_alpha_node02

look a bit out of line but I guess it's ok for now. Thank you

#24 Updated by tinita 5 months ago

okurz wrote:

The headers like in

* existing mau-extratests-zypper
* Maintenance: QR / Maintenance - QR - JeOS15SP3: Not enough finished builds found* Maintenance: QR / Maintenance - QR - SLE15SP2:
* new ha_alpha_node02

look a bit out of line but I guess it's ok for now. Thank you

I don't see those in the current report. This is the thing which I fixed in my last PR.
Where did you find them?

#25 Updated by okurz 5 months ago

https://openqa.io.suse.de/openqa-review/openqa_suse_de_todo_only.html as of now starts with

TODO: review
* Containers / Create_hdd_stable_hosts:
* **new** [create_hdd_autoyast_containers](https://openqa.suse.de/tests/6251229)

with "Containers / Create_hdd_stable_hosts:" being a job group name. What you fixed is to skip job groups without build results but job group headers are still mangled together with test results as individual list entries.

#26 Updated by tinita 5 months ago

Ok, well, that's another topic. But the content you quoted doesn't exist anymore like this.

#27 Updated by okurz 4 months ago

  • Due date deleted (2021-07-28)

Also available in: Atom PDF