action #90401
closed
openQA Project - coordination #102906: [saga][epic] Increased stability of tests with less "known failures", known incompletes handled automatically within openQA
openQA Project - coordination #88229: [epic] Prevent unintended test coverage decrease
action #88127: [tools][qem] Test coverage DB for maintenance updates
[teregen] Integrate coverage information in a presentable way into test template
Added by jbaier_cz about 3 years ago.
Updated almost 3 years ago.
- Assignee set to jbaier_cz
may I assume that you are the assignee working on this?
- Due date set to 2021-04-13
Setting due date based on mean cycle time of SUSE QE Tools
- % Done changed from 0 to 80
Data about coverage fetched in poo#88485 should be somehow presented inside the testing template. We can distinguish two different cases for missing coverage:
- A whole test suite is missing
- One or more test modules are missing inside a completed test suite
Proposed presentation format¶
The following will be added inside regression tests summary.
Missing test suite¶
regression tests:
-----------------
WARNING: One or more test suites are missing compared to last runs with these source rpms.
Please, check openQA manually. Missing test suites are:
- Maintenance: SLE 15 SP2 Incidents -> qam-allpatterns / x86_64
sle-15-SP2-Desktop-DVD-Incidents-x86_64-Build:17989:gzip-qam-allpatterns@64bit
Missing test module¶
regression tests:
-----------------
WARNING: There is a difference inside one or more test suites compared to last runs.
Please, check openQA manually. Missing test modules are:
- x11/reboot_gnome
Maintenance: SLE 15 SP2 Incidents -> qam-allpatterns / x86_64
sle-15-SP2-Desktop-DVD-Incidents-x86_64-Build:17989:gzip-qam-allpatterns@64bit
- Status changed from In Progress to Resolved
- % Done changed from 80 to 100
- Related to action #90914: [teregen] Add overview for stored coverage data added
- Subject changed from Integrate coverage information in a presentable way into test template to [teregen] Integrate coverage information in a presentable way into test template
- Due date deleted (
2021-04-13)
- Related to action #93799: teregen: Improvement of usability of disabled testcases notification size:M added
Also available in: Atom
PDF