Project

General

Profile

action #90401

openQA Project - coordination #39719: [saga][epic] Detection of "known failures" for stable tests, easy test results review and easy tracking of known issues

openQA Project - coordination #88229: [epic] Prevent unintended test coverage decrease

action #88127: [tools][qem] Test coverage DB for maintenance updates

[teregen] Integrate coverage information in a presentable way into test template

Added by jbaier_cz 3 months ago. Updated about 1 month ago.

Status:
Resolved
Priority:
Normal
Assignee:
Target version:
Start date:
2021-03-29
Due date:
% Done:

100%

Estimated time:

Related issues

Related to QA - action #90914: [teregen] Add overview for stored coverage dataNew2021-04-09

Related to QA - action #93799: Improvement of usability of disabled testcases notificationNew2021-06-102021-07-01

History

#1 Updated by okurz 3 months ago

  • Assignee set to jbaier_cz

may I assume that you are the assignee working on this?

#2 Updated by openqa_review 3 months ago

  • Due date set to 2021-04-13

Setting due date based on mean cycle time of SUSE QE Tools

#3 Updated by jbaier_cz 2 months ago

  • % Done changed from 0 to 80

Data about coverage fetched in poo#88485 should be somehow presented inside the testing template. We can distinguish two different cases for missing coverage:

  1. A whole test suite is missing
  2. One or more test modules are missing inside a completed test suite
Proposed presentation format

The following will be added inside regression tests summary.

Missing test suite
regression tests:
-----------------
WARNING: One or more test suites are missing compared to last runs with these source rpms.
         Please, check openQA manually. Missing test suites are:

  - Maintenance: SLE 15 SP2 Incidents -> qam-allpatterns / x86_64
      sle-15-SP2-Desktop-DVD-Incidents-x86_64-Build:17989:gzip-qam-allpatterns@64bit
Missing test module
regression tests:
-----------------
WARNING: There is a difference inside one or more test suites compared to last runs.
         Please, check openQA manually. Missing test modules are:

  - x11/reboot_gnome
      Maintenance: SLE 15 SP2 Incidents -> qam-allpatterns / x86_64
        sle-15-SP2-Desktop-DVD-Incidents-x86_64-Build:17989:gzip-qam-allpatterns@64bit

#4 Updated by jbaier_cz 2 months ago

  • Status changed from In Progress to Resolved
  • % Done changed from 80 to 100

#5 Updated by jbaier_cz 2 months ago

  • Related to action #90914: [teregen] Add overview for stored coverage data added

#6 Updated by jbaier_cz 2 months ago

  • Subject changed from Integrate coverage information in a presentable way into test template to [teregen] Integrate coverage information in a presentable way into test template

#7 Updated by okurz about 1 month ago

  • Due date deleted (2021-04-13)

#8 Updated by jbaier_cz 6 days ago

  • Related to action #93799: Improvement of usability of disabled testcases notification added

Also available in: Atom PDF