Project

General

Profile

Actions
Copy link

action #90401

closed

openQA Project - coordination #102906: [saga][epic] Increased stability of tests with less "known failures", known incompletes handled automatically within openQA

openQA Project - coordination #88229: [epic] Prevent unintended test coverage decrease

action #88127: [tools][qem] Test coverage DB for maintenance updates

[teregen] Integrate coverage information in a presentable way into test template

Added by jbaier_cz about 3 years ago. Updated almost 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
jbaier_cz
Target version:
openQA Project - Ready
Start date:
2021-03-29
Due date:
% Done:

100%

Estimated time:

Related issues 2 (1 open — 1 closed)

Related to QA - action #90914: [teregen] Add overview for stored coverage dataNew2021-04-09

Actions
Related to QA - action #93799: teregen: Improvement of usability of disabled testcases notification size:MResolvedjbaier_cz2021-06-10

Actions
Actions
Copy link
 #1

Updated by okurz about 3 years ago

  • Assignee set to jbaier_cz

may I assume that you are the assignee working on this?

Actions
Copy link
 #2

Updated by openqa_review about 3 years ago

  • Due date set to 2021-04-13

Setting due date based on mean cycle time of SUSE QE Tools

Actions
Copy link
 #3

Updated by jbaier_cz about 3 years ago

  • % Done changed from 0 to 80

Data about coverage fetched in poo#88485 should be somehow presented inside the testing template. We can distinguish two different cases for missing coverage:

  1. A whole test suite is missing
  2. One or more test modules are missing inside a completed test suite
Proposed presentation format

The following will be added inside regression tests summary.

Missing test suite
regression tests:
-----------------
WARNING: One or more test suites are missing compared to last runs with these source rpms.
         Please, check openQA manually. Missing test suites are:

  - Maintenance: SLE 15 SP2 Incidents -> qam-allpatterns / x86_64
      sle-15-SP2-Desktop-DVD-Incidents-x86_64-Build:17989:gzip-qam-allpatterns@64bit
Missing test module
regression tests:
-----------------
WARNING: There is a difference inside one or more test suites compared to last runs.
         Please, check openQA manually. Missing test modules are:

  - x11/reboot_gnome
      Maintenance: SLE 15 SP2 Incidents -> qam-allpatterns / x86_64
        sle-15-SP2-Desktop-DVD-Incidents-x86_64-Build:17989:gzip-qam-allpatterns@64bit
Actions
Copy link
 #4

Updated by jbaier_cz about 3 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 80 to 100
Actions
Copy link
 #5

Updated by jbaier_cz about 3 years ago

  • Related to action #90914: [teregen] Add overview for stored coverage data added
Actions
Copy link
 #6

Updated by jbaier_cz about 3 years ago

  • Subject changed from Integrate coverage information in a presentable way into test template to [teregen] Integrate coverage information in a presentable way into test template
Actions
Copy link
 #7

Updated by okurz almost 3 years ago

  • Due date deleted (2021-04-13)
Actions
Copy link
 #8

Updated by jbaier_cz almost 3 years ago

  • Related to action #93799: teregen: Improvement of usability of disabled testcases notification size:M added
Actions
Copy link

Also available in: Atom PDF