Project

General

Profile

Actions

action #42503

closed

coordination #40475: [functional][y][saga] Establish YaST team split

coordination #42191: [functional][y][epic] Have separate job group for YaST subteam

[functional][y] Define test matrix for the YaST job group

Added by riafarov over 5 years ago. Updated about 5 years ago.

Status:
Resolved
Priority:
Low
Assignee:
Category:
Enhancement to existing tests
Target version:
SUSE QA - Milestone 23
Start date:
2018-10-15
Due date:
2019-03-26
% Done:

0%

Estimated time:
3.00 h
Difficulty:

Description

Motivation

When we'll have separate job group, we need good understanding of what we have in it and what we want to have. By that we also can decide where how we want to test one thing and another.
There are many examples where we could be more efficient and gain time for increasing test coverage for more critical areas instead of covering e.g. firefox on all possible environments.
This also includes proper evaluation of the risks when not running certain test module.
As a starting point we already have test suites descriptions + test modules descriptions. But it's hard to identify which modules are executed where, and on which env do we cover certain setups. That is visible only in the openQA dashboard.

Suggestions

There is one team which uses testopia exactly for this purpose. We need to identify good format which could be reused among teams and used e.g. as a reporting template to visualize coverage per build.
Markdown is more preferable

Acceptance criteria

  1. All existing test suites in the YaST job group have description
  2. Test suite includes env description, executed test cases summary and purpose

NOTE: should be handled once we have current state of the job group, meaning after at least #42494 and #42503 are done.

Actions

Also available in: Atom PDF