Project

General

Profile

Actions

action #50186

closed

[functional][y] Include url to the skipped tests in openqa_review

Added by riafarov over 5 years ago. Updated over 5 years ago.

Status:
Resolved
Priority:
Low
Assignee:
Category:
Enhancement to existing tests
Target version:
QA (public, currently private due to #173521) - future
Start date:
2018-06-15
Due date:
2019-05-21
% Done:

0%

Estimated time:
5.00 h
Difficulty:

Description

Motivation

I as a QA Project Manager would like to know which tests were not executed for particular build in the report to understand risks we have to miss bugs in given areas.

https://github.com/os-autoinst/openqa_review/issues/98

Follow-up of #37429

Acceptance criteria

  1. Generated report from openqa-review includes section which lists skipped tests with urls to them
  2. No duplicates are shown in the report
  3. Machine name is appended to the item in case differs to the default

Further details

Script can be executed manually.

Generated reports can found here: Latest report based on openQA test results http://s.qa.suse.de/test-status , SLE12: http://s.qa.suse.de/test-status-sle12 , SLE15: http://s.qa.suse.de/test-status-sle15

For example:

  • extra_tests_in_textmode
  • minimal+proxy_SCC-postreg_SUSEconnect
  • minimal+proxy_SCC-postreg_SUSEconnect@hyperv
  • pcm_azure
  • pcm_googlecloud

Currently we have list which is duplicated


Related issues 1 (0 open1 closed)

Copied from openQA Tests (public) - action #37429: [functional][y] Improve openqa_review to include skipped tests into the reportResolvedybonatakis2018-06-152019-04-09

Actions
Actions #1

Updated by riafarov over 5 years ago

  • Copied from action #37429: [functional][y] Improve openqa_review to include skipped tests into the report added
Actions #2

Updated by riafarov over 5 years ago

  • Description updated (diff)
  • Status changed from New to Workable
  • Estimated time set to 5.00 h
Actions #3

Updated by riafarov over 5 years ago

  • Assignee set to ybonatakis
Actions #4

Updated by ybonatakis over 5 years ago

  • Status changed from Workable to In Progress
Actions #6

Updated by riafarov over 5 years ago

  • Due date changed from 2019-04-23 to 2019-05-07
Actions #7

Updated by riafarov over 5 years ago

  • Status changed from In Progress to Feedback
Actions #8

Updated by JERiveraMoya over 5 years ago

  • Due date changed from 2019-05-07 to 2019-05-21

Remaining part is PR review. Moved to next sprint.

Actions #9

Updated by ybonatakis over 5 years ago

The report pages seem that they are used still old code. Need to deploy new build for openqa-review

Actions #10

Updated by JERiveraMoya over 5 years ago

  • Status changed from Feedback to Resolved

It was successfully deployed.

Actions

Also available in: Atom PDF