Project

General

Profile

action #50186

[functional][y] Include url to the skipped tests in openqa_review

Added by riafarov over 1 year ago. Updated over 1 year ago.

Status:
Resolved
Priority:
Low
Assignee:
Category:
Enhancement to existing tests
Target version:
Start date:
2018-06-15
Due date:
2019-05-21
% Done:

0%

Estimated time:
5.00 h
Difficulty:

Description

Motivation

I as a QA Project Manager would like to know which tests were not executed for particular build in the report to understand risks we have to miss bugs in given areas.

https://github.com/os-autoinst/openqa_review/issues/98

Follow-up of #37429

Acceptance criteria

  1. Generated report from openqa-review includes section which lists skipped tests with urls to them
  2. No duplicates are shown in the report
  3. Machine name is appended to the item in case differs to the default

Further details

Script can be executed manually.

Generated reports can found here: Latest report based on openQA test results http://s.qa.suse.de/test-status , SLE12: http://s.qa.suse.de/test-status-sle12 , SLE15: http://s.qa.suse.de/test-status-sle15

For example:

  • extra_tests_in_textmode
  • minimal+proxy_SCC-postreg_SUSEconnect
  • minimal+proxy_SCC-postreg_SUSEconnect@hyperv
  • pcm_azure
  • pcm_googlecloud

Currently we have list which is duplicated


Related issues

Copied from openQA Tests - action #37429: [functional][y] Improve openqa_review to include skipped tests into the reportResolved2018-06-152019-04-09

History

#1 Updated by riafarov over 1 year ago

  • Copied from action #37429: [functional][y] Improve openqa_review to include skipped tests into the report added

#2 Updated by riafarov over 1 year ago

  • Description updated (diff)
  • Status changed from New to Workable
  • Estimated time set to 5.00 h

#3 Updated by riafarov over 1 year ago

  • Assignee set to ybonatakis

#4 Updated by ybonatakis over 1 year ago

  • Status changed from Workable to In Progress

#6 Updated by riafarov over 1 year ago

  • Due date changed from 2019-04-23 to 2019-05-07

#7 Updated by riafarov over 1 year ago

  • Status changed from In Progress to Feedback

#8 Updated by JERiveraMoya over 1 year ago

  • Due date changed from 2019-05-07 to 2019-05-21

Remaining part is PR review. Moved to next sprint.

#9 Updated by ybonatakis over 1 year ago

The report pages seem that they are used still old code. Need to deploy new build for openqa-review

#10 Updated by JERiveraMoya over 1 year ago

  • Status changed from Feedback to Resolved

It was successfully deployed.

Also available in: Atom PDF