action #50186

[functional][y] Include url to the skipped tests in openqa_review

Added by riafarov 11 months ago. Updated 9 months ago.

Status:ResolvedStart date:15/06/2018
Priority:LowDue date:21/05/2019
Assignee:ybonatakis% Done:

0%

Category:Enhancement to existing testsEstimated time:5.00 hours
Target version:QA - future
Difficulty:
Duration: 243

Description

Motivation

I as a QA Project Manager would like to know which tests were not executed for particular build in the report to understand risks we have to miss bugs in given areas.

https://github.com/os-autoinst/openqa_review/issues/98

Follow-up of #37429

Acceptance criteria

  1. Generated report from openqa-review includes section which lists skipped tests with urls to them
  2. No duplicates are shown in the report
  3. Machine name is appended to the item in case differs to the default

Further details

Script can be executed manually.

Generated reports can found here: Latest report based on openQA test results http://s.qa.suse.de/test-status , SLE12: http://s.qa.suse.de/test-status-sle12 , SLE15: http://s.qa.suse.de/test-status-sle15

For example:
* extra_tests_in_textmode
* minimal+proxy_SCC-postreg_SUSEconnect
* minimal+proxy_SCC-postreg_SUSEconnect@hyperv
* pcm_azure
* pcm_googlecloud

Currently we have list which is duplicated


Related issues

Copied from openQA Tests - action #37429: [functional][y] Improve openqa_review to include skipped ... Resolved 15/06/2018 09/04/2019

History

#1 Updated by riafarov 11 months ago

  • Copied from action #37429: [functional][y] Improve openqa_review to include skipped tests into the report added

#2 Updated by riafarov 10 months ago

  • Description updated (diff)
  • Status changed from New to Workable
  • Estimated time set to 5.00

#3 Updated by riafarov 10 months ago

  • Assignee set to ybonatakis

#4 Updated by ybonatakis 10 months ago

  • Status changed from Workable to In Progress

#6 Updated by riafarov 10 months ago

  • Due date changed from 23/04/2019 to 07/05/2019

#7 Updated by riafarov 10 months ago

  • Status changed from In Progress to Feedback

#8 Updated by JERiveraMoya 10 months ago

  • Due date changed from 07/05/2019 to 21/05/2019

Remaining part is PR review. Moved to next sprint.

#9 Updated by ybonatakis 9 months ago

The report pages seem that they are used still old code. Need to deploy new build for openqa-review

#10 Updated by JERiveraMoya 9 months ago

  • Status changed from Feedback to Resolved

It was successfully deployed.

Also available in: Atom PDF