Project

General

Profile

Actions

action #10262

closed

action #10260: Improve test coverage

Prevent further test coverage drop

Added by okurz over 8 years ago. Updated about 8 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
-
Start date:
2016-01-17
Due date:
% Done:

0%

Estimated time:

Description

user story

As openqa backend as well as test developer I get feedback on the coverage change in my PRs not to introduce coverage regressions (to prevent technical debt increase)

acceptance criteria

suggestions

  • check how coverage is currently gathered or was e.g. in https://github.com/os-autoinst/openQA/pull/51
  • research why it does not work for current changes anymore
  • re-add coverage analysis to local tests
  • re-add coverage analysis to travis/coveralls calls

further notes

seems like there was a notification on coverage using coveralls some time ago but it seems it got either disabled or somehow broke. It should be re-enabled and extended to other repositories as available.


Checklist

  • os-autoinst
  • openQA

Related issues 1 (0 open1 closed)

Related to openQA Project - action #1789: openqa test coverageResolved2014-03-04

Actions
Actions #1

Updated by okurz over 8 years ago

Actions #2

Updated by RBrownSUSE over 8 years ago

  • Priority changed from High to Normal
Actions #3

Updated by okurz over 8 years ago

Actions #4

Updated by okurz over 8 years ago

  • Status changed from New to In Progress
Actions #5

Updated by okurz over 8 years ago

  • Checklist item changed from [ ] os-autoinst, [ ] openQA, [ ] os-autoinst-distri-opensuse/master, [ ] os-autoinst-distri-opensuse/sle12 to [ ] os-autoinst, [x] openQA, [ ] os-autoinst-distri-opensuse/master, [ ] os-autoinst-distri-opensuse/sle12

with gh#540 merged we got openQA covered, other projects still missing

Actions #6

Updated by okurz over 8 years ago

@oholececk could you please check once more the coveralls settings regarding github PR notifications, see here https://coveralls.zendesk.com/hc/en-us/articles/201774895-Notifications
I don't have push access to openQA and therefore probably don't see the coveralls settings. It did properly show the recent coverage drop by you here https://coveralls.io/builds/5186643/source?filename=lib%2FOpenQA%2FWebAPI%2FController%2FFile.pm but it didn't inform github.

Actions #7

Updated by okurz over 8 years ago

  • Assignee set to oholecek
Actions #8

Updated by okurz about 8 years ago

  • Checklist item changed from [ ] os-autoinst, [x] openQA, [ ] os-autoinst-distri-opensuse/master, [ ] os-autoinst-distri-opensuse/sle12 to [ ] os-autoinst, [x] openQA, [ ] os-autoinst-distri-opensuse/master
Actions #9

Updated by okurz about 8 years ago

  • Assignee changed from oholecek to okurz

coveralls reporting is working currently for openQA.

For os-autoinst see https://github.com/os-autoinst/os-autoinst/pull/569

Actions #10

Updated by okurz about 8 years ago

  • Checklist item changed from [ ] os-autoinst, [x] openQA, [ ] os-autoinst-distri-opensuse/master to [x] os-autoinst, [x] openQA, [ ] os-autoinst-distri-opensuse/master
Actions #11

Updated by okurz about 8 years ago

would any admin please enable "os-autoinst" in coveralls.io? It works for my fork: https://coveralls.io/github/okurz/os-autoinst

Actions #12

Updated by okurz about 8 years ago

  • Checklist item changed from [x] os-autoinst, [x] openQA, [ ] os-autoinst-distri-opensuse/master to [x] os-autoinst, [x] openQA
  • Status changed from In Progress to Resolved

we have proper coveralls check for os-autoinst now, too. openQA and os-autoinst track test coverage changes so all good. The tests never had a coverage analysis so this is a totally different issue and must be tracked elsewhere.

Actions

Also available in: Atom PDF