action #1789


openqa test coverage

Added by lnussel over 9 years ago. Updated about 7 years ago.

Feature requests
Target version:
Start date:
Due date:
% Done:


Estimated time:
8.00 h


We may want to add test coverage checking to our test suite

Related issues 1 (0 open1 closed)

Related to openQA Project - action #10262: Prevent further test coverage dropResolvedokurz2016-01-17

Actions #1

Updated by ancorgs over 9 years ago

  • Priority changed from Normal to High
Actions #2

Updated by coolo almost 9 years ago

  • Category set to 124
  • Target version set to Easy hacks
Actions #3

Updated by coolo almost 8 years ago

  • Priority changed from High to Normal
Actions #4

Updated by okurz almost 8 years ago

In which project exactly do you want to gather test coverage? openQA itself gathers some coverage, see badge here:

What I would like to do is gather coverage for os-autoinst itself, at best locally as well as with . Do you have anything else in mind?

Actions #5

Updated by lnussel almost 8 years ago

the issue is two years old. might well be that I was referring to openQA itself. os-autoinst would be good of course.

Also reminds me that the coveralls hook to github is broken since monthgs. Who has the coveralls account data?

Actions #6

Updated by okurz over 7 years ago

  • Related to action #10262: Prevent further test coverage drop added
Actions #7

Updated by oholecek over 7 years ago

How is it broken? I just logged in coveralls and it seems it works fine for openQA. Fine in sense it does something on each commit/PR.

Actions #8

Updated by okurz over 7 years ago

results from irc discussion:

  • everyone with commit access to github repo has access to setup coveralls
  • openQA coveralls is still active but it does not comment PRs

e.g. pushed, but no comment is seen in
according the build log the coverage is actually the same

[18/01/2016 10:48:40] perhaps I need to try harder to regress :)

Actions #9

Updated by okurz over 7 years ago

Situation improved a bit with
We can enable hard check by setting a threshold in .travis.yml at least for openQA, os-autoinst needs to be done as well as tests distribution itself if this is feasible. coveralls got reconfigured by oholecek but still stays silent

Actions #10

Updated by okurz about 7 years ago

  • Status changed from New to Resolved

we have a coverage check with threshold plus the coveralls reports working for openQA. Since that, the test coverage improved a lot already.


Also available in: Atom PDF