action #1789
closedopenqa test coverage
0%
Description
We may want to add test coverage checking to our test suite
http://article.gmane.org/gmane.comp.lang.perl.perl-mongers.moscow/9302
Updated by coolo almost 10 years ago
- Category set to 124
- Target version set to Easy hacks
Updated by okurz almost 9 years ago
In which project exactly do you want to gather test coverage? openQA itself gathers some coverage, see badge here: https://github.com/os-autoinst/openQA#openqa--
What I would like to do is gather coverage for os-autoinst itself, at best locally as well as with coveralls.io . Do you have anything else in mind?
Updated by lnussel almost 9 years ago
the issue is two years old. might well be that I was referring to openQA itself. os-autoinst would be good of course.
Also reminds me that the coveralls hook to github is broken since monthgs. Who has the coveralls account data?
Updated by okurz over 8 years ago
- Related to action #10262: Prevent further test coverage drop added
Updated by oholecek over 8 years ago
How is it broken? I just logged in coveralls and it seems it works fine for openQA. Fine in sense it does something on each commit/PR.
Updated by okurz over 8 years ago
results from irc discussion:
- everyone with commit access to github repo has access to setup coveralls
- openQA coveralls is still active but it does not comment PRs
e.g. https://travis-ci.org/os-autoinst/openQA/builds/103067657 pushed https://coveralls.io/jobs/11276927, but no comment is seen in https://github.com/os-autoinst/openQA/pull/509
according the build log the coverage is actually the same
[18/01/2016 10:48:40] perhaps I need to try harder to regress :)
Updated by okurz over 8 years ago
Situation improved a bit with https://github.com/os-autoinst/openQA/pull/513
We can enable hard check by setting a threshold in .travis.yml at least for openQA, os-autoinst needs to be done as well as tests distribution itself if this is feasible. coveralls got reconfigured by oholecek but still stays silent
Updated by okurz about 8 years ago
- Status changed from New to Resolved
we have a coverage check with threshold plus the coveralls reports working for openQA. Since that, the test coverage improved a lot already.