coordination #55364
Updated by mkittler almost 5 years ago
## Observation
codecov reports often report about coverage changes which are obviously not related to the actual changes of a PR, e.g. when documentation is changed or as in https://github.com/os-autoinst/openQA/pull/2253#issuecomment-520042072 . It seems some of our tests – maybe the full stack test – introduced a flakyness in coverage.
## Suggestions
We should try to make the reports more reliable and hence less annoying with big red color when it is not helpful.
Let's try to collect our observations here:
* https://github.com/os-autoinst/openQA/pull/2253#issuecomment-520042072
* lib/OpenQA/Worker/Settings.pm 84.9% <0%> (-13.21%) arrow_down
* lib/OpenQA/Worker/WebUIConnection.pm 84.42% <0%> (+2.51%) arrow_up
* https://github.com/os-autoinst/openQA/pull/2135#issuecomment-506641541
* lib/OpenQA/WebSockets.pm 88.4% <0%> (-5.8%) arrow_down
* lib/OpenQA/Scheduler/Model/Jobs.pm 86.11% <0%> (-2.78%) arrow_down
* lib/OpenQA/Worker/Commands.pm 81.17% <0%> (-2.36%) arrow_down
* lib/OpenQA/Utils.pm 95.81% <0%> (-0.2%) arrow_down
* https://github.com/os-autoinst/openQA/pull/2161#issuecomment-513477665
* lib/OpenQA/Setup.pm 90.83% <100%> (ø) arrow_up
* lib/OpenQA/Worker/Settings.pm 84.31% <0%> (-13.73%) arrow_down
* lib/OpenQA/Worker/Engines/isotovideo.pm 94.66% <0%> (+0.48%) arrow_up
* https://github.com/os-autoinst/openQA/pull/2161#issuecomment-513477665
* lib/OpenQA/Setup.pm 90.83% <100%> (ø) arrow_up
* lib/OpenQA/Worker/Settings.pm 84.31% <0%> (-13.73%) arrow_down
* lib/OpenQA/Worker/Engines/isotovideo.pm 94.66% <0%> (+0.48%) arrow_up
* https://codecov.io/gh/os-autoinst/openQA/pull/2258/changes
* https://github.com/os-autoinst/openQA/pull/2920#issuecomment-611509627
* `OpenQA::Schema::Result::Jobs::done` is only invoked in some testruns with `$args{newbuild}`