Actions
action #80268
closedcoordination #80142: [saga][epic] Scale out: Redundant/load-balancing deployments of openQA, easy containers, containers on kubernetes
coordination #55364: [epic] Let's make codecov reports reliable
Fix flaky coverage - t/05-scheduler-full.t
Description
Motivation¶
See #55364 : codecov reports often report about coverage changes which are obviously not related to the actual changes of a PR, e.g. when documentation is changed. We can already trust our coverage analysis more but should have only coverage changes reported for actual changes we introduced in a pull request.
Acceptance criteria¶
- AC1: t/05-scheduler-full.t does not appear anymore as changing code coverage in unrelated changes
Suggestions¶
- Try to reproduce locally with
rm -rf cover_db/ && make coverage KEEP_DB=1 TESTS=t/05-scheduler-full.t SCHEDULER_FULLSTACK=1 - check coverage details in generated html report
- Fix uncovered lines with "uncoverable" statements or other means
- retry multiple times to check for flakyness
Updated by okurz almost 4 years ago
- Copied to action #80274: Fix flaky coverage - t/lib/OpenQA/Test/Utils.pm size:M added
Updated by okurz almost 4 years ago
- Status changed from In Progress to Feedback
Updated by okurz almost 4 years ago
- Status changed from Feedback to Resolved
PR merged. As I reached 100% statement coverage I am confident that this is reliable.
Actions