QA » openQA Project

I found a merged PR where the coverage decreased by 5%: https://github.com/os-autoinst/openQA/pull/4257

That's why we regularly see an increase of 5% now

https://app.codecov.io/gh/os-autoinst/openQA/compare/4257/changes
The lines marked with --- lost coverage:

     92 sub _bail_with_result_panel_contents {
---  93     my ($result_panel_contents) = @_;
---  94     diag("full result panel contents:\n$result_panel_contents");
---  95     javascript_console_has_no_warnings_or_errors;
     96     BAIL_OUT "Expected result not found";    # uncoverable statement
     97 }
...
    113         if ($looking_for_result && $status_text =~ qr/Result: (.*) finished/) {
--- 114             diag("stopped waiting for '$result_panel', result turned out to be '$1'");
--- 115             return _bail_with_result_panel_contents $status_text;
    116         }

https://github.com/os-autoinst/openQA/pull/4294 Mark uncoverable bailout code paths - merged

tinita wrote:

One solution would be to just delete the cover_db folder in tools/retry, but that would also remove coverage data from previous other tests which we want to keep.

Here's an idea. We already define COVERDB_SUFFIX, and we can see that in tools/retry. So we can delete the correct db after an iteration. It doesn't seem 100% clean, but not sure how else we could perform such cleanup.

https://github.com/os-autoinst/openQA/pull/4295

https://github.com/os-autoinst/openQA/pull/4295 was merged

PR https://github.com/os-autoinst/openQA/pull/4299 t: Add a hook to tools/retry to delete coverage data

edit: merged 3pm