QA » openQA Project

Regarding Codecov issues:
Devel::Cover::Report::Codecov doesn't yet support Github Actions, and I tried to add it, but had problems with it.
But that could be because Codecov and GitHub currently have problems:
https://status.codecov.io/

GitHub Tokenless Actions users may be experiencing intermittent issues retrieving commits and other tasks. The Codecov team is actively monitoring the situation.

In the end I managed to successfully upload a report, but I still need to figure out all required parameters.

Regarding codecov: in IRC Olaf Alders just pointed me to https://metacpan.org/pod/Devel::Cover::Report::Codecovbash

According to https://github.community/t/enable-nested-virtualization-for-vms/17146/5 travis CI has nested virtualization but github actions does not. https://github.com/actions/virtual-environments/issues/114 and https://github.com/actions/virtual-environments/issues/183 are related rejected feature requests. Might be something to consider.

we are back to the state of generating a complete report, now based on a Leap 15.2 base image, but with the same problem as originally that a codecov token can not be found:
https://github.com/os-autoinst/os-autoinst/pull/1576/checks?check_run_id=1530717163

@tinita in #66721#note-9 you mentioned "In the end I managed to successfully upload a report, but I still need to figure out all required parameters.". Any hints on what we should do next?

EDIT: According to https://github.com/marketplace/actions/codecov no token should be necessary anymore for public repos when using the codecov action. Will try that. But to prevent Devel::Cover::Codecov to try to upload the report directly from tests we should likely use Devel::Cover::Codecovbash which is not yet part of openSUSE:Factory (nor devel:languages:perl). So I created https://build.opensuse.org/request/show/854598 to submit to devel:languages:perl first. For now likely we need to load the package from cpan then for github actions.

I updated my PR to also add Devel::Cover::Codecovbash as alternative dependency. If that does not work because the package is not available we could use cpanm directly from GHA. Another alternative might be to actually specify the token from https://app.codecov.io/gh/os-autoinst/os-autoinst/settings as part of GHA secrets e.g. with export CODECOV_TOKEN=${{ secrets.CODECOV_TOKEN }}