action #138320
closedtest fail hook in openqa_webui is failing: script/opencli api jobs - Can't locate Mojo::Base in @INC
0%
Description
Observation¶
openQA test in scenario openqa-Tumbleweed-dev-x86_64-openqa_from_git@64bit-2G fails in
openqa_webui
# script/opencli api jobs
wCan't locate Mojo::Base in @INC
The investigate jobs fail in different ways:
https://openqa.opensuse.org/tests/3664888
[2023-10-22T15:00:03.830633Z] [debug] [pid:93263] git hash in openqa: 3bc7a4b627ceba9a2e9f075295d126470fe39b38
[2023-10-22T15:00:03.851028Z] [info] [pid:93263] ::: OpenQA::Isotovideo::Utils::clone_git: Cloning git URL 'https://github.com/os-autoinst/os-autoinst-wheel-launcher.git' into '/var/lib/openqa/pool/8'
[2023-10-22T15:00:03.886082Z] [debug] [pid:93263] Cloning into 'os-autoinst-wheel-launcher'...
fatal: unable to access 'https://github.com/os-autoinst/os-autoinst-wheel-launcher.git/': Recv failure: Connection reset by peer
[2023-10-22T15:00:03.886243Z] [debug] [pid:93263] Clone failed, retries left: 2 of 2
[2023-10-22T15:00:08.892492Z] [info] [pid:93263] ::: OpenQA::Isotovideo::Utils::clone_git: Cloning git URL 'https://github.com/os-autoinst/os-autoinst-wheel-launcher.git' into '/var/lib/openqa/pool/8'
[2023-10-22T15:00:08.930153Z] [debug] [pid:93263] Cloning into 'os-autoinst-wheel-launcher'...
fatal: unable to access 'https://github.com/os-autoinst/os-autoinst-wheel-launcher.git/': Recv failure: Connection reset by peer
[2023-10-22T15:00:08.930282Z] [debug] [pid:93263] Clone failed, retries left: 1 of 2
[2023-10-22T15:00:13.935994Z] [info] [pid:93263] ::: OpenQA::Isotovideo::Utils::clone_git: Cloning git URL 'https://github.com/os-autoinst/os-autoinst-wheel-launcher.git' into '/var/lib/openqa/pool/8'
[2023-10-22T15:00:13.970518Z] [debug] [pid:93263] Cloning into 'os-autoinst-wheel-launcher'...
fatal: unable to access 'https://github.com/os-autoinst/os-autoinst-wheel-launcher.git/': Recv failure: Connection reset by peer
[2023-10-22T15:00:13.970613Z] [debug] [pid:93263] Clone failed, retries left: 0 of 2
[2023-10-22T15:00:18.971041Z] [warn] [pid:93263] !!! main: Unable to clone Git repository 'https://github.com/os-autoinst/os-autoinst-wheel-launcher.git' specified via openqa/wheels.yaml (see log for details) at /usr/lib/os-autoinst/OpenQA/Isotovideo/Utils.pm line 56.
https://openqa.opensuse.org/tests/3664890#step/dashboard/4
Test died: no candidate needle with tag(s) 'desktop-runner, screenlock' matched
https://openqa.opensuse.org/tests/3664891 / https://openqa.opensuse.org/tests/3664889
[2023-10-22T15:00:39.200922Z] [debug] [pid:27430] fatal: remote error: upload-pack: not our ref bbf801599f8d6630c4b8c564473365375deb884f
[2023-10-22T15:00:39.201054Z] [debug] [pid:27430] Clone failed, retries left: 2 of 2
[2023-10-22T15:00:44.201377Z] [debug] [pid:27430] Skipping to clone 'https://github.com/os-autoinst/os-autoinst-distri-opensuse.git'; os-autoinst-distri-opensuse already exists
[2023-10-22T15:00:44.212271Z] [debug] [pid:27430] git hash in /var/lib/openqa/pool/1/os-autoinst-distri-opensuse: 065c4274184ef090642c946c982a4641e3fcf68d
[2023-10-22T15:00:44.213047Z] [warn] [pid:27430] !!! main: 'SCHEDULE' not set and ./main.pm not found, need one of both at /usr/lib/os-autoinst/OpenQA/Isotovideo/Utils.pm line 276.
Test suite description¶
Reproducible¶
Fails since (at least) Build :TW.23842 (current job)
Expected result¶
Last good: :TW.23841 (or more recent)
Further details¶
Always latest result in this scenario: latest
Updated by maritawerner 7 months ago
- Project changed from openQA Tests to openQA Infrastructure
- Category deleted (
Bugs in existing tests)
Updated by livdywan 7 months ago
- Status changed from In Progress to Feedback
- Priority changed from High to Normal
livdywan wrote in #note-5:
https://openqa.opensuse.org/tests/overview?build=poo%23138320&distri=openqa&version=Tumbleweed
https://openqa.opensuse.org/tests/overview?build=poo%23138320_&distri=openqa&version=Tumbleweed
Both the original and the latest build don't reproduce any issues... so maybe there's nothing we can do here...
Updated by tinita 7 months ago
I think the title is a bit misleading. Can't locate Mojo::Base in @INC.
That's just the post_fail_hook: https://github.com/os-autoinst/os-autoinst-distri-openQA/blob/master/lib/openQAcoretest.pm#L17
The failure was in the clone: https://openqa.opensuse.org/tests/3664877#step/openqa_webui/20
I think we should improve the post_fail_hook to check first whether openqa-cli / Mojo::Base exists, because I had been wondering about that error too, when I first saw it some time ago.
Updated by tinita 7 months ago
tinita wrote in #note-7:
I think we should improve the post_fail_hook to check first whether openqa-cli / Mojo::Base exists, because I had been wondering about that error too, when I first saw it some time ago.
Or even just overwrite post_fail_hook here to do nothing, because if it fails in the installation, openqa-cli won't be helpful anyway:
https://github.com/os-autoinst/os-autoinst-distri-openQA/blob/master/tests/install/openqa_webui.pm
Updated by livdywan 7 months ago
- Copied to action #138491: tests fail in retry despite having successfully executed relevant commands such as git clone size:M added
Updated by livdywan 7 months ago
- Status changed from Feedback to Blocked
- From what we can confirm the cloning worked, and this is why script/openqa-cli exists and only fails in dependencies
- retry still reports a failing result
- Filed as #138491
- We're assuming more retries would actually work around the bug in retry, @okurz is looking into that
- The post fail hook ran into deps issues because cloning "failed"
- This wouldn't be a problem in other cases of broken deps or installation failing as the error would in fact be visible
Let's block this on #138491
Updated by okurz 7 months ago
https://github.com/os-autoinst/os-autoinst-distri-openQA/pull/151 for more retries