action #69448
opencoordination #102906: [saga][epic] Increased stability of tests with less "known failures", known incompletes handled automatically within openQA
coordination #102909: [epic] Prevent more incompletes already within os-autoinst or openQA
test incompletes with auto_review:"(?s)was downloaded by.*details.*unavailable here.*Failed to download":retry , not helpful details
0%
Description
Observation¶
https://openqa.suse.de/tests/4504435 is incomplete with reason "setup failure: Failed to download SLEHPC-15-SP2-x86_64-GM-gnome.qcow2 to /var/lib/openqa/cache/openqa.suse.de/SLEHPC-15-SP2-x86_64-GM-gnome.qcow2" so no explanation of the real reason in there. The log content of autoinst-log.txt as shown on the details page shows:
[2020-07-30T06:03:09.0587 CEST] [debug] [pid:36179] Found HDD_1, caching SLEHPC-15-SP2-x86_64-GM-gnome.qcow2
[2020-07-30T06:03:09.0590 CEST] [info] [pid:36179] Downloading SLEHPC-15-SP2-x86_64-GM-gnome.qcow2, request #22885 sent to Cache Service
[2020-07-30T06:03:14.0667 CEST] [info] [pid:36179] Download of SLEHPC-15-SP2-x86_64-GM-gnome.qcow2 processed:
Asset "SLEHPC-15-SP2-x86_64-GM-gnome.qcow2" was downloaded by #22884, details are therefore unavailable here
[2020-07-30T06:03:14.0671 CEST] [error] [pid:36179] Failed to download SLEHPC-15-SP2-x86_64-GM-gnome.qcow2 to /var/lib/openqa/cache/openqa.suse.de/SLEHPC-15-SP2-x86_64-GM-gnome.qcow2
[2020-07-30T06:03:14.0695 CEST] [info] [pid:36179] +++ worker notes +++
[2020-07-30T06:03:14.0695 CEST] [info] [pid:36179] End time: 2020-07-30 04:03:14
[2020-07-30T06:03:14.0695 CEST] [info] [pid:36179] Result: setup failure
so also not really helpful as the user does not know what "downloaded by #22884" means or how to access these details. Also https://openqa.suse.de/tests/4504435/file/worker-log.txt does not add more.
Acceptance criteria¶
- AC1: The real reason for the download error is accessible in the job details (either "reason" or autoinst-log.txt)
Suggestions¶
- Research what the actual error could be and add it as a "likely explanation" in the existing error string
- Try to include the actual error details into the affected jobs logs
- If possible, adapt the "reason" to be more specific with details about the actual error
Updated by okurz over 4 years ago
- Copied to coordination #69451: [epic] test incompletes with "(?s)Download.*successful.*Failed to download":retry, not helpful details added
Updated by kraih over 4 years ago
The log message Asset "SLEHPC-15-SP2-x86_64-GM-gnome.qcow2" was downloaded by #22884, details are therefore unavailable here is actually just a fallback. Normally in that place you would see the output of the referenced job (#22884). For some reason it appears that information was not available here (referenced job already deleted from SQLite?).
Updated by okurz about 4 years ago
- Priority changed from Normal to Low
- Target version changed from Ready to future
similar as in #69451 we have an automatic workaround in place and there is no clear idea what to do so we can also regard this as Low+future and act on it depending on further feedback or when we look for correspondingly labeled jobs.
Updated by okurz about 4 years ago
- Copied to action #73285: test incompletes with auto_review:"(?s)Download of.*processed[^:].*Failed to download":retry , not helpful details about reason of error added
Updated by okurz over 3 years ago
This is an autogenerated message for openQA integration by the openqa_review script:
This bug is still referenced in a failing openQA test: autoyast_zvm_sles_product_reg@s390x-zVM-vswitch-l2
https://openqa.suse.de/tests/6353568
To prevent further reminder comments one of the following options should be followed:
- The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
- The openQA job group is moved to "Released" or "EOL" (End-of-Life)
- The label in the openQA scenario is removed
Updated by openqa_review almost 2 years ago
This is an autogenerated message for openQA integration by the openqa_review script:
This bug is still referenced in a failing openQA test: qam-minimal+base-installation
https://openqa.suse.de/tests/10430026#step/bootloader_start/1
To prevent further reminder comments one of the following options should be followed:
- The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
- The openQA job group is moved to "Released" or "EOL" (End-of-Life)
- The bugref in the openQA scenario is removed or replaced, e.g.
label:wontfix:boo1234
Expect the next reminder at the earliest in 560 days if nothing changes in this ticket.
Updated by livdywan 4 months ago ยท Edited
I believe this job is hitting the issue described here: https://openqa.opensuse.org/tests/4398612
Result: incomplete, finished about 18 hours ago (ran for 00:44 minutes)
Reason: cache failure: Failed to download openSUSE-Tumbleweed-DVD-x86_64-Snapshot20240812-Media.iso to /var/lib/openqa/cache/openqa.opensuse.org/openSUSE-Tumbleweed-DVD-x86_64-Snapshot20240812-Media.iso [Auto-restarting because reason matches the configured "auto_clone_regex".]
[2024-08-12T14:52:43.116072Z] [debug] Found ISO, caching openSUSE-Tumbleweed-DVD-x86_64-Snapshot20240812-Media.iso
[2024-08-12T14:52:43.118452Z] [info] Downloading openSUSE-Tumbleweed-DVD-x86_64-Snapshot20240812-Media.iso, request #273118 sent to Cache Service
[2024-08-12T14:52:53.482636Z] [info] Download of openSUSE-Tumbleweed-DVD-x86_64-Snapshot20240812-Media.iso processed:
Asset "openSUSE-Tumbleweed-DVD-x86_64-Snapshot20240812-Media.iso" was downloaded by #273081, details are therefore unavailable here
[2024-08-12T14:52:53.482885Z] [error] Failed to download openSUSE-Tumbleweed-DVD-x86_64-Snapshot20240812-Media.iso to /var/lib/openqa/cache/openqa.opensuse.org/openSUSE-Tumbleweed-DVD-x86_64-Snapshot20240812-Media.iso