Project

General

Profile

action #80118

coordination #39719: [saga][epic] Detection of "known failures" for stable tests, easy test results review and easy tracking of known issues

coordination #62420: [epic] Distinguish all types of incompletes

test incompletes with auto_review:"(?s)Failed to download.*Asset was pruned immediately after download":retry, not effective on osd, or second fix needed

Added by okurz 7 months ago. Updated 6 months ago.

Status:
Resolved
Priority:
Low
Assignee:
Category:
Concrete Bugs
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

e.g. see https://openqa.suse.de/tests/5044653

[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Download error 521, waiting 5 seconds for next try (4 remaining)
[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Download error 521, waiting 5 seconds for next try (3 remaining)
[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Download error 521, waiting 5 seconds for next try (2 remaining)
[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Download error 521, waiting 5 seconds for next try (1 remaining)
[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Purging "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" because of too many download errors

[2020-11-20T18:47:58.0410 UTC] [error] [pid:12467] Failed to download sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger

Related issues

Copied from openQA Project - action #71827: test incompletes with auto_review:"(?s)Failed to download.*Asset was pruned immediately after download":retry because worker cache prunes the asset it just downloadedResolved2020-07-30

History

#1 Updated by okurz 7 months ago

  • Copied from action #71827: test incompletes with auto_review:"(?s)Failed to download.*Asset was pruned immediately after download":retry because worker cache prunes the asset it just downloaded added

#2 Updated by okurz 7 months ago

https://gitlab.suse.de/openqa/auto-review/-/jobs/290490 shows 612 occurences in last 24h. I have therefore paused the alert "Incomplete jobs of last 24h alert"

#3 Updated by okurz 7 months ago

  • Priority changed from Normal to Low

I propose deleting the non-actionable alert: https://gitlab.suse.de/openqa/salt-states-openqa/-/merge_requests/407

reducing prio as we have the workaround in place with "retry".

If we decide to delete the alert we can keep the ticket open but move to "future" and unassign.

#4 Updated by okurz 6 months ago

  • Status changed from Feedback to Resolved
$ openqa-query-for-job-label 80118
5047209|2020-11-21 04:42:56|done|incomplete|hpc_ALPHA_mvapich2_mpi_slave00|setup failure: Failed to download sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047202|2020-11-21 04:35:05|done|incomplete|hpc_ALPHA_slurm_supportserver|setup failure: Failed to download openqa_support_server_sles12sp3.aarch64.qcow2 to /var/lib/openqa/cache/openqa.suse.de/openqa_support_server_sles12sp3.aarch64.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5049578|2020-11-21 04:35:05|done|incomplete|create_hdd_textmode|setup failure: Failed to download SLE-15-SP2-Online-aarch64-Build375.8-Media1.iso.sha256 to /var/lib/openqa/cache/openqa.suse.de/SLE-15-SP2-Online-aarch64-Build375.8-Media1.iso.sha256. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047199|2020-11-21 04:35:05|done|incomplete|hpc_BETA_mpich_mpi_master|setup failure: Failed to download sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047201|2020-11-21 04:35:05|done|incomplete|hpc_BETA_mpich_mpi_slave01|setup failure: Failed to download sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047204|2020-11-21 04:35:05|done|incomplete|hpc_ALPHA_slurm_slave_01|setup failure: Failed to download sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5049576|2020-11-21 04:35:05|done|incomplete|create_hdd_gnome|setup failure: Failed to download SLE-15-SP2-Online-aarch64-Build375.8-Media1.iso.sha256 to /var/lib/openqa/cache/openqa.suse.de/SLE-15-SP2-Online-aarch64-Build375.8-Media1.iso.sha256. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047198|2020-11-21 04:35:05|done|incomplete|hpc_BETA_mpich_mpi_supportserver|setup failure: Failed to download openqa_support_server_sles12sp3.aarch64.qcow2 to /var/lib/openqa/cache/openqa.suse.de/openqa_support_server_sles12sp3.aarch64.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047033|2020-11-21 04:32:52|done|incomplete|create_hdd_hpc_textmode|setup failure: Failed to download SLE-15-Installer-DVD-aarch64-GM-DVD1.iso to /var/lib/openqa/cache/openqa.suse.de/SLE-15-Installer-DVD-aarch64-GM-DVD1.iso. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047124|2020-11-21 04:32:52|done|incomplete|create_hdd_hpc_textmode|setup failure: Failed to download SLE-15-Installer-DVD-aarch64-GM-DVD1.iso to /var/lib/openqa/cache/openqa.suse.de/SLE-15-Installer-DVD-aarch64-GM-DVD1.iso. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2

no more recent occurences

Also available in: Atom PDF