Project

General

Profile

Actions
Copy link

action #80118

closed

coordination #39719: [saga][epic] Detection of "known failures" for stable tests, easy test results review and easy tracking of known issues

coordination #62420: [epic] Distinguish all types of incompletes

test incompletes with auto_review:"(?s)Failed to download.*Asset was pruned immediately after download":retry, not effective on osd, or second fix needed

Added by okurz about 4 years ago. Updated about 4 years ago.

Status:
Resolved
Priority:
Low
Assignee:
okurz
Category:
Regressions/Crashes
Target version:
Ready
Start date:
Due date:
% Done:

0%

Estimated time:

Description

Observation

e.g. see https://openqa.suse.de/tests/5044653

[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Download error 521, waiting 5 seconds for next try (4 remaining)
[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Download error 521, waiting 5 seconds for next try (3 remaining)
[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Download error 521, waiting 5 seconds for next try (2 remaining)
[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Download error 521, waiting 5 seconds for next try (1 remaining)
[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Purging "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" because of too many download errors

[2020-11-20T18:47:58.0410 UTC] [error] [pid:12467] Failed to download sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger

Related issues 1 (0 open — 1 closed)

Copied from openQA Project (public) - action #71827: test incompletes with auto_review:"(?s)Failed to download.*Asset was pruned immediately after download":retry because worker cache prunes the asset it just downloadedResolvedmkittler2020-07-30

Actions
Actions
Copy link
 #1

Updated by okurz about 4 years ago

  • Copied from action #71827: test incompletes with auto_review:"(?s)Failed to download.*Asset was pruned immediately after download":retry because worker cache prunes the asset it just downloaded added
Actions
Copy link
 #2

Updated by okurz about 4 years ago

https://gitlab.suse.de/openqa/auto-review/-/jobs/290490 shows 612 occurences in last 24h. I have therefore paused the alert "Incomplete jobs of last 24h alert"

Actions
Copy link
 #3

Updated by okurz about 4 years ago

  • Priority changed from Normal to Low

I propose deleting the non-actionable alert: https://gitlab.suse.de/openqa/salt-states-openqa/-/merge_requests/407

reducing prio as we have the workaround in place with "retry".

If we decide to delete the alert we can keep the ticket open but move to "future" and unassign.

Actions
Copy link
 #4

Updated by okurz about 4 years ago

  • Status changed from Feedback to Resolved
$ openqa-query-for-job-label 80118
5047209|2020-11-21 04:42:56|done|incomplete|hpc_ALPHA_mvapich2_mpi_slave00|setup failure: Failed to download sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047202|2020-11-21 04:35:05|done|incomplete|hpc_ALPHA_slurm_supportserver|setup failure: Failed to download openqa_support_server_sles12sp3.aarch64.qcow2 to /var/lib/openqa/cache/openqa.suse.de/openqa_support_server_sles12sp3.aarch64.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5049578|2020-11-21 04:35:05|done|incomplete|create_hdd_textmode|setup failure: Failed to download SLE-15-SP2-Online-aarch64-Build375.8-Media1.iso.sha256 to /var/lib/openqa/cache/openqa.suse.de/SLE-15-SP2-Online-aarch64-Build375.8-Media1.iso.sha256. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047199|2020-11-21 04:35:05|done|incomplete|hpc_BETA_mpich_mpi_master|setup failure: Failed to download sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047201|2020-11-21 04:35:05|done|incomplete|hpc_BETA_mpich_mpi_slave01|setup failure: Failed to download sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047204|2020-11-21 04:35:05|done|incomplete|hpc_ALPHA_slurm_slave_01|setup failure: Failed to download sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5049576|2020-11-21 04:35:05|done|incomplete|create_hdd_gnome|setup failure: Failed to download SLE-15-SP2-Online-aarch64-Build375.8-Media1.iso.sha256 to /var/lib/openqa/cache/openqa.suse.de/SLE-15-SP2-Online-aarch64-Build375.8-Media1.iso.sha256. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047198|2020-11-21 04:35:05|done|incomplete|hpc_BETA_mpich_mpi_supportserver|setup failure: Failed to download openqa_support_server_sles12sp3.aarch64.qcow2 to /var/lib/openqa/cache/openqa.suse.de/openqa_support_server_sles12sp3.aarch64.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047033|2020-11-21 04:32:52|done|incomplete|create_hdd_hpc_textmode|setup failure: Failed to download SLE-15-Installer-DVD-aarch64-GM-DVD1.iso to /var/lib/openqa/cache/openqa.suse.de/SLE-15-Installer-DVD-aarch64-GM-DVD1.iso. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047124|2020-11-21 04:32:52|done|incomplete|create_hdd_hpc_textmode|setup failure: Failed to download SLE-15-Installer-DVD-aarch64-GM-DVD1.iso to /var/lib/openqa/cache/openqa.suse.de/SLE-15-Installer-DVD-aarch64-GM-DVD1.iso. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2

no more recent occurences

Actions
Copy link

Also available in: Atom PDF