Project

General

Profile

Actions

action #80118

closed

coordination #39719: [saga][epic] Detection of "known failures" for stable tests, easy test results review and easy tracking of known issues

coordination #62420: [epic] Distinguish all types of incompletes

test incompletes with auto_review:"(?s)Failed to download.*Asset was pruned immediately after download":retry, not effective on osd, or second fix needed

Added by okurz over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Low
Assignee:
Category:
Regressions/Crashes
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:

Description

Observation

e.g. see https://openqa.suse.de/tests/5044653

[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Download error 521, waiting 5 seconds for next try (4 remaining)
[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Download error 521, waiting 5 seconds for next try (3 remaining)
[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Download error 521, waiting 5 seconds for next try (2 remaining)
[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Download error 521, waiting 5 seconds for next try (1 remaining)
[info] [#198] Downloading "sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" from "http://openqa.suse.de/tests/5044653/asset/hdd/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2"
[info] [#198] Download of "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" failed: 521 Connect timeout
[info] [#198] Purging "/var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2" because of too many download errors

[2020-11-20T18:47:58.0410 UTC] [error] [pid:12467] Failed to download sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17254:slurm-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger

Related issues 1 (0 open1 closed)

Copied from openQA Project - action #71827: test incompletes with auto_review:"(?s)Failed to download.*Asset was pruned immediately after download":retry because worker cache prunes the asset it just downloadedResolvedmkittler2020-07-30

Actions
Actions #1

Updated by okurz over 3 years ago

  • Copied from action #71827: test incompletes with auto_review:"(?s)Failed to download.*Asset was pruned immediately after download":retry because worker cache prunes the asset it just downloaded added
Actions #2

Updated by okurz over 3 years ago

https://gitlab.suse.de/openqa/auto-review/-/jobs/290490 shows 612 occurences in last 24h. I have therefore paused the alert "Incomplete jobs of last 24h alert"

Actions #3

Updated by okurz over 3 years ago

  • Priority changed from Normal to Low

I propose deleting the non-actionable alert: https://gitlab.suse.de/openqa/salt-states-openqa/-/merge_requests/407

reducing prio as we have the workaround in place with "retry".

If we decide to delete the alert we can keep the ticket open but move to "future" and unassign.

Actions #4

Updated by okurz over 3 years ago

  • Status changed from Feedback to Resolved
$ openqa-query-for-job-label 80118
5047209|2020-11-21 04:42:56|done|incomplete|hpc_ALPHA_mvapich2_mpi_slave00|setup failure: Failed to download sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047202|2020-11-21 04:35:05|done|incomplete|hpc_ALPHA_slurm_supportserver|setup failure: Failed to download openqa_support_server_sles12sp3.aarch64.qcow2 to /var/lib/openqa/cache/openqa.suse.de/openqa_support_server_sles12sp3.aarch64.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5049578|2020-11-21 04:35:05|done|incomplete|create_hdd_textmode|setup failure: Failed to download SLE-15-SP2-Online-aarch64-Build375.8-Media1.iso.sha256 to /var/lib/openqa/cache/openqa.suse.de/SLE-15-SP2-Online-aarch64-Build375.8-Media1.iso.sha256. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047199|2020-11-21 04:35:05|done|incomplete|hpc_BETA_mpich_mpi_master|setup failure: Failed to download sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047201|2020-11-21 04:35:05|done|incomplete|hpc_BETA_mpich_mpi_slave01|setup failure: Failed to download sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047204|2020-11-21 04:35:05|done|incomplete|hpc_ALPHA_slurm_slave_01|setup failure: Failed to download sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2 to /var/lib/openqa/cache/openqa.suse.de/sle-15-SP2-aarch64-Build:17241:openmpi4-with-hpc.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5049576|2020-11-21 04:35:05|done|incomplete|create_hdd_gnome|setup failure: Failed to download SLE-15-SP2-Online-aarch64-Build375.8-Media1.iso.sha256 to /var/lib/openqa/cache/openqa.suse.de/SLE-15-SP2-Online-aarch64-Build375.8-Media1.iso.sha256. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047198|2020-11-21 04:35:05|done|incomplete|hpc_BETA_mpich_mpi_supportserver|setup failure: Failed to download openqa_support_server_sles12sp3.aarch64.qcow2 to /var/lib/openqa/cache/openqa.suse.de/openqa_support_server_sles12sp3.aarch64.qcow2. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047033|2020-11-21 04:32:52|done|incomplete|create_hdd_hpc_textmode|setup failure: Failed to download SLE-15-Installer-DVD-aarch64-GM-DVD1.iso to /var/lib/openqa/cache/openqa.suse.de/SLE-15-Installer-DVD-aarch64-GM-DVD1.iso. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2
5047124|2020-11-21 04:32:52|done|incomplete|create_hdd_hpc_textmode|setup failure: Failed to download SLE-15-Installer-DVD-aarch64-GM-DVD1.iso to /var/lib/openqa/cache/openqa.suse.de/SLE-15-Installer-DVD-aarch64-GM-DVD1.iso. Asset was pruned immediately after download (poo#71827), please retrigger|openqaworker-arm-2

no more recent occurences

Actions

Also available in: Atom PDF