Project

General

Profile

action #104517

Connections to download.opensuse.org affecting openQA CI and o3

Added by cdywan over 1 year ago. Updated about 1 year ago.

Status:
Resolved
Priority:
Low
Assignee:
okurz
Category:
Concrete Bugs
Target version:
Ready
Start date:
2021-12-30
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Motivation

I'm observing more issues with download.opensuse.org and I need something I can refer to. Regardless of wether it's an issue on our end or somewhere else.

Observation

On some GHA jobs:

Error: ing: libsndfile1-1.0.31-2.2.x86_64.rpm [error]
Download (curl) error for 'http://download.opensuse.org/tumbleweed/repo/oss/x86_64/libsndfile1-1.0.31-2.2.x86_64.rpm':
Abort, retry, ignore? [a/r/i/...? shows all options] (a): a
Error code: Curl error 55
Error message: Connection died, tried 5 times before giving up

Error: ing: fontconfig-2.13.1-2.12.x86_64.rpm [error]
Download (curl) error for 'http://download.opensuse.org/tumbleweed/repo/oss/x86_64/fontconfig-2.13.1-2.12.x86_64.rpm':
Abort, retry, ignore? [a/r/i/...? shows all options] (a): a
Error code: Curl error 55
Error message: Connection died, tried 5 times before giving up

On some openQA tests on o3:

https://openqa.opensuse.org/tests/2111949#step/openqa_worker/3
https://openqa.opensuse.org/tests/2111960#step/openqa_webui/9

Needles with the error messages attached.

2111949.png (39.2 KB) 2111949.png cdywan, 2021-12-30 11:13
2111960.png (72.7 KB) 2111960.png cdywan, 2021-12-30 11:13
12336
12339

Related issues

Related to openQA Project - action #104619: openqa_from_containers needs adapted post_fail_hook (was: tests fails due to openSUSE mirror problems with can't locate Mojo/Base.pm in INC in script/client)Resolved2021-12-29

History

#1 Updated by tinita over 1 year ago

I just looked into https://github.com/os-autoinst/os-autoinst/actions/workflows/ci_extended.yml and this problem started apparently on December 13.
Just that we usually don't see it in pull requests because it is only executed on push events, where only the repo admin(s) get a notification.

#2 Updated by okurz over 1 year ago

  • Category set to Concrete Bugs
  • Status changed from New to Blocked
  • Assignee set to okurz
  • Priority changed from Normal to Low
  • Target version set to Ready

#3 Updated by okurz over 1 year ago

Also see https://suse.slack.com/archives/C028VS8TM2B/p1640669383254300 and https://gist.github.com/luc14n0/1a0b36badf5c3ce1304ff09c3475a05c and https://github.com/openSUSE/zypper/issues/399

TL;DR: Might be a curl regression, investigation is ongoing. Suggested workaround is to use dnf with a high number of retries configured replacing zypper.

#4 Updated by okurz over 1 year ago

  • Related to action #104619: openqa_from_containers needs adapted post_fail_hook (was: tests fails due to openSUSE mirror problems with can't locate Mojo/Base.pm in INC in script/client) added

#5 Updated by okurz over 1 year ago

https://github.com/openSUSE/zypper/issues/399#issuecomment-1010465696 confirms that the main issue seems to be a curl regression or change of behaviour.

#6 Updated by okurz about 1 year ago

  • Status changed from Blocked to Resolved

mirror infrastructure has improved since then so currently less or no problems. This can re-appear anytime as zypper is still mediocre at handling retries, see the related issues on github.

Also available in: Atom PDF