Project

General

Profile

Actions
Copy link

action #152941

closed

circleCI job runs into 20m timeout due to slow download from registry.opensuse.org

Added by okurz 4 months ago. Updated 4 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
okurz
Category:
-
Target version:
openQA Project - Ready
Start date:
2023-12-27
Due date:
% Done:

0%

Estimated time:

Description

Observation

https://app.circleci.com/pipelines/github/os-autoinst/openQA/12718/workflows/cbbf42a8-aabe-4365-9168-ea58c5f6b397/jobs/118659

showing

8a9cdc78: Downloading [====>                                              ]  19.03MB/192.9MB
  Error pulling image registry.opensuse.org/devel/openqa/ci/containers/base:latest: context deadline exceeded... retrying
  image cache not found on this host, downloading registry.opensuse.org/devel/openqa/ci/containers/base:latest
latest: Pulling from devel/openqa/ci/containers/base

similar one day before.
Likely a temporary issue which we can not realistically improve but should track.

Related issues 4 (1 open — 3 closed)

Related to openQA Project - action #67855: [tests][ci] circleci often abort in "cache" unable to read container image from registry.opensuse.orgNew2020-06-09

Actions
Related to openQA Project - action #71554: unstable/flaky/sporadic t/full-stack.t test failing in script waits on CircleCIResolvedlivdywan2020-09-19

Actions
Related to openQA Project - action #72316: [tests][ci] circleci can fail in `zypper ref` due to temporary repository problemsResolvedokurz2020-06-09

Actions
Related to openQA Project - action #66664: circleci jobs do not retry, are aborted with "Too long with no output (exceeded 10m0s): context deadline exceeded"Resolvedlivdywan2020-05-09

Actions
Actions
Copy link
 #2

Updated by okurz 4 months ago

Actions
Copy link
 #3

Updated by okurz 4 months ago

  • Related to action #67855: [tests][ci] circleci often abort in "cache" unable to read container image from registry.opensuse.org added
Actions
Copy link
 #4

Updated by okurz 4 months ago

  • Related to action #71554: unstable/flaky/sporadic t/full-stack.t test failing in script waits on CircleCI added
Actions
Copy link
 #5

Updated by okurz 4 months ago

  • Related to action #72316: [tests][ci] circleci can fail in `zypper ref` due to temporary repository problems added
Actions
Copy link
 #6

Updated by okurz 4 months ago

  • Related to action #66664: circleci jobs do not retry, are aborted with "Too long with no output (exceeded 10m0s): context deadline exceeded" added
Actions
Copy link
 #7

Updated by okurz 4 months ago

  • Status changed from Feedback to In Progress
Actions
Copy link
 #8

Updated by okurz 4 months ago

  • Status changed from In Progress to Feedback

https://github.com/os-autoinst/openQA/pull/5412 does not make sense, had to close it. I retriggered another failed pipeline. Either we accept this error with the occassional failure which seems to have happened more often only during vacation periods (?) or we go to another CI, e.g. GHA. I will wait for another couple of days.

Actions
Copy link
 #9

Updated by okurz 4 months ago ยท Edited

Another occurence 2024-01-03. Retried https://app.circleci.com/pipelines/github/os-autoinst/openQA/12726/workflows/2671acf7-fd6f-4d3c-b265-28a76f05969b and again all good. Considering shifting time of the nightly schedule again. In commit 39b51cfb9 from 2020 as part of #67855 I already shifted from 0000Z to 0220Z, maybe try shifting further.

https://github.com/os-autoinst/openQA/pull/5413

EDIT: Merged. Let's wait some more days to see if that is at least not worse.

Actions
Copy link
 #10

Updated by okurz 4 months ago

  • Due date deleted (2024-01-10)
  • Status changed from Feedback to Resolved

https://app.circleci.com/pipelines/github/os-autoinst/openQA?branch=master shows 7 passed runs in a go. Either problem fixed or not made worse and does not happen due to other reasons. Good enough to resolve I guess.

Actions
Copy link

Also available in: Atom PDF