Project

General

Profile

action #111551

[opensuse] Failure to create TW image (published)

Added by dimstar about 1 month ago. Updated 12 days ago.

Status:
Feedback
Priority:
Normal
Assignee:
Category:
Bugs in existing tests
Target version:
-
Start date:
2022-05-24
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

The test is supposed to install tumbleweed, as currently published, in order to then dup to the new version.
Currently, the tests fail to install the published snapshot - which smells like a mirror infra issue

openQA test in scenario opensuse-Tumbleweed-NET-x86_64-create_hdd_tumbleweed_kde@64bit fails in
welcome

Test suite description

Maintainer: dimstar, fvogt The idea of the test suite is to create an installation from the last published snapshot so that we can do the upgrade from last_published to current snapshot_under_test as a test

Reproducible

Fails since (at least) Build 20220523

Expected result

Last good: 20220522 (or more recent)

Further details

Always latest result in this scenario: latest

History

#1 Updated by dimstar about 1 month ago

  • Assignee set to andriinikitin

Can reproduce the issue (rather simply) outside of openQA:

wget http://download.opensuse.org/tumbleweed/repo/oss/CHECKSUMS
sha256sum CHECKSUMS
ed37e49daebbc84dceaec335e1115e8f5d6f8c110be4453aec199fc5a1fee87b CHECKSUMS

compared to https://download.opensuse.org/tumbleweed/repo/oss/CHECKSUMS.mirrorlist, where the sha256sum is listed as f04e0512011b29f04237840cda7ae6191fcd9f2dd25a4f7dfbd9c9d9ae1a1723

So to me this looks like a fallout from the switch from MirrorBrain to MirrorCache (apache for mirrorbrain had the /boot directory excluded and always served from the main servers IIRC, as the files do not change name, but can change content at any time)

#2 Updated by andriinikitin about 1 month ago

  • Assignee changed from andriinikitin to dimstar

dimstar wrote:

ed37e49daebbc84dceaec335e1115e8f5d6f8c110be4453aec199fc5a1fee87b CHECKSUMS

compared to https://download.opensuse.org/tumbleweed/repo/oss/CHECKSUMS.mirrorlist, where the sha256sum is listed as f04e0512011b29f04237840cda7ae6191fcd9f2dd25a4f7dfbd9c9d9ae1a1723

The checksum in .mirrorlist is not related to the problem, the real change is that download.opensuse.org started to redirecting requests for CHECKSUMS to downloadcontent.opensuse.org (as it does for all "big files" to be able to cope with load , delegating all big downloads).

curl -IsL https://download.opensuse.org/tumbleweed/repo/oss/CHECKSUMS
HTTP/2 302 
date: Wed, 25 May 2022 07:41:53 GMT
location: https://downloadcontent.opensuse.org/tumbleweed/repo/oss/CHECKSUMS
server: Apache
content-length: 0

HTTP/2 200 
server: nginx
date: Wed, 25 May 2022 07:41:53 GMT
content-type: application/octet-stream
content-length: 37230
last-modified: Tue, 24 May 2022 03:12:24 GMT
etag: "628c4d18-916e"
strict-transport-security: max-age=31536000
accept-ranges: bytes

So, to me the issue here is that the installer doesn't follow redirects for CHECKSUMS file and shows misleading error message instead. Is there chance that you confirm it and forward to the corresponding team?

Meanwhile I configured Apache on download.o.o to avoid such redirects and restarted job https://openqa.opensuse.org/tests/2372957#

So reassigning the ticket back to you , so you decide whether it should be fixed in installer (otherwise it needs some workarounds on download.o.o and may break again later).

#3 Updated by dimstar about 1 month ago

  • Assignee changed from dimstar to andriinikitin

https://openqa.opensuse.org/tests/2373822#step/welcome/5

the regression from the mirror side is still there - the tests fail with various files from the boot/ directory (they don't have versions in the file names)

Unlike the RPMs, where we have rebuild counters, the pure presence of the file on the mirror is no indication that the mirror is up-to-date.

#4 Updated by andriinikitin about 1 month ago

  • Status changed from New to Feedback

(Somehow, I've missed the last update, so was looking only today.)
So it looks that I didn't identify the root cause properly. Now I think the reason of failures in that download.o.o started using mirrors for files in boot/** folder, which wasn't intentional.
It was fix in the morning, now no mirrors are used for files inside boot/** , so the install should work.
I cannot confirm from openQA, because it has some other problems at the moment and jobs failed to start up.

#5 Updated by maritawerner 12 days ago

  • Subject changed from Failure to create TW image (published) to [opensuse] Failure to create TW image (published)

Also available in: Atom PDF