QA » openQA Project » openQA Tests

Can reproduce the issue (rather simply) outside of openQA:

wget http://download.opensuse.org/tumbleweed/repo/oss/CHECKSUMS
sha256sum CHECKSUMS
ed37e49daebbc84dceaec335e1115e8f5d6f8c110be4453aec199fc5a1fee87b CHECKSUMS

compared to https://download.opensuse.org/tumbleweed/repo/oss/CHECKSUMS.mirrorlist, where the sha256sum is listed as f04e0512011b29f04237840cda7ae6191fcd9f2dd25a4f7dfbd9c9d9ae1a1723

So to me this looks like a fallout from the switch from MirrorBrain to MirrorCache (apache for mirrorbrain had the /boot directory excluded and always served from the main servers IIRC, as the files do not change name, but can change content at any time)

dimstar wrote:

ed37e49daebbc84dceaec335e1115e8f5d6f8c110be4453aec199fc5a1fee87b CHECKSUMS

compared to https://download.opensuse.org/tumbleweed/repo/oss/CHECKSUMS.mirrorlist, where the sha256sum is listed as f04e0512011b29f04237840cda7ae6191fcd9f2dd25a4f7dfbd9c9d9ae1a1723

The checksum in .mirrorlist is not related to the problem, the real change is that download.opensuse.org started to redirecting requests for CHECKSUMS to downloadcontent.opensuse.org (as it does for all "big files" to be able to cope with load , delegating all big downloads).

curl -IsL https://download.opensuse.org/tumbleweed/repo/oss/CHECKSUMS
HTTP/2 302 
date: Wed, 25 May 2022 07:41:53 GMT
location: https://downloadcontent.opensuse.org/tumbleweed/repo/oss/CHECKSUMS
server: Apache
content-length: 0

HTTP/2 200 
server: nginx
date: Wed, 25 May 2022 07:41:53 GMT
content-type: application/octet-stream
content-length: 37230
last-modified: Tue, 24 May 2022 03:12:24 GMT
etag: "628c4d18-916e"
strict-transport-security: max-age=31536000
accept-ranges: bytes

So, to me the issue here is that the installer doesn't follow redirects for CHECKSUMS file and shows misleading error message instead. Is there chance that you confirm it and forward to the corresponding team?

Meanwhile I configured Apache on download.o.o to avoid such redirects and restarted job https://openqa.opensuse.org/tests/2372957#

So reassigning the ticket back to you , so you decide whether it should be fixed in installer (otherwise it needs some workarounds on download.o.o and may break again later).

https://openqa.opensuse.org/tests/2373822#step/welcome/5

the regression from the mirror side is still there - the tests fail with various files from the boot/ directory (they don't have versions in the file names)

Unlike the RPMs, where we have rebuild counters, the pure presence of the file on the mirror is no indication that the mirror is up-to-date.

(Somehow, I've missed the last update, so was looking only today.)
So it looks that I didn't identify the root cause properly. Now I think the reason of failures in that download.o.o started using mirrors for files in boot/** folder, which wasn't intentional.
It was fix in the morning, now no mirrors are used for files inside boot/** , so the install should work.
I cannot confirm from openQA, because it has some other problems at the moment and jobs failed to start up.

I close it as resolved, but let me know if anything still needs to be addressed.

Regards,
Andrii Nikitin