Project

General

Profile

Actions

tickets #48659

closed

Only 1 Mirror in U.S. - Move Content to CDN

Added by Todd.Kap-Kopp@microfocus.com about 5 years ago. Updated almost 4 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Mirrors
Target version:
-
Start date:
Due date:
% Done:

100%

Estimated time:

Description

I have been asked by Christian Deckelmann to forward this to the above two email addresses. Thanks.
Hi,

I noticed during the regular upgrade process of an opensuse installation, some packages are in fact delivered from provo-mirror.opensuse.org.
When checking on which mirrors a file is, provo-mirror.opensuse.org is the only one in the US region:
https://download.opensuse.org/repositories/Virtualization/openSUSE_Factory/noarch/qemu-ovmf-x86_64-2019+git1550452308.c417c1b33d06-95.3.noarch.rpm.mirrorlist
Current output of that is this:
[cid:part1.38C28E51.608E070F@microfocus.com]

Checking the traffic which is sent from Provo to the internet over the last 24 hours revealed that provo-mirror.opensuse.org has done 35.9% of all outgoing traffic.
To set this into perspective, here are the top 5 talkers:
[cid:part2.B3429778.D79633EB@microfocus.com]

Running the same over the last week shows that provo-mirror has caused 21.9% of all outgoing traffic.
[cid:part3.217626EC.4605D15A@microfocus.com]

I don´t think it is good if only provo-mirror has content for a specific region. It shouldn´t be used as the single mirror.
US based opensuse clients will fetch certain content from Provo only as there is no other mirror known to the CDN system running on download.opensuse.org.

I briefly told the opensuse admins about that and they asked if we can provide this as a ticket to them (suse-it@suse.desuse-it@suse.de andadmin@opensuse.orgadmin@opensuse.org).
They would then look into moving this traffic away to another colo in the US.

Christian

--
Christian Deckelmann
IT Network Architect
Micro Focus
christian.deckelmann@microfocus.comchristian.deckelmann@microfocus.com


Files

image002.png (25.5 KB) image002.png Todd.Kap-Kopp@microfocus.com, 2019-03-04 19:11
image001.png (93.4 KB) image001.png Todd.Kap-Kopp@microfocus.com, 2019-03-04 19:11
image003.png (25.4 KB) image003.png Todd.Kap-Kopp@microfocus.com, 2019-03-04 19:11
Actions #1

Updated by pjessen about 5 years ago

  • Private changed from Yes to No

Todd.Kap-Kopp@microfocus.com wrote:

I noticed during the regular upgrade process of an opensuse installation, some packages are in fact delivered from provo-mirror.opensuse.org.
When checking on which mirrors a file is, provo-mirror.opensuse.org is the only one in the US region:
https://download.opensuse.org/repositories/Virtualization/openSUSE_Factory/noarch/qemu-ovmf-x86_64-2019+git1550452308.c417c1b33d06-95.3.noarch.rpm.mirrorlist

Yes, that is not untypical for "repositories/". The rate of change is very high, I expect many mirrors opt out for that reason.

I don´t think it is good if only provo-mirror has content for a specific region. It shouldn´t be used as the single mirror.

Agree, but that is only for "repositories/", ie. for OBS. For the regular distribution, we have a number of US mirrors.

US based opensuse clients will fetch certain content from Provo only as there is no other mirror known to the CDN system running on download.opensuse.org.

Correct, anyone who wants OBS stuff will be served by the provo mirror.

Actions #2

Updated by Todd.Kap-Kopp@microfocus.com about 5 years ago

I will run this by Christian and see if he has any further input.

Thank you!

Actions #3

Updated by okurz almost 5 years ago

  • Category set to Mirrors
Actions #4

Updated by bmwiedemann almost 5 years ago

curl http://download.opensuse.org/distribution/leap/15.1/repo/oss/INDEX.gz.mirrorlist|grep this.country

shows 13 US mirrors and for /tumbleweed, it shows 9

so this is probably mostly about /repositories

e.g.
https://download.opensuse.org/repositories/Virtualization/openSUSE_Factory/noarch/qemu-ovmf-x86_64-2019+git1552059899.89910a39dcfd-103.5.noarch.rpm.mirrorlist
only has 1 DE mirror, 1 more in EU and the provo-mirror in US
and that file is already 8 days old.

Actions #5

Updated by pjessen almost 5 years ago

bmwiedemann wrote:

https://download.opensuse.org/repositories/Virtualization/openSUSE_Factory/noarch/qemu-ovmf-x86_64-2019+git1552059899.89910a39dcfd-103.5.noarch.rpm.mirrorlist
only has 1 DE mirror, 1 more in EU and the provo-mirror in US
and that file is already 8 days old.

I don't know why that one is only available like that - this one:

http://download.opensuse.org/repositories/Virtualization/openSUSE_Leap_15.1/x86_64/aqemu-0.9.2-lp151.1.1.x86_64.rpm.mirrorlist

from Switzerland, it has no local mirrors, but 6 EU mirrors and 3 in the rest of the world.

Actions #6

Updated by pjessen about 4 years ago

  • Status changed from New to Feedback

The vast majority of mirrors do not carry repositories/, most likely due to

1) size,
2) rate of change and
3) limited need.

I'm tempted to close this, unless there is something else we ought to do?

Actions #7

Updated by Todd.Kap-Kopp@microfocus.com about 4 years ago

Please go ahead and close it.

Thanks!

Actions #8

Updated by pjessen almost 4 years ago

  • Status changed from Feedback to Resolved
  • Assignee set to pjessen
  • % Done changed from 0 to 100
Actions

Also available in: Atom PDF