tickets #40739
closedPlease add a way to remove outdated mirrors from mirrors.opensuse.org
0%
Description
Hello,
Several mirrors listed in mirrors.opensuse.org are heavily outdated
For example (as of today)
http://download.opensuse.org/update/leap/42.3/oss/repodata/ (synced 7th
of Sept)
but
https://mirrors.edge.kernel.org/opensuse/update/leap/42.3/oss/repodata/
(synced 5th of Sept)
http://mirrors.rit.edu/opensuse/update/leap/42.3/oss/repodata/ (synced
24th of August)
http://mirror.optus.net/opensuse/update/leap/42.3/oss/repodata/ (synced
7 Dec 2017!)
Other mirrors in mirrors.opensuse.org are completely dead
eg http://mirrors.nl.eu.kernel.org/opensuse/
I could go on and on but it would be nice if there was an automated way
to notify you about broken, outdated and unreachable mirrors in order to
ensure that mirrorbrain is not redirecting users to /dev/null
Thank you
--
markos
SUSE LINUX GmbH | GF: Felix Imendörffer, Jane Smithard, Graham Norton
HRB 21284 (AG Nürnberg) Maxfeldstr. 5, D-90409, Nürnberg
Updated by pjessen over 5 years ago
- Category set to Mirrors
- Status changed from New to Rejected
- Private changed from Yes to No
mirrorbrain does regular scanning of all mirrors and should be aware of these. Users are not directed to out-of-date mirrors. If you believe mirrorbrain is not aware, that is a real problem.
I think automatically removing mirrors is a bad idea - while some have intentionally stopped mirroring, e.g. ntua.gr and switch.ch. others may have stopped by accident, script failure, ip change etc.
What I do is try to contact operators of apparently dead mirrors and see if they can be re-activated. If not, we can tidy up the database,
which is I do every so often.
I have opened separate tickets for tidying up -
https://progress.opensuse.org/issues/40745 - mirror.optus.net
https://progress.opensuse.org/issues/40748 - mirrors.nl.eu.kernel.org
If you see others, please open tickets.
Updated by markoschandras over 5 years ago
I am not sure if mirrorbrain is having issues or not but as I explained on first post, you see there are some outdated or dead mirrors there. Maybe it's just the past that needs updating? I am not sure if mirrorbrain would try to redirect you to any of these.
But what about rsync.opensuse.org though? This box is down for quite a while so we are forced to pick another rsync mirror by hand because there is no mirrorbrain for rsync is there? So in cases like this, it's a shot in the dark whether an rsync mirror we pick is updated or not. If there is mirrobrain for rsync.o.o how can we use it?
Updated by pjessen over 5 years ago
markoschandras wrote:
I am not sure if mirrorbrain is having issues or not but as I explained on first post, you see there are some outdated or dead mirrors there.
Maybe it's just the past that needs updating? I am not sure if mirrorbrain would try to redirect you to any of these.
No, mirrorbrain wouldn't - that would invalidate the whole design.
Keeping an eye on out-of-date mirrors would - currently - be a manual task. I am not aware of any MB hook that might enable a direct alert to someone.
It would be interesting to investigate though.
But what about rsync.opensuse.org though? This box is down for quite a while so we are forced to pick another rsync mirror by hand because
there is no mirrorbrain for rsync is there?
No, there is no MB for rsync, although the mirrors are listed indicating if they support rsync or not.
rsync.o.o is a separate machine, not part of the mirroring system as such. It's been down due to hardware failure. I
thought it was fixed though. I'll ask thomic tomorrow.
So in cases like this, it's a shot in the dark whether an rsync mirror we pick is updated or not. If there is mirrobrain for rsync.o.o how can we use it?
At the moment it doesn't work - I can only advise you to use "known" good rsync sites, ftp.gwdg.de for instance.
Updated by markoschandras over 5 years ago
pjessen wrote:
So in cases like this, it's a shot in the dark whether an rsync mirror we pick is updated or not. If there is mirrobrain for rsync.o.o how can we use it?
At the moment it doesn't work - I can only advise you to use "known" good rsync sites, ftp.gwdg.de for instance.
Unfortunately even ftp.gwgd.de is not so good either
http://download.opensuse.org/repositories/Cloud:/OpenStack:/Master/openSUSE_Leap_42.3/noarch/ (last sync 11 Sept ~5am GMT)
https://ftp.gwdg.de/pub/opensuse/repositories/Cloud%3A/OpenStack%3A/Master/openSUSE_Leap_42.3/noarch/ (last sync 08 Sept). So either gwdg.de broke or it sync less often than usual
Anyway, as it seems, there is no good solution for rsync right now so we will keep picking random mirrors :/ But at least it would be beneficial for us if the webpage listed only the mirrors that are known to work and be updated (maybe autogenerated based on mirror metrics etc)
Updated by markoschandras over 5 years ago
markoschandras wrote:
pjessen wrote:
So in cases like this, it's a shot in the dark whether an rsync mirror we pick is updated or not. If there is mirrobrain for rsync.o.o how can we use it?
At the moment it doesn't work - I can only advise you to use "known" good rsync sites, ftp.gwdg.de for instance.
Unfortunately even ftp.gwgd.de is not so good either
http://download.opensuse.org/repositories/Cloud:/OpenStack:/Master/openSUSE_Leap_42.3/noarch/ (last sync 11 Sept ~5am GMT)
https://ftp.gwdg.de/pub/opensuse/repositories/Cloud%3A/OpenStack%3A/Master/openSUSE_Leap_42.3/noarch/ (last sync 08 Sept). So either gwdg.de broke or it sync less often than usualAnyway, as it seems, there is no good solution for rsync right now so we will keep picking random mirrors :/ But at least it would be beneficial for us if the webpage listed only the mirrors that are known to work and be updated (maybe autogenerated based on mirror metrics etc)
Do you happen to have any information about https://ftp.gwdg.de/ ? Some OBS repositories do not seem to have been synced for a couple of days now. It takes us a lot of effort to switch mirrors in OpenStack so I though to ask here first before we go through that process again.