Project

General

Profile

tickets #116227

mirror wiki needs updating

Added by pjessen 5 months ago. Updated 3 months ago.

Status:
Workable
Priority:
Normal
Assignee:
Category:
Mirrors
Target version:
-
Start date:
2022-09-05
Due date:
% Done:

0%

Estimated time:

Description

Outdated: https://en.opensuse.org/openSUSE:Mirror_infrastructure#Register_Your_Mirror
For instance, I think we have stopped scanning with rsync and ftp? at least I see no rsync access on my own mirror any more.

History

#1 Updated by pjessen 5 months ago

  • Category set to Mirrors
  • Private changed from Yes to No

#2 Updated by avicenzi 4 months ago

I think we should rework the entire Mirror wiki to be a bit clear on some aspects.
I've been helping mirrors in Brazil and they don't really understand what they should sync, what modules to use, and so on.

I created a bash script to help run rsync 1, this could be part of the wiki perhaps. I also have container images ready to deploy.
There was a HackWeek project from Lubos to improve the mirror modules also, not sure how far that went.

#3 Updated by pjessen 4 months ago

avicenzi wrote:

I think we should rework the entire Mirror wiki to be a bit clear on some aspects.
I've been helping mirrors in Brazil and they don't really understand what they should sync, what modules to use, and so on.

Agree, I think that would be very useful. In the past, I have generally told mirrors to use opensuse-full-really-everything and add excludes for things they don't or don't have the room for.

I created a bash script to help run rsync [1], this could be part of the wiki perhaps. I also have container images ready to deploy.
There was a HackWeek project from Lubos to improve the mirror modules also, not sure how far that went.

That was #110800 - check it out.

#4 Updated by pjessen 3 months ago

  • Assignee set to andriinikitin

Assigning to andrii, he seems to be the only one who knows what's happening.

#5 Updated by andriinikitin 3 months ago

  • Status changed from New to Workable

Considering:

  1. MirrorCache needs only mirror url for scanning.
  2. Now we have an interface for registered openSUSE users to add own mirrors. E.g. for US https://mirrorcache-us.opensuse.org/app/myserver

I suggest:

  1. We announce in Wiki that users now add new mirrors on their own on local MirrorCache instance.
  2. If we need to contact the admin - we use openSUSE name which was used to add that mirror (or public contact info from the mirror website).

Benefit: Users don't need to communicate in tickets to adjust config of their mirrors.

Regarding managing list of ip addresses which are allowed to rsync from stage.o.o - I think we should also move to some automatic solution, (e.g. limiting daily traffic per IP?). Or maybe having rsync://stage-main-repos.opensuse.org/ will be enough for everyone to sync without registration?
Otherwise we should recommend to just rsync from list of selected good mirrors instead of all sync from one central location?

If I missed something and we absolutely need to manage contact of mirror admins - maybe we can do it in the private wiki (in progress.o.o?), etc.

#6 Updated by pjessen 3 months ago

andriinikitin wrote:

Considering:

  1. MirrorCache needs only mirror url for scanning.
  2. Now we have an interface for registered openSUSE users to add own mirrors. E.g. for US https://mirrorcache-us.opensuse.org/app/myserver

I suggest:

  1. We announce in Wiki that users now add new mirrors on their own on local MirrorCache instance.
  2. If we need to contact the admin - we use openSUSE name which was used to add that mirror (or public contact info from the mirror website).

Benefit: Users don't need to communicate in tickets to adjust config of their mirrors.

Drawback: mirror admins now need to get way more involved, get a userid, operate a web interface etc etc.

Andrii, I am not sure if you have quite understood how an admin of an openSUSE mirror works. I have been hosting a public openSUSE mirror since 2017:

- wearing my admin cap, I merely donate some terabytes of disk space, some bandwidth, a machine and a few minutes of my time for the local configuration. I am not interested in how the mirror setup is managed nor I am interested in helping openSUSE do that - I simply want to do my little bit to help openSUSE, but the rest is up to the openSUSE mirror admin, i.e. you.

If I missed something and we absolutely need to manage contact of mirror admins - maybe we can do it in the private wiki (in progress.o.o?), etc.

It is really up to you, you're the mirror admin. If you never ever need to contact the mirror admin, or if you're comfortable with maintaining a contact database in our admin wiki, that's fine. Even if somewhat kludgy.

As always, the proof is in the pudding - why don't you just ask all of the current mirrors to setup openSUSE id's etc etc.

Also available in: Atom PDF