tickets #48590
closedPush for the Lysator ACS mirror
100%
Description
Hello!
Lysator ACS provides an FTP mirror that mirrors the
opensuse-full-really-everything-including-repositories module. The
performance is bad so we would like to request push of that module
instead, if possible.
Push server: ftp.lysator.liu.se
rsync module: opensuse-push
want to mirror: opensuse-full-really-everything-including-repositories
public url: same as before
We have whitelisted stage.opensuse.org on the module and no login should
be required.
We have never done push before so if you could tell us whether this
configuration looks sane, that would be appreciated:
[opensuse-push]
path = /var/ftp/./pub/opensuse
comment = OpenSUSE push access
uid = ftpowner
gid = ftpowner
read only = false
list = false
hosts allow = stage.opensuse.org
ftpowner is not the same user as the ones used to serve files via the
different services to allow for permissions denying access.
Cordially,
Andreas Kempe
System administrator, Lysator
Updated by cboltz about 5 years ago
- Category set to Mirrors
- Assignee set to pjessen
Updated by pjessen about 5 years ago
- Status changed from New to In Progress
- Private changed from Yes to No
Hi Andreas
to be honest, I am also unfamiliar with the push setup. I can't really say if your rsync config looks sane or not.
I'm happy to try to set up push for you, but if it is about network performance, will that change much?
Updated by kempe@lysator.liu.se about 5 years ago
On 3/9/19 9:48 AM, admin@opensuse.org wrote:
Hi Andreas
to be honest, I am also unfamiliar with the push setup. I can't really say if your rsync config looks sane or not.
I'm happy to try to set up push for you, but if it is about network performance, will that change much?
One big issue has been the long enumeration time against your server.
When syncing everything from stage.opensuse.org it's taken 6+ hours just
to receive the file list. If we had push, that time would disappear. It
is, of course possible, that you can't push quickly enough, but we
thought it worth a try. We do have 1 Gbit/s in so it should be good on
our end, bandwidth-wise.
Updated by pjessen about 5 years ago
On my employer's mirror (http://mirror.hostsuisse.com) it is also clamped to 1Gbit/s, but we don't mirror repositories/ . The rate of change is much too high. I'll look at getting you set up for push.
Updated by pjessen about 5 years ago
- % Done changed from 0 to 50
Hi Andreas
Sorry about taking so long - I have now created the push setup for ftp.lysator.liu.se. I have also forced it to use IPv6, let me know if that's okay for you.
Updated by kempe@lysator.liu.se about 5 years ago
On 2019-03-30 11:16, admin@opensuse.org wrote:
[openSUSE Tracker]
Issue #48590 has been updated by pjessen.% Done changed from 0 to 50
Hi Andreas
Sorry about taking so long -
No worries, I'm in no rush. Thank you for taking the time!
I have now created the push setup for ftp.lysator.liu.se. I have also forced it to use IPv6, let me know if that's okay for you.
IPv6 is fine. It does however seem as if you're currently pushing the
contents of repositories into our opensuse top directory. I would assume
that this is a mistake?
Updated by kempe@lysator.liu.se about 5 years ago
On 2019-03-30 18:46, Andreas Kempe wrote:
On 2019-03-30 11:16, admin@opensuse.org wrote:
[openSUSE Tracker]
Issue #48590 has been updated by pjessen.% Done changed from 0 to 50
Hi Andreas
Sorry about taking so long -
No worries, I'm in no rush. Thank you for taking the time!
I have now created the push setup for ftp.lysator.liu.se. I have also forced it to use IPv6, let me know if that's okay for you.
IPv6 is fine. It does however seem as if you're currently pushing the
contents of repositories into our opensuse top directory. I would assume
that this is a mistake?
For the time being, I've changed the path of our opensuse-push module to
point to the repositories directory. If you don't intend to push
anything other than repositories, there is no need for further action.
Best regards,
Andreas Kempe
Updated by pjessen about 5 years ago
- Status changed from In Progress to Resolved
- % Done changed from 50 to 100
kempe@lysator.liu.se wrote:
For the time being, I've changed the path of our opensuse-push module to
point to the repositories directory. If you don't intend to push
anything other than repositories, there is no need for further action.
Yes, the push is only for repositories/, due to the high rate of change. We are automatically notified by the build-service when something is ready, then we push it out to the mirrors. For the rest, you just pull with rsync at regular intervals.