Project

General

Profile

Actions
Copy link

tickets #27793

closed

tickets #27796: Re: OpenStack openSUSE mirror hits 50 connection limit on rsync.o.o

OpenStack openSUSE mirror hits 50 connection limit on rsync.o.o

Added by mchandras@suse.de over 6 years ago. Updated over 6 years ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Category:
Mirrors
Target version:
-
Start date:
Due date:
% Done:

100%

Estimated time:

Description

Hello,

OpenStack operates a set of (public but only for the OpenStack CI
purposes) openSUSE mirrors which are used by the OpenStack CI jobs to
fetch openSUSE packages instead of hitting downloads.opensuse.org every
single time. However, for the past 10 days the OpenStack mirrors is
hitting the following issue

  • k5start -t -f /etc/opensuse.keytab service/opensuse-mirror -- timeout -k 2m 30m rsync -rlptDvz --delete --delete-excluded --exclude=src/ --exclude=nosrc/ rsync://rsync.opensuse.org/opensuse-full/opensuse/update/leap/42.3/ /afs/.openstack.org/mirror/opensuse/update/leap/42.3/

This is rsync.opensuse.org, public rsync server of openSUSE.org,
limited to 50 connections.

If you run a public mirror, please get in contact so we can give you
access to the stage rsync server.
You'll find conditions for access and further information at

http://en.opensuse.org/Mirror_Infrastructure

Would it be possible to allow the OpenStack node to access the
stage.opensuse.org server instead? The OpenStack infra people use a
single machine to sync with rsync.opensuse.org and then the mirrors are
populated from that machine. The DNS for that node is
'mirror-update.openstack.org'. Also, I was asked if the
rsync.opensuse.org is possibly stuck and not terminating connections
properly and maybe that's why we are hitting the 50 connections limit
every single time.

Please let me know what you think.

--
markos

SUSE LINUX GmbH | GF: Felix Imendörffer, Jane Smithard, Graham Norton
HRB 21284 (AG Nürnberg) Maxfeldstr. 5, D-90409, Nürnberg

Actions
Copy link
 #1

Updated by pjessen over 6 years ago

  • Parent task set to #27796
  • Private changed from Yes to No
Actions
Copy link
 #2

Updated by Anonymous over 6 years ago

  • Category set to Mirrors
  • Assignee set to Anonymous
  • % Done changed from 0 to 100

mchandras@suse.de wrote:

Would it be possible to allow the OpenStack node to access the
stage.opensuse.org server instead? The OpenStack infra people use a
single machine to sync with rsync.opensuse.org and then the mirrors are
populated from that machine. The DNS for that node is
'mirror-update.openstack.org'.

I added the following entries now to the "allowed hosts" entry on stage.opensuse.org:

          mirror-update.openstack.org 
          23.253.92.251 
          2001:4800:7815:105:be76:4eff:fe06:5a40

This should give the admins access to all stage.opensuse.org:: rsync modules (the same as we provide on rsync.opensuse.org).

Also, I was asked if the
rsync.opensuse.org is possibly stuck and not terminating connections
properly and maybe that's why we are hitting the 50 connections limit
every single time.

The network of the rsync.opensuse.org machine is currently a bit unreliable - we are working on a permanent solution for this.

Regards,
Lars

Actions
Copy link
 #3

Updated by Anonymous over 6 years ago

  • Status changed from New to Closed
Actions
Copy link

Also available in: Atom PDF