Project

General

Profile

Actions
Copy link

tickets #17568

closed

New official mirror in Switzerland

Added by per.jessen@hostsuisse.com about 7 years ago. Updated almost 7 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
maxmaher
Category:
Mirrors
Target version:
-
Start date:
Due date:
2017-03-21
% Done:

0%

Estimated time:

Description

Hi,

we'd like to run an openSUSE mirror at

https://mirror.hostsuisse.com

host mirror.hostsuisse.com

mirror.hostsuisse.com has address 185.85.248.30
mirror.hostsuisse.com has IPv6 address 2a03:7520:4c68::2017

We're currently syncing from rsync.opensuse.org.

The mirror is sponsored by "ENIDAN Technologies GmbH", main point of contact
is myself, see sender address.

We expect to run the mirror on http only.

Best regards
Per Jessen

--
ENIDAN Technologies GmbH, Bergstrasse 170, CH-8704 Herrliberg, Switzerland
info@enidan.com, phone +41 (0) 44 914 4200, fax +41 (0) 44 914 4210

Actions
Copy link
 #1

Updated by pjessen about 7 years ago

  • Due date set to 2017-03-21
  • Category set to Mirrors
  • Private changed from Yes to No
Actions
Copy link
 #2

Updated by AdaLovelace about 7 years ago

  • Assignee set to mcaj
Actions
Copy link
 #3

Updated by mcaj about 7 years ago

  • Status changed from New to Feedback

Hi Per

The HTTP looks fine but our scanner machine has problem to access it via rsync:
wiki https://en.opensuse.org/Mirror_Infrastructure :
point
read-only rsync access for our scanner -- for scanning which we perform to keep our download redirector database up-to-date. It is done from 195.135.220.0/22. (Test via rsync -v yourmirror.example.com::)

I have tested it today and its not working ATM:
rsync --list-only rsync://mirror.hostsuisse.com
rsync: failed to connect to mirror.hostsuisse.com: Connection refused (111)
rsync error: error in socket IO (code 10) at clientserver.c(122) [receiver=3.0.4]

Please enable it for our mirror scanners : IP range 195.135.220.0/22 and let me know.
Thank you
Martin

Actions
Copy link
 #4

Updated by pjessen about 7 years ago

  • Status changed from Feedback to In Progress

Hi Martin

okay, we have an rsync daemon running on rsync://mirror.hostsuisse.com now.

Actions
Copy link
 #5

Updated by mcaj about 7 years ago

  • Assignee changed from mcaj to maxmaher

Hi Max

Can you please have look on it ?

ATM I'm busy with SUSE-IT internal tasks. :(

Thank you
Martin

Actions
Copy link
 #6

Updated by maxmaher almost 7 years ago

  • Status changed from In Progress to Feedback

suse:~ # mb scan -e mirror.hostsuisse.com
Thu Jun 29 11:34:50 2017 mirror.hostsuisse.com: starting
Thu Jun 29 11:35:24 2017 mirror.hostsuisse.com: total files before scan: 0
DIE: (/usr/bin/scanner 315 main::rsync_readdir => /usr/bin/scanner 1095 (eval) => /usr/bin/scanner 1096 main::rsync_get_filelist)
Thu Jun 29 11:35:24 2017 mirror.hostsuisse.com: scanned 0 files (0/s) in 0s
Thu Jun 29 11:35:24 2017 mirror.hostsuisse.com: files to be purged: 0
Thu Jun 29 11:35:51 2017 mirror.hostsuisse.com: total files after scan: 0 (delta: 0)
Thu Jun 29 11:35:51 2017 mirror.hostsuisse.com: purged old files in 27s.
Thu Jun 29 11:35:51 2017 mirror.hostsuisse.com: done.
Thu Jun 29 11:35:51 2017 mirror.hostsuisse.com: testing status of base URL...
Thu Jun 29 11:35:51 2017 mirror.hostsuisse.com: OK. Mirror is online now.

Uhm Per, something seems to be off.

can you help me checking? It seems there are zero files there.

Actions
Copy link
 #7

Updated by pjessen almost 7 years ago

  • Status changed from Feedback to In Progress

maxmaher wrote:

suse:~ # mb scan -e mirror.hostsuisse.com
Thu Jun 29 11:34:50 2017 mirror.hostsuisse.com: starting
Thu Jun 29 11:35:24 2017 mirror.hostsuisse.com: total files before scan: 0
DIE: (/usr/bin/scanner 315 main::rsync_readdir => /usr/bin/scanner 1095 (eval) => /usr/bin/scanner 1096 main::rsync_get_filelist)
Thu Jun 29 11:35:24 2017 mirror.hostsuisse.com: scanned 0 files (0/s) in 0s
Thu Jun 29 11:35:24 2017 mirror.hostsuisse.com: files to be purged: 0
Thu Jun 29 11:35:51 2017 mirror.hostsuisse.com: total files after scan: 0 (delta: 0)
Thu Jun 29 11:35:51 2017 mirror.hostsuisse.com: purged old files in 27s.
Thu Jun 29 11:35:51 2017 mirror.hostsuisse.com: done.
Thu Jun 29 11:35:51 2017 mirror.hostsuisse.com: testing status of base URL...
Thu Jun 29 11:35:51 2017 mirror.hostsuisse.com: OK. Mirror is online now.

Uhm Per, something seems to be off.
can you help me checking? It seems there are zero files there.

Hi Max

that's weird - we have been syncing from rsync.opensuse.org sofar, but the IPv6 connection has been down. It should
not mean the mirror is completely empty though.

If I look at it (from an external IP):

per@kzinti:~> rsync -v mirror.hostsuisse.com::opensuse
receiving file list ... done
drwxr-xr-x 4096 2016/05/30 14:36:01 .
lrwxrwxrwx 10 2015/10/27 15:09:16 factory
drwxr-xr-x 16 2015/10/28 03:51:14 debug
drwxr-xr-x 4096 2016/06/14 11:38:03 distribution
drwxr-xr-x 56 2016/12/28 16:57:51 ports
drwxr-xr-x 16 2010/11/05 15:55:13 projects
drwxr-xr-x 16 2015/10/27 15:11:21 source
drwxrwxr-x 16 2015/10/28 03:34:28 tumbleweed
drwxr-xr-x 4096 2017/06/26 08:29:01 update

I can see your scanner accesses in the log though:

2017/06/29 11:30:04 [22134] connect from nat.nue.novell.com (195.135.221.2)
2017/06/29 11:30:04 [22134] module-list request from nat.nue.novell.com (195.135.221.2)
2017/06/29 11:33:48 [22320] connect from nat.nue.novell.com (195.135.221.2)
2017/06/29 11:33:48 [22320] module-list request from nat.nue.novell.com (195.135.221.2)
2017/06/29 11:35:24 [22441] connect from nat.nue.novell.com (195.135.221.2)
2017/06/29 11:35:24 [22441] module-list request from nat.nue.novell.com (195.135.221.2)
2017/06/29 11:44:07 [22870] connect from charybdis-ext.suse.de (195.135.221.2)
2017/06/29 11:44:07 [22870] unknown module 'tumbleweed' tried from charybdis-ext.suse.de (195.135.221.2)

Actions
Copy link
 #8

Updated by maxmaher almost 7 years ago

If i call it from my workstation its also perfectly fine.

i'll try to scan it again.

Actions
Copy link
 #9

Updated by maxmaher almost 7 years ago

Ah! there was a typo. but now i got more interessting information

mirror.hostsuisse.com: info: rsync: opendir "/debug/distribution/12.3" (in opensuse) failed: Permission denied (13)

mirror.hostsuisse.com: tag=8 rsync: opendir "/debug/distribution/13.1/repo/oss/suse/i686" (in opensuse) failed: Permission denied (13)

mirror.hostsuisse.com: info: rsync: opendir "/debug/distribution/13.1/repo/oss/suse/i686" (in opensuse) failed: Permission denied (13)

mirror.hostsuisse.com: tag=8 rsync: opendir "/debug/distribution/13.1/repo/oss/suse/noarch" (in opensuse) failed: Permission denied (13)

mirror.hostsuisse.com: info: rsync: opendir "/debug/distribution/13.1/repo/oss/suse/noarch" (in opensuse) failed: Permission denied (13)

mirror.hostsuisse.com: tag=8 rsync: opendir "/debug/distribution/13.1/repo/oss/suse/repodata" (in opensuse) failed: Permission denied (13)

mirror.hostsuisse.com: info: rsync: opendir "/debug/distribution/13.1/repo/oss/suse/repodata" (in opensuse) failed: Permission denied (13)

mirror.hostsuisse.com: tag=8 rsync: opendir "/debug/distribution/13.1/repo/oss/suse/setup" (in opensuse) failed: Permission denied (13)

mirror.hostsuisse.com: info: rsync: opendir "/debug/distribution/13.1/repo/oss/suse/setup" (in opensuse) failed: Permission denied (13)

mirror.hostsuisse.com: tag=8 rsync: opendir "/debug/distribution/13.2" (in opensuse) failed: Permission denied (13)

mirror.hostsuisse.com: info: rsync: opendir "/debug/distribution/13.2" (in opensuse) failed: Permission denied (13)

mirror.hostsuisse.com: tag=8 rsync: opendir "/debug/update" (in opensuse) failed: Permission denied (13)

mirror.hostsuisse.com: info: rsync: opendir "/debug/update" (in opensuse) failed: Permission denied (13)

Thu Jun 29 14:29:13 2017 mirror.hostsuisse.com: Error 404 occured
mirror.hostsuisse.com: warning: distribution/12.1/iso/openSUSE-12.1-DVD-i586.iso cannot be delivered via HTTP! Skipping
Thu Jun 29 14:29:13 2017 mirror.hostsuisse.com: Error 404 occured
mirror.hostsuisse.com: warning: distribution/12.1/iso/openSUSE-12.1-DVD-x86_64.iso cannot be delivered via HTTP! Skipping

Actions
Copy link
 #10

Updated by maxmaher almost 7 years ago

Thu Jun 29 14:34:25 2017 mirror.hostsuisse.com: scanned 137645 files (438/s) in 314s
Thu Jun 29 14:34:25 2017 mirror.hostsuisse.com: files to be purged: 0
Thu Jun 29 14:35:03 2017 mirror.hostsuisse.com: total files after scan: 137645 (delta: 137645)
Thu Jun 29 14:35:03 2017 mirror.hostsuisse.com: purged old files in 38s.
Thu Jun 29 14:35:03 2017 mirror.hostsuisse.com: done.
Thu Jun 29 14:35:03 2017 mirror.hostsuisse.com: testing status of base URL...
Thu Jun 29 14:35:03 2017 mirror.hostsuisse.com: OK. Mirror is online now.

So this is the result. Is it ok this way? even with the skipped files and permission denied files?

Actions
Copy link
 #11

Updated by pjessen almost 7 years ago

The permission problems are a little odd, those directories didn't have the correct permissions. Weird, but I've fixed them.
The two 404s were because the scanner didn't look in the correct directory "opensuse/" ?

The mirror address is http://mirror.hostsuisse.com/opensuse/

Actions
Copy link
 #12

Updated by maxmaher almost 7 years ago

changing baseurl from 'http://mirror.hostsuisse.com' to 'http://mirror.hostsuisse.com/opensuse'

this makes a lot of sense.

ok, i think we can resolve the ticket then?

Actions
Copy link
 #13

Updated by pjessen almost 7 years ago

maxmaher wrote:

changing baseurl from 'http://mirror.hostsuisse.com' to 'http://mirror.hostsuisse.com/opensuse'

this makes a lot of sense.

ok, i think we can resolve the ticket then?

Seems we still need access permissions on stage.opensuse.org ?

@ERROR: access denied to opensuse-full-really-everything from prague.enidan.com (2a03:7520:4c68::2017)
rsync error: error starting client-server protocol (code 5) at main.c(1650) [Receiver=3.1.1]

Actions
Copy link
 #14

Updated by maxmaher almost 7 years ago

uhm (2a03:7520:4c68::2017) is whitelisted, 185.85.248.30 also

but if i try to resolve

host prague.enidan.com.
prague.enidan.com has address 185.85.248.17
prague.enidan.com has IPv6 address 2a03:7520:4c68::2017

should i whitelist the .17 ipv4? instead of the .30

Actions
Copy link
 #15

Updated by pjessen almost 7 years ago

maxmaher wrote:

uhm (2a03:7520:4c68::2017) is whitelisted, 185.85.248.30 also

but if i try to resolve

host prague.enidan.com.
prague.enidan.com has address 185.85.248.17
prague.enidan.com has IPv6 address 2a03:7520:4c68::2017

should i whitelist the .17 ipv4? instead of the .30

No, the .30 is good, we default to IPv6 anyway, but I'll make sure we don't use the .17. With IPv6, I still get permission denied -

@ERROR: access denied to opensuse-full-really-everything from prague.enidan.com (2a03:7520:4c68::2017)

Actions
Copy link
 #16

Updated by pjessen almost 7 years ago

Max, we'd like to add 2a03:7520:4c68::2030 to the whitelist too, thanks.

Actions
Copy link
 #17

Updated by maxmaher almost 7 years ago

i'll added the .30, is it better now?

Actions
Copy link
 #18

Updated by pjessen almost 7 years ago

It doesn't seem to have changed much:

@ERROR: access denied to opensuse-full-really-everything from mirror.hostsuisse.com (2a03:7520:4c68::2030)
@ERROR: access denied to opensuse-full-really-everything from mirror.hostsuisse.com (185.85.248.30)

Also, on http:mirror.o.o, the mirror is listed as 'Per Jessen', I'd prefer that just to read 'Hostsuisse (ENIDAN Technologies GmbH)'.

Actions
Copy link
 #19

Updated by maxmaher almost 7 years ago

Ok changed to 'Hostsuisse (ENIDAN Technologies GmbH)'.

a03:7520:4c68::2030
2a03:7520:4c68::2017

both are whitelisted

185.85.248.30

is also whitelisted...

i add the hostname to the list.

but it should work, in all other cases it does

Actions
Copy link
 #20

Updated by pjessen almost 7 years ago

maxmaher wrote:

Ok changed to 'Hostsuisse (ENIDAN Technologies GmbH)'.

Great, thanks.

a03:7520:4c68::2030
2a03:7520:4c68::2017

both are whitelisted

185.85.248.30

is also whitelisted...

i add the hostname to the list.

but it should work, in all other cases it does

Weird, I'm still getting the same error message, on ipv4 and ipv6. Do your logs not show anything?

Actions
Copy link
 #21

Updated by maxmaher almost 7 years ago

i think i found an error in the config file.

what about now?

Actions
Copy link
 #22

Updated by pjessen almost 7 years ago

maxmaher wrote:

i think i found an error in the config file.

what about now?

Much better!, works on both addresses. Thanks!

Actions
Copy link
 #23

Updated by maxmaher almost 7 years ago

  • Status changed from In Progress to Resolved
Actions
Copy link

Also available in: Atom PDF