Project

General

Profile

Actions

tickets #99492

closed

Permission denied while mirroring openSuse

Added by giuseppe.glorioso@garr.it over 2 years ago. Updated over 2 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Mirrors
Target version:
-
Start date:
2021-09-29
Due date:
% Done:

100%

Estimated time:

Description

Hello,
I'm contacting from Consortium GARR, and we actually mirror openSuse on
GARR Mirror service (http://opensuse.mirror.garr.it). We are contacting
you because we are having some trouble mirroring openSuse files.
Specifically rsync fails with the following errors:

rsync: opendir "/opensuse/history/20210831/tumbleweed/repo/oss/i686"
(in opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210831/tumbleweed/repo/oss/media.1" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210831/tumbleweed/repo/oss/noarch" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210831/tumbleweed/repo/oss/repodata" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210831/tumbleweed/repo/oss/x86_64" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210901" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210902" (in opensuse-full-with-factory) failed:
Permission denied (13) rsync: opendir "/opensuse/history/20210904" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210906" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210907" (in opensuse-full-with-factory) failed:
Permission denied (13) rsync: opendir "/opensuse/history/20210908" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210910" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210912" (in opensuse-full-with-factory) failed:
Permission denied (13) rsync: opendir "/opensuse/history/20210913" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210914" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210915" (in opensuse-full-with-factory) failed:
Permission denied (13) rsync: opendir "/opensuse/history/20210916" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210920" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210921" (in opensuse-full-with-factory) failed:
Permission denied (13)

Our systems seems to be working fine, is this a problem on your side?

Thanks you

Best regards

Giuseppe Glorioso
System Support | Consortium GARR
M: +39 366 935 6504
GPG: 4DEA56D6A10EC348 (giuseppe.glorioso@garr.it)

Actions #1

Updated by pjessen over 2 years ago

  • Subject changed from Permission denied while mirrorig openSuse to Permission denied while mirroring openSuse
  • Category set to Mirrors
  • Assignee set to pjessen
  • Private changed from Yes to No
Actions #2

Updated by pjessen over 2 years ago

  • Status changed from New to Feedback

Looking in our rsync logs, I cannot see any access from 'rm.mirror.garr.it', in all of September ? I also checked the IP addresses:

# host rm.mirror.garr.it 
rm.mirror.garr.it is an alias for proxy.mirror.garr.it.
proxy.mirror.garr.it has address 90.147.160.73
proxy.mirror.garr.it has address 90.147.160.70
proxy.mirror.garr.it has address 90.147.160.72
proxy.mirror.garr.it has IPv6 address 2001:760:ffff:b6:4:100:0:70
proxy.mirror.garr.it has IPv6 address 2001:760:ffff:b6:4:100:0:73
proxy.mirror.garr.it has IPv6 address 2001:760:ffff:b6:4:100:0:72

Which server are you rsync'ing from ?

Actions #3

Updated by giuseppe.glorioso@garr.it over 2 years ago

Hello,
the requests should come from one of the following IP addresses:

  • 90.147.160.196
  • 90.147.160.197
  • 90.147.160.198

rm.mirror.garr.it server has been discontinued some time ago.

Thank you for the support

Actions #4

Updated by pjessen over 2 years ago

giuseppe.glorioso@garr.it wrote:

Hello,
the requests should come from one of the following IP addresses:

  • 90.147.160.196
  • 90.147.160.197
  • 90.147.160.198

We are not seeing any traffic from those either. Which openSUSE server are you using? The correct one is "stage.opensuse.org".

rm.mirror.garr.it server has been discontinued some time ago.

That is all we have listed in the rsync ACL.

For 90.147.160.196 I see it maps to vpn.ba1.garrservices.it, but the other two addresses have no reverse maps?

Actions #5

Updated by pjessen over 2 years ago

pjessen wrote:

giuseppe.glorioso@garr.it wrote:

Hello,
the requests should come from one of the following IP addresses:

  • 90.147.160.196
  • 90.147.160.197
  • 90.147.160.198

We are not seeing any traffic from those either. Which openSUSE server are you using? The correct one is "stage.opensuse.org".

I took a look at widehat (our external rsync mirror) and as I suspected, you are using that instead of stage.opensuse.org.
FYI, I only see accesses from 90.147.160.197.

There is however an issue with history/ starting at 20210901 - all of the directories are empty, and have permissions 0700. Also, the last snapshot is 20210921, which seems odd. I'll track that in a separate ticket, #99828

Actions #6

Updated by giuseppe.glorioso@garr.it over 2 years ago

Hello again,
it turns out that the way we are mirroring opensuse is not
correct, and we are working to fix the procedure. We just need some
time to perform all the needed tests.

Thank you for the support

On Wed, 06 Oct 2021 08:29:13 +0000
redmine@opensuse.org wrote:

[openSUSE Tracker]
Issue #99492 has been updated by pjessen.

pjessen wrote:

giuseppe.glorioso@garr.it wrote:

Hello,
the requests should come from one of the following IP addresses:

  • 90.147.160.196
  • 90.147.160.197
  • 90.147.160.198

We are not seeing any traffic from those either. Which openSUSE
server are you using? The correct one is "stage.opensuse.org".

I took a look at widehat (our external rsync mirror) and as I
suspected, you are using that instead of stage.opensuse.org. FYI, I
only see accesses from 90.147.160.197.

There is however an issue with history/ starting at 20210901 - all of
the directories are empty, and have permissions 0700. Also, the last
snapshot is 20210921, which seems odd. I'll track that in a separate
ticket, #nnnnn


tickets #99492: Permission denied while mirroring openSuse
https://progress.opensuse.org/issues/99492#change-452622

* Target version:

Hello,
I'm contacting from Consortium GARR, and we actually mirror openSuse
on GARR Mirror service (http://opensuse.mirror.garr.it). We are
contacting you because we are having some trouble mirroring openSuse
files. Specifically rsync fails with the following errors:

rsync: opendir "/opensuse/history/20210831/tumbleweed/repo/oss/i686"
(in opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210831/tumbleweed/repo/oss/media.1" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210831/tumbleweed/repo/oss/noarch" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210831/tumbleweed/repo/oss/repodata" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210831/tumbleweed/repo/oss/x86_64" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210901" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210902" (in opensuse-full-with-factory) failed:
Permission denied (13) rsync: opendir "/opensuse/history/20210904" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210906" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210907" (in opensuse-full-with-factory) failed:
Permission denied (13) rsync: opendir "/opensuse/history/20210908" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210910" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210912" (in opensuse-full-with-factory) failed:
Permission denied (13) rsync: opendir "/opensuse/history/20210913" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210914" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210915" (in opensuse-full-with-factory) failed:
Permission denied (13) rsync: opendir "/opensuse/history/20210916" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210920" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210921" (in opensuse-full-with-factory) failed:
Permission denied (13)

Our systems seems to be working fine, is this a problem on your side?

Thanks you
Best regards


Giuseppe Glorioso
System Support | Consortium GARR
M: +39 366 935 6504
GPG: 4DEA56D6A10EC348 (giuseppe.glorioso@garr.it)

Actions #7

Updated by giuseppe.glorioso@garr.it over 2 years ago

Hello,
we have fixed the synchronization procedure using the guide found at
this link:

We provide a rsync access, but it's not public, it is just for
repo mantainer who requires to verify the integrity of the mirrored
files.

To procede, we need access to use stage.opensuse.org . The rsync
requests will come from one of the following IP addresses:

  • 90.147.160.196
  • 90.147.160.197
  • 90.147.160.198
Actions #8

Updated by pjessen over 2 years ago

giuseppe.glorioso@garr.it wrote:

Hello,
we have fixed the synchronization procedure using the guide found at
this link:

We provide a rsync access, but it's not public, it is just for
repo mantainer who requires to verify the integrity of the mirrored
files.

To procede, we need access to use stage.opensuse.org . The rsync
requests will come from one of the following IP addresses:

  • 90.147.160.196
  • 90.147.160.197
  • 90.147.160.198

Okay, I have added those three. Sorry it took so long.

Actions #9

Updated by giuseppe.glorioso@garr.it over 2 years ago

Thank you, the synchronization is working correctly using
stage.opensuse.org . I'm going now to send an email to
admin@opensuse.org with all our mirror info, as specified here:
https://en.opensuse.org/openSUSE:Mirror_infrastructure#Registering_your_mirror

Best regards

On Tue, 02 Nov 2021 12:29:11 +0000
redmine@opensuse.org wrote:

[openSUSE Tracker]
Issue #99492 has been updated by pjessen.

giuseppe.glorioso@garr.it wrote:

Hello,
we have fixed the synchronization procedure using the guide found at
this link:

We provide a rsync access, but it's not public, it is just for
repo mantainer who requires to verify the integrity of the mirrored
files.

To procede, we need access to use stage.opensuse.org . The rsync
requests will come from one of the following IP addresses:

  • 90.147.160.196
  • 90.147.160.197
  • 90.147.160.198

Okay, I have added those three. Sorry it took so long.


tickets #99492: Permission denied while mirroring openSuse
https://progress.opensuse.org/issues/99492#change-460669

* Target version:

Hello,
I'm contacting from Consortium GARR, and we actually mirror openSuse
on GARR Mirror service (http://opensuse.mirror.garr.it). We are
contacting you because we are having some trouble mirroring openSuse
files. Specifically rsync fails with the following errors:

rsync: opendir "/opensuse/history/20210831/tumbleweed/repo/oss/i686"
(in opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210831/tumbleweed/repo/oss/media.1" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210831/tumbleweed/repo/oss/noarch" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210831/tumbleweed/repo/oss/repodata" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210831/tumbleweed/repo/oss/x86_64" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210901" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210902" (in opensuse-full-with-factory) failed:
Permission denied (13) rsync: opendir "/opensuse/history/20210904" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210906" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210907" (in opensuse-full-with-factory) failed:
Permission denied (13) rsync: opendir "/opensuse/history/20210908" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210910" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210912" (in opensuse-full-with-factory) failed:
Permission denied (13) rsync: opendir "/opensuse/history/20210913" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210914" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210915" (in opensuse-full-with-factory) failed:
Permission denied (13) rsync: opendir "/opensuse/history/20210916" (in
opensuse-full-with-factory) failed: Permission denied (13) rsync:
opendir "/opensuse/history/20210920" (in opensuse-full-with-factory)
failed: Permission denied (13) rsync: opendir
"/opensuse/history/20210921" (in opensuse-full-with-factory) failed:
Permission denied (13)

Our systems seems to be working fine, is this a problem on your side?

Thanks you
Best regards


Giuseppe Glorioso
System Support | Consortium GARR
M: +39 366 935 6504
GPG: 4DEA56D6A10EC348 (giuseppe.glorioso@garr.it)

Actions #10

Updated by pjessen over 2 years ago

  • Status changed from Feedback to Resolved
  • % Done changed from 0 to 100

Thanks, all done.

Actions

Also available in: Atom PDF