Project

General

Profile

Actions

tickets #108494

closed

[carsten@c-otto.de: [ftpsync-opensuse-ftp@ftp] ERROR: rsync errors]

Added by otto@informatik.rwth-aachen.de over 2 years ago. Updated 5 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Mirrors
Target version:
-
Start date:
2022-03-17
Due date:
% Done:

80%

Estimated time:

Description

Hi,

there seems to be some issue with the RPM file mentioned below. I keep
getting errors rsyncing against stage, and the file name makes me think
some rsync on your side of things tries to write the file again and
again.

Could you please check on stage.opensuse.org?

Thanks
Carsten

----- Forwarded message from carsten@c-otto.de -----

Date: Thu, 17 Mar 2022 09:31:34 +0100 (CET)
From: carsten@c-otto.de
To: datafetch@ftp.halifax.rwth-aachen.de
Subject: [ftpsync-opensuse-ftp@ftp] ERROR: rsync errors

rsync: send_files failed to open "/opensuse/update/leap/15.3/sle/src/.rust1.58-1.58.0-150300.7.3.1.src.rpm.ZMUDCR" (in opensuse-full-with-factory-dvd5): Permission denied (13)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1819) [generator=3.2.3]

Mar 17 09:30:01 ftp ftpsync-opensuse-ftp[6745]: Mirrorsync start
Mar 17 09:30:01 ftp ftpsync-opensuse-ftp[6745]: Running mirrorsync, update is required, /pub/opensuse//Archive-Update-Required-ftp.halifax.rwth-aachen.de exists
Mar 17 09:30:01 ftp ftpsync-opensuse-ftp[6745]: Running stage2: rsync --quiet --log-file /home/datafetch/log/rsync-ftpsync-opensuse.log --filter=exclude_/Archive-Update-in-Progress-ftp.halifax.rwth-aachen.de --filter=protect_/Archive-Update-in-Progress-ftp.halifax.rwth-aachen.de --filter=exclude_/Archive-Update-Required-ftp.halifax.rwth-aachen.de --filter=protect_/Archive-Update-Required-ftp.halifax.rwth-aachen.de --filter=exclude_/project/trace/ftp.halifax.rwth-aachen.de --filter=protect_/project/trace/ftp.halifax.rwth-aachen.de --filter=exclude_/project/trace/ftp.halifax.rwth-aachen.de-stage1 --filter=protect_/project/trace/ftp.halifax.rwth-aachen.de-stage1 --filter=exclude_/project/trace/hierarchy --filter=protect/project/trace/hierarchy --filter=exclude/project/trace/traces --filter=protect/project/trace/traces --filter=include/project/ --filter=protect_/project/ --filter=include_/project/trace/ --filter=protect_/project/trace/ --filter=include_/project/trace/* --bwlimit=
0 -prltvHSB8192 --safe-links --chmod=D755,F644 --stats --no-human-readable --no-inc-recursive --exclude repositories/ --exclude=.~tmp~/ stage.opensuse.org::opensuse-full-with-factory-dvd5/opensuse/ /pub/opensuse/ --max-delete=40000 --delay-updates --delete --filter protect_debug/ --filter protect_source/
Mar 17 09:31:34 ftp ftpsync-opensuse-ftp[6745]: Back from rsync with returncode 23
Mar 17 09:31:34 ftp ftpsync-opensuse-ftp[6745]: Mirrorsync done with errors
Mar 17 09:31:34 ftp ftpsync-opensuse-ftp[6745]: bytes: 86165481 93

----- End forwarded message -----

--
Dr. Carsten Otto
http://verify.rwth-aachen.de/otto/


Files

signature.asc (195 Bytes) signature.asc otto@informatik.rwth-aachen.de, 2022-03-17 08:51
signature.asc (195 Bytes) signature.asc otto@informatik.rwth-aachen.de, 2022-03-22 16:50
signature.asc (195 Bytes) signature.asc otto@informatik.rwth-aachen.de, 2022-03-22 17:44
signature.asc (195 Bytes) signature.asc otto@informatik.rwth-aachen.de, 2023-04-08 14:05
signature.asc (195 Bytes) signature.asc otto@informatik.rwth-aachen.de, 2024-07-14 13:36
Actions #1

Updated by cboltz over 2 years ago

  • Category set to Mirrors
  • Assignee set to pjessen
Actions #2

Updated by pjessen over 2 years ago

  • Status changed from New to Feedback
  • Private changed from Yes to No

otto@informatik.rwth-aachen.de wrote:

rsync: send_files failed to open "/opensuse/update/leap/15.3/sle/src/.rust1.58-1.58.0-150300.7.3.1.src.rpm.ZMUDCR" (in opensuse-full-with-factory-dvd5): Permission denied (13)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1819) [generator=3.2.3]

Hi Carsten

That file is surely some temp file, maybe created during rsync - it is certainly gone now. The rpm rust1.58-1.58.0-150300.7.3.1.src.rpm is quite large, 2Gb. Are you still seeing this issue?

Thanks
Per

Actions #3

Updated by pjessen over 2 years ago

pjessen wrote:

That file is surely some temp file, maybe created during rsync

Confirm, that is the target file created by rsync, i.e. ".filename.NNNNNN".

Actions #4

Updated by otto@informatik.rwth-aachen.de over 2 years ago

Hi Per,

On Tue, Mar 22, 2022 at 02:56:59PM +0000, redmine@opensuse.org wrote:

That file is surely some temp file, maybe created during rsync - it is
certainly gone now. The rpm rust1.58-1.58.0-150300.7.3.1.src.rpm is
quite large, 2Gb. Are you still seeing this issue?

No, the error disappeared after a while. It took you several days to
respond, though. Is there some better way to talk about mirroring issues
with stage.opensuse.org?

Thanks,

Carsten

Dr. Carsten Otto
http://verify.rwth-aachen.de/otto/

Actions #5

Updated by pjessen over 2 years ago

  • Status changed from Feedback to In Progress
  • % Done changed from 0 to 80

otto@informatik.rwth-aachen.de wrote:

Hi Per,

On Tue, Mar 22, 2022 at 02:56:59PM +0000, redmine@opensuse.org wrote:

That file is surely some temp file, maybe created during rsync - it is
certainly gone now. The rpm rust1.58-1.58.0-150300.7.3.1.src.rpm is
quite large, 2Gb. Are you still seeing this issue?

No, the error disappeared after a while. It took you several days to
respond, though. Is there some better way to talk about mirroring issues
with stage.opensuse.org?

I would say reporting issues to admin-at-o-o is the best approach - depending on the severity of the issue, you will also usually have a quick answer. This time, well - I've been out with Covid since Thursday :-(

I'm wondering if it might be a good idea to exclude that file pattern from rsync modules in general ".filename.NNNNNN".

Actions #6

Updated by otto@informatik.rwth-aachen.de over 2 years ago

On Tue, Mar 22, 2022 at 05:39:21PM +0000, redmine@opensuse.org wrote:

I would say reporting issues to admin-at-o-o is the best approach -
depending on the severity of the issue, you will also usually have a
quick answer. This time, well - I've been out with Covid since
Thursday :-(

Ouch, get (and stay) well soon! This certainly wasn't a high priority
issue.

I'm wondering if it might be a good idea to exclude that file pattern from rsync modules in general ".filename.NNNNNN".

Yes, that would be great. My rsync script (based on what Debian uses for
their mirroring) automatically excludes .~tmp~, which, I think, is the
directory used when running "rsync --delay-updates". I don't know if
that's feasible for your setup, though.

Bye,

Carsten

Dr. Carsten Otto
http://verify.rwth-aachen.de/otto/

Actions #7

Updated by otto@informatik.rwth-aachen.de over 1 year ago

On Tue, Mar 22, 2022 at 06:44:43PM +0100, Carsten Otto wrote:

Yes, that would be great. My rsync script (based on what Debian uses for
their mirroring) automatically excludes .~tmp~, which, I think, is the
directory used when running "rsync --delay-updates". I don't know if
that's feasible for your setup, though.

This is still an issue and I haven't received an update on this. Please
(re)consider this approach.

Thanks

Carsten

Dr. Carsten Otto
http://verify.rwth-aachen.de/otto/

Actions #8

Updated by crameleon 5 months ago

  • Assignee changed from pjessen to crameleon

Hi,

sorry for the lack in response.
I don't have a reproducer for stage.o.o, but upon testing locally, adding *.rpm.[A-Z][A-Z][A-Z][A-Z][A-Z][A-Z] to the excludes seems promising.

Can you confirm if adding this to the modules on stage.o.o would help your case?

Best,
Georg

Actions #9

Updated by otto@informatik.rwth-aachen.de 5 months ago

Hi Georg,

I think it goes without saying that I don't appreciate a response time
of more than two years, especially as I'm not a user but a volunteer
helping you out.

Regarding your question: the regexp sounds reasonable. I can't change
the config on your server, though. Could you raise an issue internally
and configure this exclusion? I assume you never want to serve temporary
files, to any mirror.

While we're at it, you might also want to check how temporary files end
up on your server. Maybe there's another system worth tweaking.

Best regards

Carsten

Dr. Carsten Otto
http://verify.rwth-aachen.de/otto/

Actions #10

Updated by crameleon 5 months ago

Hi Carsten,

I'm just as much a volunteer here as you are.

Thanks for confirming. I added the setting to all rsync modules on rsync.opensuse.org.
Unfortunately I do not have access to the origin server - I can assign your ticket further, but as I cannot reproduce the issue and do not find any current files matching this pattern, it would require someone actively checking for it.

Best,
Georg

Actions #11

Updated by crameleon 5 months ago

  • Status changed from In Progress to Resolved
Actions

Also available in: Atom PDF