tickets #108494
closed[carsten@c-otto.de: [ftpsync-opensuse-ftp@ftp] ERROR: rsync errors]
80%
Description
Hi,
there seems to be some issue with the RPM file mentioned below. I keep
getting errors rsyncing against stage, and the file name makes me think
some rsync on your side of things tries to write the file again and
again.
Could you please check on stage.opensuse.org?
Thanks
Carsten
----- Forwarded message from carsten@c-otto.de -----
Date: Thu, 17 Mar 2022 09:31:34 +0100 (CET)
From: carsten@c-otto.de
To: datafetch@ftp.halifax.rwth-aachen.de
Subject: [ftpsync-opensuse-ftp@ftp] ERROR: rsync errors
rsync: send_files failed to open "/opensuse/update/leap/15.3/sle/src/.rust1.58-1.58.0-150300.7.3.1.src.rpm.ZMUDCR" (in opensuse-full-with-factory-dvd5): Permission denied (13)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1819) [generator=3.2.3]
Mar 17 09:30:01 ftp ftpsync-opensuse-ftp[6745]: Mirrorsync start
Mar 17 09:30:01 ftp ftpsync-opensuse-ftp[6745]: Running mirrorsync, update is required, /pub/opensuse//Archive-Update-Required-ftp.halifax.rwth-aachen.de exists
Mar 17 09:30:01 ftp ftpsync-opensuse-ftp[6745]: Running stage2: rsync --quiet --log-file /home/datafetch/log/rsync-ftpsync-opensuse.log --filter=exclude_/Archive-Update-in-Progress-ftp.halifax.rwth-aachen.de --filter=protect_/Archive-Update-in-Progress-ftp.halifax.rwth-aachen.de --filter=exclude_/Archive-Update-Required-ftp.halifax.rwth-aachen.de --filter=protect_/Archive-Update-Required-ftp.halifax.rwth-aachen.de --filter=exclude_/project/trace/ftp.halifax.rwth-aachen.de --filter=protect_/project/trace/ftp.halifax.rwth-aachen.de --filter=exclude_/project/trace/ftp.halifax.rwth-aachen.de-stage1 --filter=protect_/project/trace/ftp.halifax.rwth-aachen.de-stage1 --filter=exclude_/project/trace/hierarchy --filter=protect/project/trace/hierarchy --filter=exclude/project/trace/traces --filter=protect/project/trace/traces --filter=include/project/ --filter=protect_/project/ --filter=include_/project/trace/ --filter=protect_/project/trace/ --filter=include_/project/trace/* --bwlimit=
0 -prltvHSB8192 --safe-links --chmod=D755,F644 --stats --no-human-readable --no-inc-recursive --exclude repositories/ --exclude=.~tmp~/ stage.opensuse.org::opensuse-full-with-factory-dvd5/opensuse/ /pub/opensuse/ --max-delete=40000 --delay-updates --delete --filter protect_debug/ --filter protect_source/
Mar 17 09:31:34 ftp ftpsync-opensuse-ftp[6745]: Back from rsync with returncode 23
Mar 17 09:31:34 ftp ftpsync-opensuse-ftp[6745]: Mirrorsync done with errors
Mar 17 09:31:34 ftp ftpsync-opensuse-ftp[6745]: bytes: 86165481 93
----- End forwarded message -----
--
Dr. Carsten Otto
http://verify.rwth-aachen.de/otto/
Files
Updated by cboltz over 2 years ago
- Category set to Mirrors
- Assignee set to pjessen
Updated by pjessen over 2 years ago
- Status changed from New to Feedback
- Private changed from Yes to No
otto@informatik.rwth-aachen.de wrote:
rsync: send_files failed to open "/opensuse/update/leap/15.3/sle/src/.rust1.58-1.58.0-150300.7.3.1.src.rpm.ZMUDCR" (in opensuse-full-with-factory-dvd5): Permission denied (13)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1819) [generator=3.2.3]
Hi Carsten
That file is surely some temp file, maybe created during rsync - it is certainly gone now. The rpm rust1.58-1.58.0-150300.7.3.1.src.rpm is quite large, 2Gb. Are you still seeing this issue?
Thanks
Per
Updated by pjessen over 2 years ago
pjessen wrote:
That file is surely some temp file, maybe created during rsync
Confirm, that is the target file created by rsync, i.e. ".filename.NNNNNN".
Updated by otto@informatik.rwth-aachen.de over 2 years ago
- File signature.asc signature.asc added
Hi Per,
On Tue, Mar 22, 2022 at 02:56:59PM +0000, redmine@opensuse.org wrote:
That file is surely some temp file, maybe created during rsync - it is
certainly gone now. The rpm rust1.58-1.58.0-150300.7.3.1.src.rpm is
quite large, 2Gb. Are you still seeing this issue?
No, the error disappeared after a while. It took you several days to
respond, though. Is there some better way to talk about mirroring issues
with stage.opensuse.org?
Thanks,
Carsten¶
Dr. Carsten Otto
http://verify.rwth-aachen.de/otto/
Updated by pjessen over 2 years ago
- Status changed from Feedback to In Progress
- % Done changed from 0 to 80
otto@informatik.rwth-aachen.de wrote:
Hi Per,
On Tue, Mar 22, 2022 at 02:56:59PM +0000, redmine@opensuse.org wrote:
That file is surely some temp file, maybe created during rsync - it is
certainly gone now. The rpm rust1.58-1.58.0-150300.7.3.1.src.rpm is
quite large, 2Gb. Are you still seeing this issue?No, the error disappeared after a while. It took you several days to
respond, though. Is there some better way to talk about mirroring issues
with stage.opensuse.org?
I would say reporting issues to admin-at-o-o is the best approach - depending on the severity of the issue, you will also usually have a quick answer. This time, well - I've been out with Covid since Thursday :-(
I'm wondering if it might be a good idea to exclude that file pattern from rsync modules in general ".filename.NNNNNN".
Updated by otto@informatik.rwth-aachen.de over 2 years ago
- File signature.asc signature.asc added
On Tue, Mar 22, 2022 at 05:39:21PM +0000, redmine@opensuse.org wrote:
I would say reporting issues to admin-at-o-o is the best approach -
depending on the severity of the issue, you will also usually have a
quick answer. This time, well - I've been out with Covid since
Thursday :-(
Ouch, get (and stay) well soon! This certainly wasn't a high priority
issue.
I'm wondering if it might be a good idea to exclude that file pattern from rsync modules in general ".filename.NNNNNN".
Yes, that would be great. My rsync script (based on what Debian uses for
their mirroring) automatically excludes .~tmp~, which, I think, is the
directory used when running "rsync --delay-updates". I don't know if
that's feasible for your setup, though.
Bye,
Carsten¶
Dr. Carsten Otto
http://verify.rwth-aachen.de/otto/
Updated by otto@informatik.rwth-aachen.de over 1 year ago
- File signature.asc signature.asc added
On Tue, Mar 22, 2022 at 06:44:43PM +0100, Carsten Otto wrote:
Yes, that would be great. My rsync script (based on what Debian uses for
their mirroring) automatically excludes .~tmp~, which, I think, is the
directory used when running "rsync --delay-updates". I don't know if
that's feasible for your setup, though.
This is still an issue and I haven't received an update on this. Please
(re)consider this approach.
Thanks
Carsten¶
Dr. Carsten Otto
http://verify.rwth-aachen.de/otto/
Updated by crameleon 13 days ago
- Assignee changed from pjessen to crameleon
Hi,
sorry for the lack in response.
I don't have a reproducer for stage.o.o, but upon testing locally, adding *.rpm.[A-Z][A-Z][A-Z][A-Z][A-Z][A-Z] to the excludes seems promising.
Can you confirm if adding this to the modules on stage.o.o would help your case?
Best,
Georg
Updated by otto@informatik.rwth-aachen.de 12 days ago
- File signature.asc signature.asc added
Hi Georg,
I think it goes without saying that I don't appreciate a response time
of more than two years, especially as I'm not a user but a volunteer
helping you out.
Regarding your question: the regexp sounds reasonable. I can't change
the config on your server, though. Could you raise an issue internally
and configure this exclusion? I assume you never want to serve temporary
files, to any mirror.
While we're at it, you might also want to check how temporary files end
up on your server. Maybe there's another system worth tweaking.
Best regards
Carsten¶
Dr. Carsten Otto
http://verify.rwth-aachen.de/otto/
Updated by crameleon 12 days ago
Hi Carsten,
I'm just as much a volunteer here as you are.
Thanks for confirming. I added the setting to all rsync modules on rsync.opensuse.org.
Unfortunately I do not have access to the origin server - I can assign your ticket further, but as I cannot reproduce the issue and do not find any current files matching this pattern, it would require someone actively checking for it.
Best,
Georg