Project

General

Profile

Actions

tickets #100506

closed

rsync.o.o setup

Added by pjessen over 2 years ago. Updated over 1 year ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Mirrors
Target version:
-
Start date:
2021-10-07
Due date:
% Done:

100%

Estimated time:

Description

Triggered by another issue, I started to look at widehat - it was clear that history/ hat not been updated since 23 September, for instance.
For now, I have set up a number of cron jobs to synchronize from stage.o.o. I have made a rough attempt to spread them out over time, to not clog up stage.o.o, maybe make the process a bit more parallel.

* update       - every 10mins
* distribution - every hour
* tumbleweed   - every hour
* ports        - every hour
* history      - every three hours, for max one hour
* source       - every three hours, for max one hour
* debug        - every three hours, for max one hour

However, I notice that widehat has a "/etc/rsyncd-push.conf" which contains various push modules, with allowed hosts being stage.o.o and obs-gateway.o.o.
It is not in use, we run rsyncd via xinetd and that config file is not used.

"/etc/rsyncd-push.conf" uses userid 'repopush', although this is not defined.

Most modules allow obs-gateway.o.o.

There is an old logfile, /var/log/rsyncd-push.log, which was last written to 2 August 2021. It goes back to 14 May - looking at that, the push modules were only ever used by two IP addresses: 192.168.7.1 and 192.168.7.4.

192.168.7.1 only uploads to "upload-obs", 192.168.7.4 uploads to "put-ports", "upload-factory" and "upload-obs".


Related issues 3 (1 open2 closed)

Related to openSUSE admin - tickets #109016: rsync.opensuse.org not updated since 2022/03/07Resolvedpjessen2022-03-26

Actions
Related to openSUSE admin - tickets #97520: rsync.opensuse.org out of synch ?Resolvedpjessen2021-08-25

Actions
Related to openSUSE admin - tickets #115640: provo-mirror.o.o/rsync.o.o - review of rsync processNewbmwiedemann2022-08-23

Actions
Actions #1

Updated by pjessen over 2 years ago

  • Status changed from New to In Progress
  • Assignee set to pjessen
  • Private changed from Yes to No

pjessen wrote:

However, I notice that widehat has a "/etc/rsyncd-push.conf" which contains various push modules, with allowed hosts being stage.o.o and obs-gateway.o.o.
It is not in use, we run rsyncd via xinetd and that config file is not used.

Disregard the above, the contents of that file were appended to /etc/rsyncd.conf

Actions #2

Updated by pjessen over 2 years ago

According to /var/log/rsyncd.conf, scanner.o.o and stage.o.o both work fine with this setup, widehat is being scanned and has repositories pushed. I also see some access from obs-gateway.o.o, to "put-updates-main-debug" and "put-updates-main" (since 3 August). I think this means my cronjob for updates is superfluous, I'll disable it and check back later.

Actions #3

Updated by pjessen over 2 years ago

Running "rsync -rlptvn --delete-after --no-motd stage.opensuse.org::opensuse-updates /srv/ftp/pub/opensuse/update" :

receiving file list ... done
leap/15.2/oss_debug/
leap/15.2/oss_debug/openSUSE:Leap:15.2:Update.repo
leap/15.2/oss_debug/repodata/
leap/15.2/oss_debug/repodata/5afc6cb78c11733eb7ae0cd9dfefc5a37fba3d6530ec285484cf419be9bc7e84-suseinfo.xml.gz
leap/15.2/oss_debug/repodata/6a0f673b18b80e07c2e3868288ab06e6da9a9e530969b0efbf66d3c347e0a73b-filelists.xml.gz
leap/15.2/oss_debug/repodata/aa14174bd505cc1f6ca8cc242f05d8b987e9615c602bbc334658690267d488fe-other.xml.gz
leap/15.2/oss_debug/repodata/b82351e01fd5492013049c86a4d750ad07b4f6a59b18ede75b6ab44b46d532da-primary.xml.gz
leap/15.2/oss_debug/repodata/repomd.xml
leap/15.2/oss_debug/repodata/repomd.xml.asc
leap/15.2/oss_debug/repodata/repomd.xml.key
leap/15.2/oss_debug/x86_64/
leap/15.2/oss_debug/x86_64/python3-virtualbox-debuginfo-6.1.22-lp152.2.24.2.x86_64.rpm
leap/15.2/oss_debug/x86_64/virtualbox-debuginfo-6.1.22-lp152.2.24.2.x86_64.rpm
leap/15.2/oss_debug/x86_64/virtualbox-debugsource-6.1.22-lp152.2.24.2.x86_64.rpm
leap/15.2/oss_debug/x86_64/virtualbox-guest-tools-debuginfo-6.1.22-lp152.2.24.2.x86_64.rpm
leap/15.2/oss_debug/x86_64/virtualbox-guest-x11-debuginfo-6.1.22-lp152.2.24.2.x86_64.rpm
leap/15.2/oss_debug/x86_64/virtualbox-kmp-debugsource-6.1.22-lp152.2.24.2.x86_64.rpm
leap/15.2/oss_debug/x86_64/virtualbox-kmp-default-debuginfo-6.1.22_k5.3.18_lp152.75-lp152.2.24.2.x86_64.rpm
leap/15.2/oss_debug/x86_64/virtualbox-kmp-preempt-debuginfo-6.1.22_k5.3.18_lp152.75-lp152.2.24.2.x86_64.rpm
leap/15.2/oss_debug/x86_64/virtualbox-qt-debuginfo-6.1.22-lp152.2.24.2.x86_64.rpm
leap/15.2/oss_debug/x86_64/virtualbox-websrv-debuginfo-6.1.22-lp152.2.24.2.x86_64.rpm
leap/15.3/backports/
leap/15.3/backports/openSUSE:Backports:SLE-15-SP3:Update.repo
leap/15.3/backports/aarch64/
leap/15.3/backports/aarch64/chromedriver-94.0.4606.71-bp153.2.31.1.aarch64.rpm
leap/15.3/backports/aarch64/chromium-94.0.4606.71-bp153.2.31.1.aarch64.rpm
leap/15.3/backports/repodata/
leap/15.3/backports/repodata/0e279ff05d06a86a4bd9ab51d6a41875e4374917a5ab250e1cb191b595b0b17f-updateinfo.xml.gz
leap/15.3/backports/repodata/198115ed0add1eaaf2d6a7f3dfe73bc581e1091dce4edbd50428c72a559b6695-filelists.xml.gz
leap/15.3/backports/repodata/4cfb6f62fc38ba03d518a78d872a33c393810974844675385d8e8292075d5dbf-other.xml.gz
leap/15.3/backports/repodata/5afc6cb78c11733eb7ae0cd9dfefc5a37fba3d6530ec285484cf419be9bc7e84-suseinfo.xml.gz
leap/15.3/backports/repodata/6f5adebf58acfc6986b2f5a164547f2568b0a3fb43adb7f882aac992a6b2e22f-deltainfo.xml.gz
leap/15.3/backports/repodata/d16f161c366ab7df7cf6eadb180a8e37be70f55e8567405370e5a4eebe9e36db-primary.xml.gz
leap/15.3/backports/repodata/repomd.xml
leap/15.3/backports/repodata/repomd.xml.asc
leap/15.3/backports/repodata/repomd.xml.key
leap/15.3/backports/src/
leap/15.3/backports/src/chromium-94.0.4606.71-bp153.2.31.1.src.rpm
leap/15.3/backports/x86_64/
leap/15.3/backports/x86_64/chromedriver-94.0.4606.71-bp153.2.31.1.x86_64.rpm
leap/15.3/backports/x86_64/chromium-94.0.4606.71-bp153.2.31.1.x86_64.rpm
leap/15.3/backports_debug/
leap/15.3/backports_debug/openSUSE:Backports:SLE-15-SP3:Update.repo
leap/15.3/backports_debug/repodata/
leap/15.3/backports_debug/repodata/3b19de3029765c9a5000acdad52092511330d7682e9d7ee60388f9feb77aafde-filelists.xml.gz
leap/15.3/backports_debug/repodata/5afc6cb78c11733eb7ae0cd9dfefc5a37fba3d6530ec285484cf419be9bc7e84-suseinfo.xml.gz
leap/15.3/backports_debug/repodata/bc6831ba4933c7490a43b60496b123f8866652d63d572761c9c0a810dfbebbe8-other.xml.gz
leap/15.3/backports_debug/repodata/e6f60640da452d85ac4c53d58d5859613cc01ab7724bb21db70162051d9557dd-primary.xml.gz
leap/15.3/backports_debug/repodata/repomd.xml
leap/15.3/backports_debug/repodata/repomd.xml.asc
leap/15.3/backports_debug/repodata/repomd.xml.key
leap/15.3/oss/
leap/15.3/oss/openSUSE:Leap:15.3:Update.repo
leap/15.3/oss/noarch/
leap/15.3/oss/noarch/virtualbox-guest-desktop-icons-6.1.22-lp153.2.3.2.noarch.rpm
leap/15.3/oss/noarch/virtualbox-guest-source-6.1.22-lp153.2.3.2.noarch.rpm
leap/15.3/oss/noarch/virtualbox-host-source-6.1.22-lp153.2.3.2.noarch.rpm
leap/15.3/oss/repodata/
leap/15.3/oss/repodata/102029af486759aaf2cf8a3a789a0feb44135023fb1b1e5b630a6465502f7784-primary.xml.gz
leap/15.3/oss/repodata/14ac4e9d4ace16a755699a434dde89598ff82bb1037f4b86a55cf9f4986709f2-filelists.xml.gz
leap/15.3/oss/repodata/5afc6cb78c11733eb7ae0cd9dfefc5a37fba3d6530ec285484cf419be9bc7e84-suseinfo.xml.gz
leap/15.3/oss/repodata/690dcd609082117fd1ef0c4124aaadb31bc15bb3f8aba3ac9340c3b7d085f5ea-updateinfo.xml.gz
leap/15.3/oss/repodata/7da0a3e474f1bd0500e402ca0934ef4b8350534aaa8978302626a3b9fb1c0baf-other.xml.gz
leap/15.3/oss/repodata/aca5e7662d2b580b0c13483eed6e56582f38de34b13f101ced5417933f5242ae-deltainfo.xml.gz
leap/15.3/oss/repodata/repomd.xml
leap/15.3/oss/repodata/repomd.xml.asc
leap/15.3/oss/repodata/repomd.xml.key
leap/15.3/oss/src/
leap/15.3/oss/src/virtualbox-6.1.22-lp153.2.3.2.src.rpm
leap/15.3/oss/src/virtualbox-kmp-6.1.22-lp153.2.3.2.src.rpm
leap/15.3/oss/x86_64/
leap/15.3/oss/x86_64/python3-virtualbox-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss/x86_64/virtualbox-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss/x86_64/virtualbox-devel-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss/x86_64/virtualbox-guest-tools-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss/x86_64/virtualbox-guest-x11-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss/x86_64/virtualbox-kmp-default-6.1.22_k5.3.18_59.5-lp153.2.3.2.x86_64.rpm
leap/15.3/oss/x86_64/virtualbox-kmp-preempt-6.1.22_k5.3.18_59.5-lp153.2.3.2.x86_64.rpm
leap/15.3/oss/x86_64/virtualbox-qt-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss/x86_64/virtualbox-vnc-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss/x86_64/virtualbox-websrv-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss_debug/
leap/15.3/oss_debug/openSUSE:Leap:15.3:Update.repo
leap/15.3/oss_debug/repodata/
leap/15.3/oss_debug/repodata/09bf1c4609fd0a8e5631fcbbbace83e1a1998bcdd7250434a60b12411e713515-filelists.xml.gz
leap/15.3/oss_debug/repodata/5afc6cb78c11733eb7ae0cd9dfefc5a37fba3d6530ec285484cf419be9bc7e84-suseinfo.xml.gz
leap/15.3/oss_debug/repodata/f8c78ae2a7f82d4dfd123d7894e9a437700fc393f8744b1b7cc0d63caf085cd2-primary.xml.gz
leap/15.3/oss_debug/repodata/fd9d95fd02e367b98779e83da1e82eec75552759ad647b67b130dc1541ebc212-other.xml.gz
leap/15.3/oss_debug/repodata/repomd.xml
leap/15.3/oss_debug/repodata/repomd.xml.asc
leap/15.3/oss_debug/repodata/repomd.xml.key
leap/15.3/oss_debug/x86_64/
leap/15.3/oss_debug/x86_64/python3-virtualbox-debuginfo-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss_debug/x86_64/virtualbox-debuginfo-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss_debug/x86_64/virtualbox-debugsource-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss_debug/x86_64/virtualbox-guest-tools-debuginfo-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss_debug/x86_64/virtualbox-guest-x11-debuginfo-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss_debug/x86_64/virtualbox-kmp-debugsource-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss_debug/x86_64/virtualbox-kmp-default-debuginfo-6.1.22_k5.3.18_59.5-lp153.2.3.2.x86_64.rpm
leap/15.3/oss_debug/x86_64/virtualbox-kmp-preempt-debuginfo-6.1.22_k5.3.18_59.5-lp153.2.3.2.x86_64.rpm
leap/15.3/oss_debug/x86_64/virtualbox-qt-debuginfo-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/oss_debug/x86_64/virtualbox-websrv-debuginfo-6.1.22-lp153.2.3.2.x86_64.rpm
leap/15.3/sle/
leap/15.3/sle/aarch64/
leap/15.3/sle/aarch64/coreutils-8.32-1.2_3.2.1.aarch64.drpm
leap/15.3/sle/aarch64/coreutils-8.32-3.2.1.aarch64.rpm
leap/15.3/sle/aarch64/coreutils-single-8.32-1.2_3.2.1.aarch64.drpm
leap/15.3/sle/aarch64/coreutils-single-8.32-3.2.1.aarch64.rpm
leap/15.3/sle/aarch64/coreutils-testsuite-8.32-3.2.1.aarch64.rpm
leap/15.3/sle/aarch64/erlang-rabbitmq-client-3.8.11-1.26_3.3.3.aarch64.drpm
leap/15.3/sle/aarch64/erlang-rabbitmq-client-3.8.11-3.3.3.aarch64.rpm
leap/15.3/sle/aarch64/rabbitmq-server-3.8.11-1.26_3.3.3.aarch64.drpm
leap/15.3/sle/aarch64/rabbitmq-server-3.8.11-3.3.3.aarch64.rpm
leap/15.3/sle/aarch64/rabbitmq-server-plugins-3.8.11-1.26_3.3.3.aarch64.drpm
leap/15.3/sle/aarch64/rabbitmq-server-plugins-3.8.11-3.3.3.aarch64.rpm
leap/15.3/sle/aarch64/yast2-schema-4.3.22_4.3.25-1.1_3.6.1.aarch64.drpm
leap/15.3/sle/aarch64/yast2-schema-4.3.23_4.3.25-3.3.2_3.6.1.aarch64.drpm
leap/15.3/sle/aarch64/yast2-schema-4.3.25-3.6.1.aarch64.rpm
leap/15.3/sle/noarch/
leap/15.3/sle/noarch/autoyast2-4.3.90-3.25.1.noarch.rpm
leap/15.3/sle/noarch/autoyast2-installation-4.3.77_4.3.90-1.1_3.25.1.noarch.drpm
leap/15.3/sle/noarch/autoyast2-installation-4.3.89_4.3.90-3.22.1_3.25.1.noarch.drpm
leap/15.3/sle/noarch/autoyast2-installation-4.3.90-3.25.1.noarch.rpm
leap/15.3/sle/noarch/coreutils-doc-8.32-1.2_3.2.1.noarch.drpm
leap/15.3/sle/noarch/coreutils-doc-8.32-3.2.1.noarch.rpm
leap/15.3/sle/noarch/coreutils-lang-8.32-1.2_3.2.1.noarch.drpm
leap/15.3/sle/noarch/coreutils-lang-8.32-3.2.1.noarch.rpm
leap/15.3/sle/ppc64le/
leap/15.3/sle/ppc64le/coreutils-8.32-1.2_3.2.1.ppc64le.drpm
leap/15.3/sle/ppc64le/coreutils-8.32-3.2.1.ppc64le.rpm
leap/15.3/sle/ppc64le/coreutils-single-8.32-1.2_3.2.1.ppc64le.drpm
leap/15.3/sle/ppc64le/coreutils-single-8.32-3.2.1.ppc64le.rpm
leap/15.3/sle/ppc64le/coreutils-testsuite-8.32-3.2.1.ppc64le.rpm
leap/15.3/sle/ppc64le/erlang-rabbitmq-client-3.8.11-1.26_3.3.3.ppc64le.drpm
leap/15.3/sle/ppc64le/erlang-rabbitmq-client-3.8.11-3.3.3.ppc64le.rpm
leap/15.3/sle/ppc64le/patterns-sap-15.3-9.5.1.ppc64le.rpm
leap/15.3/sle/ppc64le/patterns-sap-b1-15.3-9.5.1.ppc64le.rpm
leap/15.3/sle/ppc64le/patterns-sap-hana-15.3-9.5.1.ppc64le.rpm
leap/15.3/sle/ppc64le/patterns-sap-nw-15.3-9.5.1.ppc64le.rpm
leap/15.3/sle/ppc64le/rabbitmq-server-3.8.11-1.26_3.3.3.ppc64le.drpm
leap/15.3/sle/ppc64le/rabbitmq-server-3.8.11-3.3.3.ppc64le.rpm
leap/15.3/sle/ppc64le/rabbitmq-server-plugins-3.8.11-1.26_3.3.3.ppc64le.drpm
leap/15.3/sle/ppc64le/rabbitmq-server-plugins-3.8.11-3.3.3.ppc64le.rpm
leap/15.3/sle/ppc64le/yast2-schema-4.3.22_4.3.25-1.1_3.6.1.ppc64le.drpm
leap/15.3/sle/ppc64le/yast2-schema-4.3.23_4.3.25-3.3.2_3.6.1.ppc64le.drpm
leap/15.3/sle/ppc64le/yast2-schema-4.3.25-3.6.1.ppc64le.rpm
leap/15.3/sle/repodata/
leap/15.3/sle/repodata/1b27999e4c9b3e9a2ea2af2f1df355839d9011b588d8de27b08584a93e9cf956-susedata.xml.gz
leap/15.3/sle/repodata/3754dfc58ededa0cb952d1ae1d73ff15cead6b302c8d33dc19d467707b92a200-updateinfo.xml.gz
leap/15.3/sle/repodata/51f2fe7d595efb319f2f2f7483cd899b17e90b5ad7597dc2290eefd4117f9a90-other.xml.gz
leap/15.3/sle/repodata/9408a7dbfa51d5adc1a5139d8bb3e0a0fa3c6717d4ab17f4677366f5b585fa56-deltainfo.xml.gz
leap/15.3/sle/repodata/ac902b18200c6a45f822210df34ceebea614daba45903552412bfa314f49787b-primary.xml.gz
leap/15.3/sle/repodata/d9bcfd7b2816b657754814f2f0a0fb675fe91f2e11a989e64df5055dcaa6847d-filelists.xml.gz
leap/15.3/sle/repodata/repomd.xml
leap/15.3/sle/repodata/repomd.xml.asc
leap/15.3/sle/repodata/repomd.xml.key
leap/15.3/sle/s390x/
leap/15.3/sle/s390x/coreutils-8.32-1.2_3.2.1.s390x.drpm
leap/15.3/sle/s390x/coreutils-8.32-3.2.1.s390x.rpm
leap/15.3/sle/s390x/coreutils-single-8.32-1.2_3.2.1.s390x.drpm
leap/15.3/sle/s390x/coreutils-single-8.32-3.2.1.s390x.rpm
leap/15.3/sle/s390x/coreutils-testsuite-8.32-3.2.1.s390x.rpm
leap/15.3/sle/s390x/erlang-rabbitmq-client-3.8.11-1.26_3.3.3.s390x.drpm
leap/15.3/sle/s390x/erlang-rabbitmq-client-3.8.11-3.3.3.s390x.rpm
leap/15.3/sle/s390x/rabbitmq-server-3.8.11-1.26_3.3.3.s390x.drpm
leap/15.3/sle/s390x/rabbitmq-server-3.8.11-3.3.3.s390x.rpm
leap/15.3/sle/s390x/rabbitmq-server-plugins-3.8.11-1.26_3.3.3.s390x.drpm
leap/15.3/sle/s390x/rabbitmq-server-plugins-3.8.11-3.3.3.s390x.rpm
leap/15.3/sle/s390x/yast2-schema-4.3.22_4.3.25-1.1_3.6.1.s390x.drpm
leap/15.3/sle/s390x/yast2-schema-4.3.23_4.3.25-3.3.2_3.6.1.s390x.drpm
leap/15.3/sle/s390x/yast2-schema-4.3.25-3.6.1.s390x.rpm
leap/15.3/sle/src/
leap/15.3/sle/src/autoyast2-4.3.90-3.25.1.src.rpm
leap/15.3/sle/src/coreutils-8.32-3.2.1.src.rpm
leap/15.3/sle/src/coreutils-single-8.32-3.2.1.src.rpm
leap/15.3/sle/src/coreutils-testsuite-8.32-3.2.1.src.rpm
leap/15.3/sle/src/patterns-sap-15.3-9.5.1.src.rpm
leap/15.3/sle/src/rabbitmq-server-3.8.11-3.3.3.src.rpm
leap/15.3/sle/src/yast2-schema-4.3.25-3.6.1.src.rpm
leap/15.3/sle/x86_64/
leap/15.3/sle/x86_64/coreutils-8.32-1.2_3.2.1.x86_64.drpm
leap/15.3/sle/x86_64/coreutils-8.32-3.2.1.x86_64.rpm
leap/15.3/sle/x86_64/coreutils-single-8.32-1.2_3.2.1.x86_64.drpm
leap/15.3/sle/x86_64/coreutils-single-8.32-3.2.1.x86_64.rpm
leap/15.3/sle/x86_64/coreutils-testsuite-8.32-3.2.1.x86_64.rpm
leap/15.3/sle/x86_64/erlang-rabbitmq-client-3.8.11-1.26_3.3.3.x86_64.drpm
leap/15.3/sle/x86_64/erlang-rabbitmq-client-3.8.11-3.3.3.x86_64.rpm
leap/15.3/sle/x86_64/patterns-sap-15.3-9.5.1.x86_64.rpm
leap/15.3/sle/x86_64/patterns-sap-b1-15.3-9.5.1.x86_64.rpm
leap/15.3/sle/x86_64/patterns-sap-hana-15.3-9.5.1.x86_64.rpm
leap/15.3/sle/x86_64/patterns-sap-nw-15.3-9.5.1.x86_64.rpm
leap/15.3/sle/x86_64/rabbitmq-server-3.8.11-1.26_3.3.3.x86_64.drpm
leap/15.3/sle/x86_64/rabbitmq-server-3.8.11-3.3.3.x86_64.rpm
leap/15.3/sle/x86_64/rabbitmq-server-plugins-3.8.11-1.26_3.3.3.x86_64.drpm
leap/15.3/sle/x86_64/rabbitmq-server-plugins-3.8.11-3.3.3.x86_64.rpm
leap/15.3/sle/x86_64/yast2-schema-4.3.22_4.3.25-1.1_3.6.1.x86_64.drpm
leap/15.3/sle/x86_64/yast2-schema-4.3.23_4.3.25-3.3.2_3.6.1.x86_64.drpm
leap/15.3/sle/x86_64/yast2-schema-4.3.25-3.6.1.x86_64.rpm
deleting leap/15.2/oss_debug/repodata/471dbb45741f2ec77d9ee1476775ca919b62199a924dbef9f52e002e6a9a64b5-primary.xml.gz
deleting leap/15.3/backports/repodata/b34587cf6f78af91932a5a4d69debe19d164155b7c35968ab9985f03071c59e2-primary.xml.gz
deleting leap/15.3/backports/repodata/895a407f580c8144493c53ab94f394732c3edcbe71b2735a27e1c76fed9e4ed6-deltainfo.xml.gz
deleting leap/15.3/backports/repodata/58017057f3d412e8611fd69fdd80c3098ac61196fc19cbd55f2d455cacfea2f6-filelists.xml.gz
deleting leap/15.3/backports/repodata/139ff28249f928c0ba946fe783aa8cbb28dc1d2c0d3e6c5a34ef0d2f6efb94f9-updateinfo.xml.gz
deleting leap/15.3/backports/repodata/0ff3fcb270c808820955e50c114d7ad5ff90152099be2febf2f7bce5891ada1a-other.xml.gz
deleting leap/15.3/backports/x86_64/chromedriver-92.0.4515.159_93.0.4577.82-bp153.2.25.1_bp153.2.28.1.x86_64.drpm
deleting leap/15.3/oss/repodata/fd274ce6c30194d8b6d3838e67a828132cf2cf25a282757115d7a91d5bfb7905-updateinfo.xml.gz
deleting leap/15.3/oss/repodata/29811d0c54fbf9246cdd70e30ec05842adf603a1a0fa001b5c8352cf24d2660b-primary.xml.gz
deleting leap/15.3/oss/repodata/15321a94d4c10ba12492b4211c5d357b90e18960d6b42d27f1fed3f59dd6c64e-deltainfo.xml.gz
deleting leap/15.3/oss_debug/repodata/de9b9692c544e784933dc400571be709ab5600a74569135dfbb9b776911a2905-primary.xml.gz
deleting leap/15.3/sle/aarch64/yast2-schema-4.3.22_4.3.23-1.1_3.3.2.aarch64.drpm
deleting leap/15.3/sle/noarch/autoyast2-installation-4.3.86_4.3.89-3.17.1_3.22.1.noarch.drpm
deleting leap/15.3/sle/noarch/autoyast2-installation-4.3.77_4.3.89-1.1_3.22.1.noarch.drpm
deleting leap/15.3/sle/ppc64le/yast2-schema-4.3.22_4.3.23-1.1_3.3.2.ppc64le.drpm
deleting leap/15.3/sle/repodata/e3b13c41da3facc9d767a83770644babd5315f8f156ee821555d2c15bbe22fed-other.xml.gz
deleting leap/15.3/sle/repodata/ca2b69a0534aca42fa5fa8a29a8fdc35803fab00d0e6d7c78183912a0a0e14b6-updateinfo.xml.gz
deleting leap/15.3/sle/repodata/76e19067c21062487893a5f9937fd49aa83670ec68d44427709a03c70229f923-deltainfo.xml.gz
deleting leap/15.3/sle/repodata/5135712bc30b109b39eebd8cd8a7756c31705a0c024a9a7de7ce5dee908c4cd2-primary.xml.gz
deleting leap/15.3/sle/repodata/37b581d129a4585f8a53e69c8d6a08ed1ed2f037e24a7c3e371082649fe51a47-filelists.xml.gz
deleting leap/15.3/sle/s390x/yast2-schema-4.3.22_4.3.23-1.1_3.3.2.s390x.drpm
deleting leap/15.3/sle/x86_64/yast2-schema-4.3.22_4.3.23-1.1_3.3.2.x86_64.drpm

Some of those are days old, so the updates push doesn't seem to work.

Actions #4

Updated by pjessen over 2 years ago

pjessen wrote:

Some of those are days old, so the updates push doesn't seem to work.

Well, the rsync logs do show plenty of pushes to "put-updates-main" and "put-updates-main-debug", so why we are missing some files, I don't know.

Actions #5

Updated by pjessen about 2 years ago

  • Subject changed from widehat setup to rsync.o.o setup

Sorry, I guess I dropped the ball on this one. :-(
However, as noted above, the push to 'put-updates-main' and 'put-updates-main-debug' both seem to be working, judging by /var/log/rsyncd.log-20220321.xz. No pushes since 20 March though, but that does not appear to be unusual. What is unusual is, there are no pushes of leap/15.3/sle and leap/15.3/backports.

on rsync.o.o, running manually right now (1239 CET):

rsync -av --progress stage.opensuse.org::opensuse-full/opensuse/update/leap/15.3/sle  /srv/ftp/pub/opensuse/update/leap/15.3
Actions #6

Updated by pjessen about 2 years ago

on rsync.o.o, running manually right now (1239 CET):

rsync -av --progress stage.opensuse.org::opensuse-full/opensuse/update/leap/15.3/sle  /srv/ftp/pub/opensuse/update/leap/15.3

That took about 20mins, I am now doing backports, but I expect that to be fast too.

Actions #7

Updated by pjessen about 2 years ago

  • Related to tickets #109016: rsync.opensuse.org not updated since 2022/03/07 added
Actions #8

Updated by pjessen about 2 years ago

  • % Done changed from 0 to 40

To clean up, I ran a full rsync on update/leap - "15.2/oss_debug" took quite a while. It also synced 15.4/sle and 15.4/backports which suggests they are also not being pushed to us.
For the time being, I am re-enabling the cronjob for updates, but it seems to me we ought to look at obs-gateway.opensuse.org and review what is being pushed.

Actions #9

Updated by pjessen almost 2 years ago

Actions #10

Updated by pjessen over 1 year ago

  • Related to tickets #115640: provo-mirror.o.o/rsync.o.o - review of rsync process added
Actions #11

Updated by pjessen over 1 year ago

  • Status changed from In Progress to Resolved
  • % Done changed from 40 to 100

I'm closing this one as resolved. rsync.o.o is doing it's best to keep up, and we have a working sync setup. There is room for improvement, but I'll leave that for #115640

Actions

Also available in: Atom PDF