tickets #111216
openBroken symlinks in OpenSuse main rsync server
0%
Description
Howdy Team,
This has been raised on the mirror mailing list previously to no
response, but I'm seeing a large number of broken symlinks when
pulling from the tier 0 server:
fcixadmin@griffin1:/data/mirror/opensuse/opensuse$ find . -xtype l
./source/distribution/openSUSE-current
./history/20220505/tumbleweed/repo/src-oss
./history/20220505/tumbleweed/repo/src-non-oss
./history/20220505/tumbleweed/repo/debug
./history/20220423/tumbleweed/repo/debug
./history/20220423/tumbleweed/repo/src-oss
./history/20220423/tumbleweed/repo/src-non-oss
./history/20220424/tumbleweed/repo/src-non-oss
./history/20220424/tumbleweed/repo/debug
./history/20220424/tumbleweed/repo/src-oss
./history/20220502/tumbleweed/repo/src-non-oss
./history/20220502/tumbleweed/repo/src-oss
./history/20220502/tumbleweed/repo/debug
./history/20220506/tumbleweed/repo/src-oss
./history/20220506/tumbleweed/repo/src-non-oss
./history/20220506/tumbleweed/repo/debug
./history/20220515/tumbleweed/repo/src-non-oss
./history/20220515/tumbleweed/repo/src-oss
./history/20220515/tumbleweed/repo/debug
./history/20220512/tumbleweed/repo/debug
./history/20220512/tumbleweed/repo/src-non-oss
./history/20220512/tumbleweed/repo/src-oss
./history/20220427/tumbleweed/repo/debug
./history/20220427/tumbleweed/repo/src-oss
./history/20220427/tumbleweed/repo/src-non-oss
./history/20220501/tumbleweed/repo/src-oss
./history/20220501/tumbleweed/repo/src-non-oss
./history/20220501/tumbleweed/repo/debug
./history/20220503/tumbleweed/repo/src-non-oss
./history/20220503/tumbleweed/repo/debug
./history/20220503/tumbleweed/repo/src-oss
./history/20220509/tumbleweed/repo/debug
./history/20220509/tumbleweed/repo/src-oss
./history/20220509/tumbleweed/repo/src-non-oss
./history/20220510/tumbleweed/repo/src-oss
./history/20220510/tumbleweed/repo/debug
./history/20220510/tumbleweed/repo/src-non-oss
./history/20220425/tumbleweed/repo/debug
./history/20220425/tumbleweed/repo/src-oss
./history/20220425/tumbleweed/repo/src-non-oss
./history/20220422/tumbleweed/repo/debug
./history/20220422/tumbleweed/repo/src-oss
./history/20220422/tumbleweed/repo/src-non-oss
./history/20220428/tumbleweed/repo/src-oss
./history/20220428/tumbleweed/repo/src-non-oss
./history/20220428/tumbleweed/repo/debug
./history/20220504/tumbleweed/repo/src-non-oss
./history/20220504/tumbleweed/repo/src-oss
./history/20220504/tumbleweed/repo/debug
./history/20220513/tumbleweed/repo/src-non-oss
./history/20220513/tumbleweed/repo/src-oss
./history/20220513/tumbleweed/repo/debug
./history/20220426/tumbleweed/repo/debug
./history/20220426/tumbleweed/repo/src-oss
./history/20220426/tumbleweed/repo/src-non-oss
./history/20220421/tumbleweed/repo/debug
./history/20220421/tumbleweed/repo/src-oss
./history/20220421/tumbleweed/repo/src-non-oss
./history/20220507/tumbleweed/repo/src-oss
./history/20220507/tumbleweed/repo/src-non-oss
./history/20220507/tumbleweed/repo/debug
./tumbleweed/repo/debug
./ports/aarch64/update/tumbleweed
./ports/armv7hl/update/tumbleweed
./ports/ppc/update/tumbleweed
./ports/armv6hl/update/tumbleweed
./ports/zsystems/update/tumbleweed
./update/tumbleweed-non-oss
./update/tumbleweed
The broken links in history seem to be a bad relative reference, but
the update links are particularly concerning:
fcixadmin@griffin1:/data/mirror/opensuse/opensuse/update$ ls -l
total 17
drwxr-xr-x 13 fcixadmin fcixadmin 13 Dec 3 06:09 leap
drwxr-xr-x 3 fcixadmin fcixadmin 3 Mar 10 04:41 leap-micro
lrwxrwxrwx 1 fcixadmin fcixadmin 14 Mar 10 04:41 leap-micro-current
-> leap-micro/5.2
lrwxrwxrwx 1 fcixadmin fcixadmin 13 Jun 2 2021 openSUSE-current ->
leap/15.3/oss
lrwxrwxrwx 1 fcixadmin fcixadmin 17 Jul 7 2020
openSUSE-non-oss-current -> leap/15.2/non-oss
lrwxrwxrwx 1 fcixadmin fcixadmin 13 Jul 7 2020 openSUSE-stable ->
leap/15.2/oss
lrwxrwxrwx 1 fcixadmin fcixadmin 69 Nov 24 2020 tumbleweed ->
/srv/ftp/pub/opensuse/repositories/openSUSE:/Factory:/Update/standard
lrwxrwxrwx 1 fcixadmin fcixadmin 10 Nov 24 2020 tumbleweed-non-oss
-> tumbleweed
It looks like there's an errant reference to
/srv/ftp/pub/opensuse/repositories/openSUSE:/Factory:/Update/standard
which isn't getting dereferenced for rsync clients, so most mirrors
are not able to host those folders.
I will also point out that the wiki says that the opensuse-full and
opensuse-full-with-factory are supposed to carry all of the contents
of download.opensuse.org, but I've found that the with-factory module
doesn't include ports or source, so I need to run three separate
rsyncs to actually pull in everything.
The fact that the https://mirrors.opensuse.org/ dashboard doesn't
recognize that mirror.fcix.net is carrying everything is also odd.
--
Kenneth Finnegan
Technical Director, FCIX
Updated by pjessen about 2 years ago
- Private changed from Yes to No
kenneth@fcix.net wrote:
It looks like there's an errant reference to
/srv/ftp/pub/opensuse/repositories/openSUSE:/Factory:/Update/standard
which isn't getting dereferenced for rsync clients, so most mirrors
are not able to host those folders.
Yes, that is for Tumbleweed updates, which we don't really "do". (someone might have a better explanation).
It can be done, by sync'ing that bit of repositories/ (and exclude the rest).
I will also point out that the wiki says that the opensuse-full and
opensuse-full-with-factory are supposed to carry all of the contents
of download.opensuse.org, but I've found that the with-factory module
doesn't include ports or source, so I need to run three separate
rsyncs to actually pull in everything.
Yep, it looks like the wiki could do with an update.
The fact that the https://mirrors.opensuse.org/ dashboard doesn't
recognize that mirror.fcix.net is carrying everything is also odd.
That is usually due to incomplete scanning, I'll look into it.