tickets #110064
closedewr.edge.kernel.org mirror for http://download.opensuse.org/update/leap/15.3/sle broken
100%
Description
as of yesterday, I can't update my 15.3 systems.
I think the problem is mirror ewr.edge.kernel.org
see attached file.
when I use curl to get
http://download.opensuse.org/update/leap/15.3/sle/repodata/repomd.xml
it references:
repodata/50e44b75c8f6f912190468fe694bab8ebae370be1f47ebe84fff5cff0e0cdb68-primary.xml.gz
but that's not available on ewr.edge.kernel.org.
(the repomd.xml seems to come directly from download.opensuse.org, the .gz file redirects to ewr.edge.kernel.org)
ewr also doesn't seem to have the latest kernel.
on a system I updated on Sat. it got kernel 5.3.18-150300.59.63-default but ewr only goes up to 5.3.18-150300.59.60-default
Files
Updated by cboltz about 2 years ago
- Tracker changed from action to tickets
- Project changed from openSUSE Leap 15.3 to openSUSE admin
- Subject changed from mirror for http://download.opensuse.org/update/leap/15.3/sle broken to ewr.edge.kernel.org mirror for http://download.opensuse.org/update/leap/15.3/sle broken
- Category set to Mirrors
- Assignee set to pjessen
This looks like a mirror issue, moving to the admin project.
Updated by pjessen about 2 years ago
yes, ewr.edge.kernel.org is currently a bit out of date, but that is something for the scanner to pick up on. My own mirror also has http://download.opensuse.org/update/leap/15.3/sle/repodata with files dated 2022-04-14 17:01. It looks like http://download.opensuse.org/update/leap/15.3/sle/repodata was also just now updated again, mirrors are beginning to pick it up now. I was just now given three mirrors -
Mirrors in other parts of the world:
https://provo-mirror.opensuse.org/update/leap/15.3/sle/repodata/970feef70cbd786e4312437d7b2b59286370e6cb58ea88f3d56639c8727a7cc5-primary.xml.gz (US)
https://mirror-jp.firstyear.id.au/update/leap/15.3/sle/repodata/970feef70cbd786e4312437d7b2b59286370e6cb58ea88f3d56639c8727a7cc5-primary.xml.gz (JP)
https://mirror.firstyear.id.au/update/leap/15.3/sle/repodata/970feef70cbd786e4312437d7b2b59286370e6cb58ea88f3d56639c8727a7cc5-primary.xml.gz (AU)
Updated by pjessen about 2 years ago
- Status changed from New to In Progress
Judging by the rsync logs on pontifex, ewr.edge.kernel.org does not sync directly, I think kernel.org does some CDN stuff. They refresh twice a day, at 1107 and at 2307.
Updated by pjessen about 2 years ago
kernel.org admin suggested we delete ewr.edge.kernel.org and only keep:
da.mirrors.kernel.org (Dallas/US-Central)
ams.edge.kernel.org (Amsterdam/EU-West)
nrt.edge.kernel.org (Tokyo/JP)
We have a few:
# mb show kernel.org
Found multiple matching mirrors:
mirrors.se.eu.kernel.org - was disabled, have deleted.
mirrors1.kernel.org - was disabled, have deleted.
mirrors2.kernel.org - was disabled, have deleted.
sfo-korg-mirror.kernel.org - apparently aka sv.edge.kernel.org
ams.edge.kernel.org
ewr.edge.kernel.org - have disabled, have deleted.
nrt.edge.kernel.org
sjc.edge.kernel.org - have disabled
Updated by pjessen almost 2 years ago
For the record, my deletion of 'ewr.edge.kernel.org ' has failed twice:
# mb delete ewr.edge.kernel.org
Traceback (most recent call last):
File "/usr/bin/mb", line 1729, in <module>
r = mirrordoctor.main()
File "/usr/lib/python2.7/site-packages/cmdln.py", line 261, in main
return self.cmd(args)
File "/usr/lib/python2.7/site-packages/cmdln.py", line 284, in cmd
retval = self.onecmd(argv)
File "/usr/lib/python2.7/site-packages/cmdln.py", line 422, in onecmd
return self._dispatch_cmd(handler, argv)
File "/usr/lib/python2.7/site-packages/cmdln.py", line 1123, in _dispatch_cmd
return handler(argv[0], opts, *args)
File "/usr/bin/mb", line 726, in do_delete
mb.core.delete_mirror(self.conn, identifier)
File "/usr/lib64/python2.7/site-packages/mb/core.py", line 22, in delete_mirror
conn.Server._connection.queryAll(query)
File "/usr/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 449, in queryAll
return self._runWithConnection(self._queryAll, s)
File "/usr/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 342, in _runWithConnection
val = meth(conn, *args)
File "/usr/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 441, in _queryAll
self._executeRetry(conn, c, s)
File "/usr/lib/python2.7/site-packages/sqlobject/postgres/pgconnection.py", line 237, in _executeRetry
raise dberrors.OperationalError(ErrorMessage(e))
sqlobject.dberrors.OperationalError: deadlock detected
DETAIL: Process 11459 waits for ShareLock on transaction 1662200388; blocked by process 12025.
Process 12025 waits for ShareLock on transaction 1661954929; blocked by process 11459.
HINT: See server log for query details.
CONTEXT: while locking tuple (6751736,11) in relation "filearr"
SQL statement "UPDATE filearr
SET mirrors = arr WHERE id = arg_fileid"
PL/pgSQL function mirr_del_byid(integer,integer) line 21 at SQL statement
Updated by pjessen almost 2 years ago
Okay, I managed to delete it.
I have added:
# mb show da.mirrors
identifier : da.mirrors.kernel.org
operatorName : Linux Kernel Archives (US)
operatorUrl : https://mirrors.kernel.org
baseurl : http://da.mirrors.kernel.org/opensuse/
baseurlFtp :
baseurlRsync : rsync://mirrors.kernel.org/opensuse
region : na
country : us
asn : 54825
prefix : 139.178.80.0/21
lat,lng : 32.777,-96.805
regionOnly : False
countryOnly : False
asOnly : False
prefixOnly : False
ipv6Only : False
otherCountries :
fileMaxsize : 0
publicNotes :
score : 100
enabled : False
statusBaseurl : False
admin : Konstantin Ryabitsev
adminEmail : ftpadmin@kernel.org
Updated by pjessen almost 2 years ago
- Status changed from In Progress to Resolved
- % Done changed from 30 to 100
# mb scan -e da.mirrors
Thu Apr 28 08:29:39 2022 da.mirrors.kernel.org: starting
Thu Apr 28 08:35:11 2022 da.mirrors.kernel.org: total files before scan: 0
__DIE__: (/usr/bin/scanner 1124 main::rsync_get_filelist => /usr/bin/scanner 1293 main::muxread => /usr/bin/scanner 1183 main::sread)
Thu Apr 28 08:58:42 2022 da.mirrors.kernel.org: scanned 488574 files (346/s) in 1410s
Thu Apr 28 08:58:42 2022 da.mirrors.kernel.org: files to be purged: 0
Thu Apr 28 09:04:13 2022 da.mirrors.kernel.org: total files after scan: 488574 (delta: 488574)
Thu Apr 28 09:04:13 2022 da.mirrors.kernel.org: purged old files in 331s.
Thu Apr 28 09:04:13 2022 da.mirrors.kernel.org: now enabled.
Thu Apr 28 09:04:13 2022 da.mirrors.kernel.org: done.
Thu Apr 28 09:04:13 2022 da.mirrors.kernel.org: testing status of base URL...
Thu Apr 28 09:04:13 2022 da.mirrors.kernel.org: OK. Mirror is online now.
Completed in 34.6 minutes