Project

General

Profile

Actions

tickets #110064

closed

ewr.edge.kernel.org mirror for http://download.opensuse.org/update/leap/15.3/sle broken

Added by koutsofios about 2 years ago. Updated almost 2 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Mirrors
Target version:
-
Start date:
2022-04-18
Due date:
% Done:

100%

Estimated time:

Description

as of yesterday, I can't update my 15.3 systems.
I think the problem is mirror ewr.edge.kernel.org
see attached file.

when I use curl to get
http://download.opensuse.org/update/leap/15.3/sle/repodata/repomd.xml
it references:
repodata/50e44b75c8f6f912190468fe694bab8ebae370be1f47ebe84fff5cff0e0cdb68-primary.xml.gz
but that's not available on ewr.edge.kernel.org.
(the repomd.xml seems to come directly from download.opensuse.org, the .gz file redirects to ewr.edge.kernel.org)

ewr also doesn't seem to have the latest kernel.
on a system I updated on Sat. it got kernel 5.3.18-150300.59.63-default but ewr only goes up to 5.3.18-150300.59.60-default


Files

zypper.log (3.92 KB) zypper.log output of zypper -vvv ref koutsofios, 2022-04-18 17:51
Actions #1

Updated by cboltz about 2 years ago

  • Tracker changed from action to tickets
  • Project changed from openSUSE Leap 15.3 to openSUSE admin
  • Subject changed from mirror for http://download.opensuse.org/update/leap/15.3/sle broken to ewr.edge.kernel.org mirror for http://download.opensuse.org/update/leap/15.3/sle broken
  • Category set to Mirrors
  • Assignee set to pjessen

This looks like a mirror issue, moving to the admin project.

Actions #2

Updated by pjessen about 2 years ago

yes, ewr.edge.kernel.org is currently a bit out of date, but that is something for the scanner to pick up on. My own mirror also has http://download.opensuse.org/update/leap/15.3/sle/repodata with files dated 2022-04-14 17:01. It looks like http://download.opensuse.org/update/leap/15.3/sle/repodata was also just now updated again, mirrors are beginning to pick it up now. I was just now given three mirrors -

Mirrors in other parts of the world:
    https://provo-mirror.opensuse.org/update/leap/15.3/sle/repodata/970feef70cbd786e4312437d7b2b59286370e6cb58ea88f3d56639c8727a7cc5-primary.xml.gz (US)
    https://mirror-jp.firstyear.id.au/update/leap/15.3/sle/repodata/970feef70cbd786e4312437d7b2b59286370e6cb58ea88f3d56639c8727a7cc5-primary.xml.gz (JP)
    https://mirror.firstyear.id.au/update/leap/15.3/sle/repodata/970feef70cbd786e4312437d7b2b59286370e6cb58ea88f3d56639c8727a7cc5-primary.xml.gz (AU)
Actions #3

Updated by pjessen about 2 years ago

  • Status changed from New to In Progress

Judging by the rsync logs on pontifex, ewr.edge.kernel.org does not sync directly, I think kernel.org does some CDN stuff. They refresh twice a day, at 1107 and at 2307.

Actions #4

Updated by pjessen about 2 years ago

  • % Done changed from 0 to 30

I have written to the admin.

Actions #5

Updated by pjessen about 2 years ago

kernel.org admin suggested we delete ewr.edge.kernel.org and only keep:

da.mirrors.kernel.org (Dallas/US-Central)
ams.edge.kernel.org (Amsterdam/EU-West)
nrt.edge.kernel.org (Tokyo/JP)

We have a few:

# mb show kernel.org
Found multiple matching mirrors:
mirrors.se.eu.kernel.org     - was disabled, have deleted.
mirrors1.kernel.org          - was disabled, have deleted.
mirrors2.kernel.org          - was disabled, have deleted.
sfo-korg-mirror.kernel.org   - apparently aka sv.edge.kernel.org
ams.edge.kernel.org
ewr.edge.kernel.org          - have disabled, have deleted.
nrt.edge.kernel.org
sjc.edge.kernel.org          - have disabled
Actions #6

Updated by pjessen almost 2 years ago

For the record, my deletion of 'ewr.edge.kernel.org ' has failed twice:

# mb delete ewr.edge.kernel.org
Traceback (most recent call last):
  File "/usr/bin/mb", line 1729, in <module>
    r = mirrordoctor.main()
  File "/usr/lib/python2.7/site-packages/cmdln.py", line 261, in main
    return self.cmd(args)
  File "/usr/lib/python2.7/site-packages/cmdln.py", line 284, in cmd
    retval = self.onecmd(argv)
  File "/usr/lib/python2.7/site-packages/cmdln.py", line 422, in onecmd
    return self._dispatch_cmd(handler, argv)
  File "/usr/lib/python2.7/site-packages/cmdln.py", line 1123, in _dispatch_cmd
    return handler(argv[0], opts, *args)
  File "/usr/bin/mb", line 726, in do_delete
    mb.core.delete_mirror(self.conn, identifier)
  File "/usr/lib64/python2.7/site-packages/mb/core.py", line 22, in delete_mirror
    conn.Server._connection.queryAll(query)
  File "/usr/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 449, in queryAll
    return self._runWithConnection(self._queryAll, s)
  File "/usr/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 342, in _runWithConnection
    val = meth(conn, *args)
  File "/usr/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 441, in _queryAll
    self._executeRetry(conn, c, s)
  File "/usr/lib/python2.7/site-packages/sqlobject/postgres/pgconnection.py", line 237, in _executeRetry
    raise dberrors.OperationalError(ErrorMessage(e))
sqlobject.dberrors.OperationalError: deadlock detected
DETAIL:  Process 11459 waits for ShareLock on transaction 1662200388; blocked by process 12025.
Process 12025 waits for ShareLock on transaction 1661954929; blocked by process 11459.
HINT:  See server log for query details.
CONTEXT:  while locking tuple (6751736,11) in relation "filearr"
SQL statement "UPDATE filearr 
            SET mirrors = arr WHERE id = arg_fileid"
PL/pgSQL function mirr_del_byid(integer,integer) line 21 at SQL statement
Actions #7

Updated by pjessen almost 2 years ago

Okay, I managed to delete it.

I have added:

# mb show da.mirrors
identifier     : da.mirrors.kernel.org
operatorName   : Linux Kernel Archives (US)
operatorUrl    : https://mirrors.kernel.org
baseurl        : http://da.mirrors.kernel.org/opensuse/
baseurlFtp     : 
baseurlRsync   : rsync://mirrors.kernel.org/opensuse
region         : na
country        : us
asn            : 54825
prefix         : 139.178.80.0/21
lat,lng        : 32.777,-96.805
regionOnly     : False
countryOnly    : False
asOnly         : False
prefixOnly     : False
ipv6Only       : False
otherCountries : 
fileMaxsize    : 0
publicNotes    : 
score          : 100
enabled        : False
statusBaseurl  : False
admin          : Konstantin Ryabitsev
adminEmail     : ftpadmin@kernel.org
Actions #8

Updated by pjessen almost 2 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 30 to 100
# mb scan -e da.mirrors
Thu Apr 28 08:29:39 2022 da.mirrors.kernel.org: starting
Thu Apr 28 08:35:11 2022 da.mirrors.kernel.org: total files before scan: 0
__DIE__: (/usr/bin/scanner 1124 main::rsync_get_filelist => /usr/bin/scanner 1293 main::muxread => /usr/bin/scanner 1183 main::sread)
Thu Apr 28 08:58:42 2022 da.mirrors.kernel.org: scanned 488574 files (346/s) in 1410s
Thu Apr 28 08:58:42 2022 da.mirrors.kernel.org: files to be purged: 0
Thu Apr 28 09:04:13 2022 da.mirrors.kernel.org: total files after scan: 488574 (delta: 488574)
Thu Apr 28 09:04:13 2022 da.mirrors.kernel.org: purged old files in 331s.
Thu Apr 28 09:04:13 2022 da.mirrors.kernel.org: now enabled.
Thu Apr 28 09:04:13 2022 da.mirrors.kernel.org: done.
Thu Apr 28 09:04:13 2022 da.mirrors.kernel.org: testing status of base URL...
Thu Apr 28 09:04:13 2022 da.mirrors.kernel.org: OK. Mirror is online now.
Completed in 34.6 minutes
Actions

Also available in: Atom PDF