Project

General

Profile

Actions

tickets #90839

closed

olaf - mirror lists in html not being generated since 7 April 0900 ?

Added by pjessen about 3 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
Mirrors
Target version:
-
Start date:
2021-04-08
Due date:
% Done:

100%

Estimated time:

Description

I am mostly opening this so I don't forget - somehow the html mirror lists on olaf have stopped being generated, last one was yesterday at 09:00. Remarkably, the txt format lists continue to be generated - and they are both done in the same script.

/srv/www/vhosts/mirrors.opensuse.org/list/

The script /usr/bin/create_mirrorbrain-webpages is run by cron every 30 minutes.

olaf:~ # mb mirrorlist -f xhtml -o klop
Traceback (most recent call last):
  File "/usr/bin/mb", line 1729, in <module>
    r = mirrordoctor.main()
  File "/usr/lib/python2.7/site-packages/cmdln.py", line 261, in main
    return self.cmd(args)
  File "/usr/lib/python2.7/site-packages/cmdln.py", line 284, in cmd
    retval = self.onecmd(argv)
  File "/usr/lib/python2.7/site-packages/cmdln.py", line 422, in onecmd
    return self._dispatch_cmd(handler, argv)
  File "/usr/lib/python2.7/site-packages/cmdln.py", line 1123, in _dispatch_cmd
    return handler(argv[0], opts, *args)
  File "/usr/bin/mb", line 1546, in do_mirrorlist
    mb.mirrorlists.genlist(conn=self.conn, opts=opts, mirrors=mirrors, markers=markers, format=opts.format)
  File "/usr/lib64/python2.7/site-packages/mb/mirrorlists.py", line 40, in genlist
    for i in gen:
  File "/usr/lib64/python2.7/site-packages/mb/mirrorlists.py", line 233, in xhtml
    % (6 + markers_cnt, region_name[region])
KeyError: ''
Actions #1

Updated by pjessen about 3 years ago

  • Private changed from Yes to No

Well, that traceback gave me a hint - a mirror with no region. Same thing that happened with the Chinese mirrors that I added recently. The newest mirror "easylee" does not have a region either. There must be something wrong with the maxmind data or the way we access it.
Temporary fix, edit "easylee" and update region to say 'eu'.

Actions #2

Updated by bmwiedemann about 3 years ago

For some reason, postgresql on mirrordb2 was dead. download.o.o started to work better after switching it to mirrordb1.

We should get the local pgbouncer properly configured, because the one on anna adds random delays between 80 and 300 ms

Actions #3

Updated by bmwiedemann about 3 years ago

  • Status changed from New to Feedback
  • % Done changed from 0 to 50

Using https://gitlab.infra.opensuse.org/infra/salt/-/merge_requests/481 for increased Write-Ahead-Log, mirrordb2 is (since 6d) synced properly and used again by download.o.o for its read accesses.

Can you confirm that your problem is solved, too?

Actions #4

Updated by pjessen about 3 years ago

  • Status changed from Feedback to In Progress

bmwiedemann wrote:

Can you confirm that your problem is solved, too?

Yep, I confirm, the mirrors page is being properly generated. AFAICT, my problem was the empty region field, which is being tracked in a different ticket.

Actions #5

Updated by pjessen about 3 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 50 to 100
Actions

Also available in: Atom PDF