tickets #90839
closedolaf - mirror lists in html not being generated since 7 April 0900 ?
100%
Description
I am mostly opening this so I don't forget - somehow the html mirror lists on olaf have stopped being generated, last one was yesterday at 09:00. Remarkably, the txt format lists continue to be generated - and they are both done in the same script.
/srv/www/vhosts/mirrors.opensuse.org/list/
The script /usr/bin/create_mirrorbrain-webpages is run by cron every 30 minutes.
olaf:~ # mb mirrorlist -f xhtml -o klop
Traceback (most recent call last):
File "/usr/bin/mb", line 1729, in <module>
r = mirrordoctor.main()
File "/usr/lib/python2.7/site-packages/cmdln.py", line 261, in main
return self.cmd(args)
File "/usr/lib/python2.7/site-packages/cmdln.py", line 284, in cmd
retval = self.onecmd(argv)
File "/usr/lib/python2.7/site-packages/cmdln.py", line 422, in onecmd
return self._dispatch_cmd(handler, argv)
File "/usr/lib/python2.7/site-packages/cmdln.py", line 1123, in _dispatch_cmd
return handler(argv[0], opts, *args)
File "/usr/bin/mb", line 1546, in do_mirrorlist
mb.mirrorlists.genlist(conn=self.conn, opts=opts, mirrors=mirrors, markers=markers, format=opts.format)
File "/usr/lib64/python2.7/site-packages/mb/mirrorlists.py", line 40, in genlist
for i in gen:
File "/usr/lib64/python2.7/site-packages/mb/mirrorlists.py", line 233, in xhtml
% (6 + markers_cnt, region_name[region])
KeyError: ''
Updated by pjessen about 3 years ago
- Private changed from Yes to No
Well, that traceback gave me a hint - a mirror with no region. Same thing that happened with the Chinese mirrors that I added recently. The newest mirror "easylee" does not have a region either. There must be something wrong with the maxmind data or the way we access it.
Temporary fix, edit "easylee" and update region to say 'eu'.
Updated by bmwiedemann about 3 years ago
For some reason, postgresql on mirrordb2 was dead. download.o.o started to work better after switching it to mirrordb1.
We should get the local pgbouncer properly configured, because the one on anna adds random delays between 80 and 300 ms
Updated by bmwiedemann about 3 years ago
- Status changed from New to Feedback
- % Done changed from 0 to 50
Using https://gitlab.infra.opensuse.org/infra/salt/-/merge_requests/481 for increased Write-Ahead-Log, mirrordb2 is (since 6d) synced properly and used again by download.o.o for its read accesses.
Can you confirm that your problem is solved, too?
Updated by pjessen about 3 years ago
- Status changed from Feedback to In Progress
bmwiedemann wrote:
Can you confirm that your problem is solved, too?
Yep, I confirm, the mirrors page is being properly generated. AFAICT, my problem was the empty region field, which is being tracked in a different ticket.
Updated by pjessen about 3 years ago
- Status changed from In Progress to Resolved
- % Done changed from 50 to 100