Project

General

Profile

Actions

tickets #77701

open

post-mortem - mailing list migration

Added by pjessen over 3 years ago. Updated 5 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Email
Target version:
-
Start date:
2020-11-11
Due date:
% Done:

0%

Estimated time:

Description

I think keeping this is as a separate ticket is better than continuing one of the others.
First of all, I think it went very well, overall. Good work, Stasiek, Neal.

There is however also room for improvement :-)

  • opensuse-de – “Der Beitrag $ mlist.fqdn_listname” …. something is not right.
  • opensuse-de – had a listname prefix added, I have removed it.
  • superfluous MIME encoding of subjects.
  • superfluous base64 encoding of content.
  • admin mailing list – get rid of the footers. The template “list:member:regular:footer” seems to be empty ??
  • X-Mailing-List – we should/could have retained it. I cannot figure out how to do it though.
  • sending user notifications with envelope address = admin@o.o was perhaps not so clever, but shit happens, btdt.
  • mailman3::postfix – I did a few minor updates.
  • studio-express – I thought I had suggested not to touch that, but maybe I forgot.
  • lists.o.o – still being redirected to “archives/” ?
  • lists.o.o – signin-in: we have to get of that userid/password form. It will come back to bite us.
  • admin.lists – have updated max msg size to 100kb.
  • searching for a list - https://lists.opensuse.org/manage/lists/?all-lists – cumbersome, but at least I can type in the name directly.
  • ml-admin@o.o - [Django] ERROR (EXTERNAL IP): Internal Server Error ??
  • archives – how can I view the source of a message? Is download the only option?
  • archives – in the downloaded message, virtually all headers have been deleted?
  • timestamps everywhere - I don’t want am/pm time, I want a 24hour clock. (personal setting?)
  • DKIM signature being removed? Dan Cermak sent a message to project.lists, it appears to have had a DKIM signature, but it was not included when the posting was distributed. I could be wrong, but I can’t see the full source in the archive :-)
  • bugs.list - mails from bugzilla are not being let through.
  • SUSE DMARC – 24 hours later, still has not been changed. "v=DMARC1; p=none; rua=mailto:7wbsqica@ag.dmarcian.eu; sp=none;"
  • bugzilla still sends mails without DKIM signature.

Files

Screenshot_20210331_192923.jpeg (20.9 KB) Screenshot_20210331_192923.jpeg pjessen, 2021-03-31 17:31
opensuse-2007-06 (95.2 KB) opensuse-2007-06 hellcp, 2021-04-04 20:30
notfound.ReallyFull.ids (231 Bytes) notfound.ReallyFull.ids the ids I can't find robin_listas, 2021-04-06 16:56
opensuse-2007-06-missing_messages.mbox.xz (9.33 KB) opensuse-2007-06-missing_messages.mbox.xz the 8 missing emails robin_listas, 2021-04-06 19:19
pruned.2007tremis.mbox.xz (1.71 MB) pruned.2007tremis.mbox.xz robin_listas, 2021-04-07 20:59

Checklist

  • bugs.list - mails from bugzilla are not being let through.
  • wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o
  • direct outbound delivery instead of via the proxy? (baloo always used the proxies).
  • mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?
  • mailman3: have added body check for delayed mail notifications
  • max mail sizes? with mlmmj, only three lists had a maximum size setting.
  • where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb.
  • list-specific archive accesses - redirect ? (see text)
  • rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times.
  • need to investigate the nntp setup
  • ease of customising the hyperkitty interface?
  • full audit of all lists, make sure we have all the right settings from baloo
  • 24 hour clock instead of 12hour clock
  • [Django] ERROR (EXTERNAL IP): Internal Server Error
  • bounce messages are not kept by mailman, makes debugging impssible
Actions #1

Updated by pjessen over 3 years ago

  • Private changed from Yes to No
  • need to remove footers from bugs.lists.
Actions #2

Updated by pjessen over 3 years ago

  • disable the administrivia check ? Carlos proposed we consider this.
Actions #3

Updated by pjessen over 3 years ago

mailman3:

# less /var/log/mail
mktemp: failed to create file via template ‘/tmp/less.XXXXXXXXX’: Permission denied

Something wrong in /etc/resolv.conf:

# host google.com
host: parse of /etc/resolv.conf failed
Actions #4

Updated by cboltz over 3 years ago

lists.o.o – still being redirected to “archives/” ?

s/still/now/

That was an intentional change, see #77278. (The current redirect isn't set into stone, so if you have a better idea, tell us ;-)

On a more general note - maybe we should convert the "actionable" items (like "disable footer") in this ticket to a checklist? In the current way, it's easy to overlook something.

Actions #5

Updated by pjessen over 3 years ago

cboltz wrote:

lists.o.o – still being redirected to “archives/” ?

s/still/now/

That was an intentional change, see #77278. (The current redirect isn't set into stone, so if you have a better idea, tell us ;-)

Plenty of ideas, but probably not better :-).

I guess I was surprised to be presented with that list when I was logged in.
Hmm, having thought about it, it's probably the best option.

On a more general note - maybe we should convert the "actionable" items (like "disable footer") in this ticket to a checklist? In the current way, it's easy to overlook something.

Yeah, I was wondering whether to use a checklist instead.

Actions #6

Updated by pjessen over 3 years ago

  • Checklist item changed from to [x] bugs.list - mails from bugzilla are not being let through.
Actions #7

Updated by cboltz over 3 years ago

  • Checklist item changed from [x] bugs.list - mails from bugzilla are not being let through. to [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o
Actions #8

Updated by pjessen over 3 years ago

There is something wrong, it looks like some lists are being mistaken for each other?

Example:
https://lists.opensuse.org/manage/lists/yast-commit.lists.opensuse.org/held_messages
Look at the message "Apple iPad Pro" - in the source, it was clearly sent to "yast-devel@opensuse.org", redirected to "yast-devel@lists.opensuse.org", so why does it end up in the moderator queue for "yast-commit" ? Also, the same message seems to be queued here:
https://lists.opensuse.org/manage/lists/yast-devel.lists.opensuse.org/held_messages

At https://lists.opensuse.org/manage/lists/election-officials.lists.opensuse.org/held_messages
a lot of messages apparently sent to opensuse-project, so why are they queued under election-officials??

Look at the whole queue of held messages, further down there are messages from this morning, but for factory ??

Actions #9

Updated by pjessen over 3 years ago

  • Checklist item changed from [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o to [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies).
Actions #10

Updated by pjessen over 3 years ago

  • Checklist item changed from [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies). to [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications
Actions #11

Updated by pjessen over 3 years ago

  • Checklist item changed from [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications to [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting.
Actions #12

Updated by pjessen over 3 years ago

  • Checklist item changed from [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting. to [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb.

The many mails going to mailman are from a cronjob, telling us every minute:

/usr/lib/python3.6/site-packages/readme_renderer/markdown.py:38: UserWarning: Markdown renderers are not available. Install 'readme_render[md]' to enable Markdown rendering.
  warnings.warn(_EXTRA_WARNING)
Error: None of the config files exist.

It might be useful to have cron output sent to ml-admin instead, dunno.

Actions #13

Updated by pjessen over 3 years ago

Recommend adding this to your /etc/hosts -

127.0.0.1 seccdn.libravatar.org

Will speed up held messages by 2-3 seconds per message.

Actions #14

Updated by pjessen over 3 years ago

  • Checklist item changed from [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb. to [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text)

The archives on baloo are accessed directly, primarily by robots. 200K-300K daily requests.

I propose something along these lines:
/oldlistname/yyyy-0m/ -> /archives/list/newlistname@lists.opensuse.org/yyy/m
/oldlistname/yyyy-1m/ -> /archives/list/newlistname@lists.opensuse.org/yyy/1m
/oldlistname/ -> /archives/list/newlistname@lists.opensuse.org/

All 301 redirects, "moved permanently". I think that ought to work for all the robots, and also for users that are seeking a specific message, e.g. after a google search ? The mapping from oldlistname to newlistname should be easy to do with a rewritemap. comments?

Actions #15

Updated by pjessen over 3 years ago

  • Checklist item changed from [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text) to [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text), [ ] rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times.
Actions #16

Updated by pjessen over 3 years ago

  • Checklist item changed from [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text), [ ] rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times. to [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text), [ ] rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times., [ ] need to investigate the nntp setup, [ ] ease of customising the hyperkitty interface?, [ ] full audit of all lists, make sure we have all the right settings from baloo
  • We need to do a full audit of all lists, make sure we have the right settings from baloo. Maybe look for owners and moderators at the same time?
  • I think I might take a look at enabling the nntp interface or at least get to know how it works.
  • As some people have pointed out on users.list, the hyperkitty interface is helplessly bloated, full of unnecessary stuff. Even if you don't read the lists via the archive, it is not very practical. (I was particularly missing a threaded look, with subject lines stacked and indented?)
  • Third, this post mortem list is for everyone to help out with, I'm only collecting the items :-)
Actions #17

Updated by pjessen over 3 years ago

wrt checklist item #2 - "wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o", I don't know where to really fix it, somewhere in mailman I presume, but for the time being I have rerouted "$list-bounces@opensuse.org" to "$list-bounces@lists.opensuse.org" on mx12.

Actions #18

Updated by pjessen over 3 years ago

  • Checklist item changed from to [x] need to investigate the nntp setup
Actions #19

Updated by pjessen over 3 years ago

mailman has the option of gating posts to an NNTP server, that's nice.

Actions #20

Updated by pjessen over 3 years ago

pjessen wrote:

The many mails going to mailman are from a cronjob, telling us every minute:

/usr/lib/python3.6/site-packages/readme_renderer/markdown.py:38: UserWarning: Markdown renderers are not available. Install 'readme_render[md]' to enable Markdown rendering.
  warnings.warn(_EXTRA_WARNING)
Error: None of the config files exist.

It might be useful to have cron output sent to ml-admin instead, dunno.

The mailman crontab "/var/spool/cron/tabs/mailman" appears to have double entries, which only causes twice the amount of mail.

Actions #21

Updated by pjessen over 3 years ago

  • Checklist item changed from [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text), [ ] rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times., [x] need to investigate the nntp setup, [ ] ease of customising the hyperkitty interface?, [ ] full audit of all lists, make sure we have all the right settings from baloo to [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text), [ ] rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times., [x] need to investigate the nntp setup, [ ] ease of customising the hyperkitty interface?, [ ] full audit of all lists, make sure we have all the right settings from baloo, [ ] 24 hour clock instead of 12hour clock

I have looked at the 12/24h clock issue, even asked on the mailman list.

I added a file "/var/lib/mailman_webui/settings_local.py" containing

USE_L10N = True
TIME_FORMAT = 'H'                                                                                                                                                         

and then added this to "/var/lib/mailman_webui/settings.py"

try:
    from settings_local import *
except ImportError:
    pass

Not knowing any Python, I am on very thin ice here :-)

I also tried adding LC_CTYPE=en_GB.UTF-8 to the environment before starting mailman_webui. Neither idea made any differences.

Actions #22

Updated by hellcp over 3 years ago

pjessen wrote:

I have looked at the 12/24h clock issue, even asked on the mailman list.

I added a file "/var/lib/mailman_webui/settings_local.py" containing

USE_L10N = True
TIME_FORMAT = 'H'                                                                                                                                                         

and then added this to "/var/lib/mailman_webui/settings.py"

try:
    from settings_local import *
except ImportError:
    pass

Since settings.py is salted, you can just directly modify that (and if the changes work add it to salt repo). I will have a look later to see what's up with that.

Actions #23

Updated by pjessen over 3 years ago

[Django] ERROR (EXTERNAL IP): Internal Server Error

I guess this is someone attempting to access a Django 'app' that we don't have. Maybe we should just update nginx not to forward those requests.

Actions #24

Updated by pjessen over 3 years ago

  • Checklist item changed from [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text), [ ] rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times., [x] need to investigate the nntp setup, [ ] ease of customising the hyperkitty interface?, [ ] full audit of all lists, make sure we have all the right settings from baloo, [ ] 24 hour clock instead of 12hour clock to [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text), [ ] rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times., [x] need to investigate the nntp setup, [ ] ease of customising the hyperkitty interface?, [ ] full audit of all lists, make sure we have all the right settings from baloo, [ ] 24 hour clock instead of 12hour clock, [ ] [Django] ERROR (EXTERNAL IP): Internal Server Error
Actions #25

Updated by pjessen over 3 years ago

The subscribe/unsubscribe links in the old archives were obviously never updated, but they seem to be used quite a bit. I have done a mass-edit and updated the following:

forums-admin/index.cgi
heroes/index.cgi
kernel-bugs/index.cgi
kubic-bugs/index.cgi
libeconf-devel/index.cgi
libyui-commit/index.cgi
mirror/index.cgi
mysql-packaging/index.cgi
obs-commits/index.cgi
obs-devel/index.cgi
obs-tests/index.cgi
opensuse-announce/index.cgi
opensuse-arm/index.cgi
opensuse-artwork/index.cgi
opensuse-autoinstall/index.cgi
opensuse-bugs/index.cgi
opensuse-bugshare/index.cgi
opensuse-buildservice/index.cgi
opensuse-cloud/index.cgi
opensuse-commit/index.cgi
opensuse-conference/index.cgi
opensuse-cz/index.cgi
opensuse-de/index.cgi
opensuse-doc/index.cgi
opensuse-edu/index.cgi
opensuse-el/index.cgi
opensuse-es/index.cgi
opensuse-factory-mozilla/index.cgi
opensuse-factory/index.cgi
opensuse-features/index.cgi
opensuse-fr/index.cgi
opensuse-gnome/index.cgi
opensuse-go/index.cgi
opensuse-ha/index.cgi
opensuse-haskell/index.cgi
opensuse-hu/index.cgi
opensuse-isdn-de/index.cgi
opensuse-ja/index.cgi
opensuse-kde/index.cgi
opensuse-kde3/index.cgi
opensuse-kernel/index.cgi
opensuse-kubic/index.cgi
opensuse-m17n/index.cgi
opensuse-marketing/index.cgi
opensuse-optimize/index.cgi
opensuse-packaging/index.cgi
opensuse-ppc/index.cgi
opensuse-programming/index.cgi
opensuse-project/index.cgi
opensuse-proofreading/index.cgi
opensuse-pt/index.cgi
opensuse-python/index.cgi
opensuse-releaseteam/index.cgi
opensuse-ruby/index.cgi
opensuse-science/index.cgi
opensuse-security-announce/index.cgi
opensuse-security/index.cgi
opensuse-summit/index.cgi
opensuse-support/index.cgi
opensuse-test/index.cgi
opensuse-translation-commit/index.cgi
opensuse-translation-de/index.cgi
opensuse-translation-el/index.cgi
opensuse-translation-es/index.cgi
opensuse-translation-fr/index.cgi
opensuse-translation/index.cgi
opensuse-updates/index.cgi
opensuse-virtual/index.cgi
opensuse-web-de/index.cgi
opensuse-web/index.cgi
opensuse-wiki/index.cgi
opensuse-xfce/index.cgi
opensuse-zsystems/index.cgi
opensuse/index.cgi
studio-express/index.cgi
ulp-devel/index.cgi
uyuni-announce/index.cgi
uyuni-devel/index.cgi
uyuni-translation/index.cgi
uyuni-users/index.cgi
wicked-commit/index.cgi
wicked-devel/index.cgi
wicked/index.cgi
yast-commit/index.cgi
yast-devel/index.cgi
zypp-commit/index.cgi
zypp-devel/index.cgi

The following were not updated:

yast-announce/index.cgi
vhostmd/index.cgi
radeonhd/index.cgi
proxy-suite/index.cgi
packet-writing/index.cgi
packet-writing-announce/index.cgi
opensuse-zh/index.cgi
opensuse-xorg/index.cgi
opensuse-women/index.cgi
opensuse-wiki-de/index.cgi
opensuse-ux/index.cgi
opensuse-translation-sk/index.cgi
opensuse-translation-ru/index.cgi
opensuse-translation-hu/index.cgi
opensuse-testing/index.cgi
opensuse-storage/index.cgi
opensuse-squeegee/index.cgi
opensuse-softwaremgmt/index.cgi
opensuse-ru/index.cgi
opensuse-programming-de/index.cgi
opensuse-pl/index.cgi
opensuse-osc14/index.cgi
opensuse-osc13/index.cgi
opensuse-osc12/index.cgi
opensuse-nl/index.cgi
opensuse-networking/index.cgi
opensuse-multimedia/index.cgi
opensuse-multimedia-de/index.cgi
opensuse-mobile/index.cgi
opensuse-mobile-de/index.cgi
opensuse-mingw/index.cgi
opensuse-medical/index.cgi
opensuse-maintenance/index.cgi
opensuse-lxde/index.cgi
opensuse-java/index.cgi
opensuse-it/index.cgi
opensuse-invis/index.cgi
opensuse-infrastructure/index.cgi
opensuse-ia64/index.cgi
opensuse-ham/index.cgi
opensuse-ham-de/index.cgi
opensuse-goblin/index.cgi
opensuse-foundation/index.cgi
opensuse-factory-graphics/index.cgi
opensuse-factory-base/index.cgi
opensuse-edu-de/index.cgi
opensuse-da/index.cgi
opensuse-contrib/index.cgi
opensuse-ceph/index.cgi
opensuse-boosters/index.cgi
opensuse-board/index.cgi
opensuse-bar/index.cgi
opensuse-amd64/index.cgi
opensuse-ambassadors/index.cgi
opensuse-ambassadors-north-america/index.cgi
opensuse-ambassadors-netherlands/index.cgi
opensuse-ambassadors-chinese/index.cgi
opensuse-ambassadors-australia/index.cgi
limal-devel/index.cgi
limal-commit/index.cgi
libyui-devel/index.cgi
blinux/index.cgi
blinux-de/index.cgi
python/index.cgi
Actions #26

Updated by hellcp over 3 years ago

I submitted MR to hyperkitty to add rss feeds: https://gitlab.com/mailman/hyperkitty/-/merge_requests/302

Actions #27

Updated by hellcp over 3 years ago

Removed the login box from the login screen https://lists.opensuse.org/accounts/login/

Actions #28

Updated by pjessen over 3 years ago

hellcp wrote:

Removed the login box from the login screen https://lists.opensuse.org/accounts/login/

Nice one, I'm sure that will prevent a lot of confusion.

Actions #29

Updated by pjessen over 3 years ago

pjessen wrote:

mailman3:

# less /var/log/mail
mktemp: failed to create file via template ‘/tmp/less.XXXXXXXXX’: Permission denied

Something wrong in /etc/resolv.conf:

# host google.com
host: parse of /etc/resolv.conf failed

mailman3 /etc/resolv.conf contents:

options attempts:1 timeout:1 rotateattempts:1 timeout:1
search infra.opensuse.org
nameserver 192.168.47.101
nameserver 192.168.47.102192.168.47.101
nameserver 192.168.47.102

salt issue ?

Actions #30

Updated by hellcp over 3 years ago

pjessen wrote:

pjessen wrote:

mailman3:

# less /var/log/mail
mktemp: failed to create file via template ‘/tmp/less.XXXXXXXXX’: Permission denied

Something wrong in /etc/resolv.conf:

# host google.com
host: parse of /etc/resolv.conf failed

mailman3 /etc/resolv.conf contents:

options attempts:1 timeout:1 rotateattempts:1 timeout:1
search infra.opensuse.org
nameserver 192.168.47.101
nameserver 192.168.47.102192.168.47.101
nameserver 192.168.47.102

salt issue ?

This happens with most salted vms, so I would guess so

Actions #31

Updated by cboltz over 3 years ago

This affects only two (quite new) VMs:

# salt \* cmd.run 'grep "192.*192" /etc/resolv.conf'  # shortened to matching VMs
moodle.infra.opensuse.org:
    nameserver 192.168.47.102192.168.47.101
mailman3.infra.opensuse.org:
    nameserver 192.168.47.102192.168.47.101

On mailman3, a testhighstate warned about the problem (as warning, not as patch), and after fixing it manually, it seems to be happy and doesn't propose additional resolv.conf changes. (Sidenote: There seem to be various manual changes in salt-managed files, therefore I didn't run highstate. Please make sure to get these manual changes into the salt repo ;-) - if needed, I'll of course help.)

moodle doesn't let me in via ssh (we don't even have a pillar/id/ file for it -> TODO list), therefore I used salt cmd.run to fix the resolv.conf with sed.

Actions #32

Updated by pjessen over 3 years ago

With respect to the item "[Django] ERROR (EXTERNAL IP): Internal Server Error ", I see four typical URLs:

/accounts/github
/accounts/gitlab
/accounts/google
/accounts/stackexchange

I am tempted to just return a 404 (from nginx.conf) whenever those are requested, does anyone see an issue in that?

Actions #33

Updated by hellcp over 3 years ago

pjessen wrote:

With respect to the item "[Django] ERROR (EXTERNAL IP): Internal Server Error ", I see four typical URLs:

/accounts/github
/accounts/gitlab
/accounts/google
/accounts/stackexchange

I am tempted to just return a 404 (from nginx.conf) whenever those are requested, does anyone see an issue in that?

That means we have 4 misconfigured account providers and should fix it in config instead of covering it up:
https://django-allauth.readthedocs.io/en/latest/providers.html

Actions #34

Updated by pjessen about 3 years ago

  • Checklist item changed from [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text), [ ] rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times., [x] need to investigate the nntp setup, [ ] ease of customising the hyperkitty interface?, [ ] full audit of all lists, make sure we have all the right settings from baloo, [ ] 24 hour clock instead of 12hour clock, [ ] [Django] ERROR (EXTERNAL IP): Internal Server Error to [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text), [ ] rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times., [x] need to investigate the nntp setup, [ ] ease of customising the hyperkitty interface?, [ ] full audit of all lists, make sure we have all the right settings from baloo, [ ] 24 hour clock instead of 12hour clock, [ ] [Django] ERROR (EXTERNAL IP): Internal Server Error, [ ] bounce messages are not kept by mailman, makes debugging impssible
Actions #35

Updated by hellcp about 3 years ago

  • Checklist item changed from [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text), [ ] rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times., [x] need to investigate the nntp setup, [ ] ease of customising the hyperkitty interface?, [ ] full audit of all lists, make sure we have all the right settings from baloo, [ ] 24 hour clock instead of 12hour clock, [ ] [Django] ERROR (EXTERNAL IP): Internal Server Error, [ ] bounce messages are not kept by mailman, makes debugging impssible to [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text), [ ] rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times., [x] need to investigate the nntp setup, [ ] ease of customising the hyperkitty interface?, [ ] full audit of all lists, make sure we have all the right settings from baloo, [ ] 24 hour clock instead of 12hour clock, [x] [Django] ERROR (EXTERNAL IP): Internal Server Error, [ ] bounce messages are not kept by mailman, makes debugging impssible

I think this is fixed now, since I fixed the /accounts addresses to work properly

Actions #36

Updated by hellcp about 3 years ago

  • Checklist item changed from [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text), [ ] rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times., [x] need to investigate the nntp setup, [ ] ease of customising the hyperkitty interface?, [ ] full audit of all lists, make sure we have all the right settings from baloo, [ ] 24 hour clock instead of 12hour clock, [x] [Django] ERROR (EXTERNAL IP): Internal Server Error, [ ] bounce messages are not kept by mailman, makes debugging impssible to [x] bugs.list - mails from bugzilla are not being let through., [ ] wrong envelope-from $list-bounces@opensuse.org, should be @lists.o.o, [ ] direct outbound delivery instead of via the proxy? (baloo always used the proxies)., [ ] mailman3: have set postfix message size limit to 10M. 1M ought to be sufficient though?, [x] mailman3: have added body check for delayed mail notifications, [ ] max mail sizes? with mlmmj, only three lists had a maximum size setting., [ ] where should mails to mailman go? right now they are just creating a huge mailbox, currently 246811 mails, 431Mb., [ ] list-specific archive accesses - redirect ? (see text), [x] rss feed - on baloo, mhonarc generates a mailing.rss, yesterday it was fetched 5000 times., [x] need to investigate the nntp setup, [ ] ease of customising the hyperkitty interface?, [ ] full audit of all lists, make sure we have all the right settings from baloo, [ ] 24 hour clock instead of 12hour clock, [x] [Django] ERROR (EXTERNAL IP): Internal Server Error, [ ] bounce messages are not kept by mailman, makes debugging impssible

Oh yeah, I fixed this a while back: https://lists.opensuse.org/archives/list/factory@lists.opensuse.org/feed/ for example

I reported an issue for 24H clock https://gitlab.com/mailman/hyperkitty/-/issues/357

Actions #37

Updated by hellcp about 3 years ago

I prepped the following rewrite rules:

RewriteMap listsmap "txt:/etc/apache2/lists.rewritemap"
RewriteCond %{QUERY_STRING} &?list=([^&]+)
RewriteRule ^/cgi-bin/search.cgi$ /archives/search%{QUERY_STRING}&mlist=%1 [R=301,L]
RewriteCond %{QUERY_STRING} &?query=([^&]+)
RewriteRule ^/cgi-bin/search.cgi$ /archives/search%{QUERY_STRING}&query=%1 [R=301,L]
RewriteRule "^/cgi-bin/search.cgi$" "/archives/list/${listsmap:$1}/" [PT]
RewriteRule "^/stats/(.*)" "/archives/list/${listsmap:$1}/" [PT]
RewriteRule "^/(.*)/?$" "/archives/list/${listsmap:$1}/" [PT]
RewriteRule "^/(.*)/mailinglist\.rss$" "/archives/list/${listsmap:$1}/feed/" [PT]
RewriteRule "^/(.*)/([0-9]{4})-([0-9]{2})/?$" "/archives/list/${listsmap:$1}/$2/$3/" [PT]
RewriteRule "^/(.*)/([0-9]{4})-([0-9]{2}).mbox(\.gz)?$" "/archives/list/${listsmap:$1}/export/${listsmap:$1}-$2-$3.mbox.gz" [PT]

with the following rewritemap:

heroes heroes@lists.opensuse.org
kernel-bugs kernel-bugs@lists.opensuse.org
kubic-bugs kubic-bugs@lists.opensuse.org
libeconf-devel libeconf-devel@lists.opensuse.org
libyui-commit libyui-commit@lists.opensuse.org
mirror mirror@lists.opensuse.org
mysql-packaging mysql-packaging@lists.opensuse.org
obs-commits obs-commits@lists.opensuse.org
obs-devel obs-devel@lists.opensuse.org
obs-tests obs-tests@lists.opensuse.org
opensuse users@lists.opensuse.org
opensuse-announce announce@lists.opensuse.org
opensuse-arm arm@lists.opensuse.org
opensuse-artwork artwork@lists.opensuse.org
opensuse-autoinstall autoinstall@lists.opensuse.org
opensuse-bugs bugs@lists.opensuse.org
opensuse-buildservice buildservice@lists.opensuse.org
opensuse-cloud cloud@lists.opensuse.org
opensuse-commit commit@lists.opensuse.org
opensuse-conference conference@lists.opensuse.org
opensuse-cz users-cz@lists.opensuse.org
opensuse-de users-de@lists.opensuse.org
opensuse-doc doc@lists.opensuse.org
opensuse-edu edu@lists.opensuse.org
opensuse-el users-el@lists.opensuse.org
opensuse-es users-es@lists.opensuse.org
opensuse-factory factory@lists.opensuse.org
opensuse-factory-mozilla factory-mozilla@lists.opensuse.org
opensuse-features features@lists.opensuse.org
opensuse-fr users-fr@lists.opensuse.org
opensuse-gnome gnome@lists.opensuse.org
opensuse-go go@lists.opensuse.org
opensuse-ha ha@lists.opensuse.org
opensuse-haskell haskell@lists.opensuse.org
opensuse-hu users-hu@lists.opensuse.org
opensuse-isdn-de isdn-de@lists.opensuse.org
opensuse-ja users-ja@lists.opensuse.org
opensuse-kde3 kde3@lists.opensuse.org
opensuse-kde kde@lists.opensuse.org
opensuse-kernel kernel@lists.opensuse.org
opensuse-kubic kubic@lists.opensuse.org
opensuse-m17n m17n@lists.opensuse.org
opensuse-marketing marketing@lists.opensuse.org
opensuse-optimize optimize@lists.opensuse.org
opensuse-packaging packaging@lists.opensuse.org
opensuse-ppc ppc@lists.opensuse.org
opensuse-programming programming@lists.opensuse.org
opensuse-project project@lists.opensuse.org
opensuse-proofreading proofreading@lists.opensuse.org
opensuse-pt users-pt@lists.opensuse.org
opensuse-python python@lists.opensuse.org
opensuse-releaseteam releaseteam@lists.opensuse.org
opensuse-ruby ruby@lists.opensuse.org
opensuse-science science@lists.opensuse.org
opensuse-security security@lists.opensuse.org
opensuse-security-announce security-announce@lists.opensuse.org
opensuse-summit summit@lists.opensuse.org
opensuse-support support@lists.opensuse.org
opensuse-test test@lists.opensuse.org
opensuse-translation translation@lists.opensuse.org
opensuse-translation-commit translation-commit@lists.opensuse.org
opensuse-translation-de translation-de@lists.opensuse.org
opensuse-translation-el translation-el@lists.opensuse.org
opensuse-translation-es translation-es@lists.opensuse.org
opensuse-translation-fr translation-fr@lists.opensuse.org
opensuse-updates updates@lists.opensuse.org
opensuse-virtual virtual@lists.opensuse.org
opensuse-web web@lists.opensuse.org
opensuse-web-de web-de@lists.opensuse.org
opensuse-wiki wiki@lists.opensuse.org
opensuse-xfce xfce@lists.opensuse.org
opensuse-zsystems zsystems@lists.opensuse.org
ulp-devel ulp-devel@lists.opensuse.org
uyuni-announce announce@lists.uyuni-project.org
uyuni-devel devel@lists.uyuni-project.org
uyuni-users users@lists.uyuni-project.org
uyuni-translation translation@lists.uyuni-project.org
wicked wicked@lists.opensuse.org
wicked-commit wicked-commit@lists.opensuse.org
wicked-devel wicked-devel@lists.opensuse.org
yast-commit yast-commit@lists.opensuse.org
yast-devel yast-devel@lists.opensuse.org
zypp-commit zypp-commit@lists.opensuse.org
zypp-devel zypp-devel@lists.opensuse.org

somebody should probably verify there isn't anything glaringly obviously bad with it

I was gonna check if I have all urls covered, but I can't log into baloo

Actions #38

Updated by hellcp about 3 years ago

hellcp wrote:

pjessen wrote:

I have looked at the 12/24h clock issue, even asked on the mailman list.

I added a file "/var/lib/mailman_webui/settings_local.py" containing

USE_L10N = True
TIME_FORMAT = 'H'                                                                                                                                                         

and then added this to "/var/lib/mailman_webui/settings.py"

try:
    from settings_local import *
except ImportError:
    pass

Since settings.py is salted, you can just directly modify that (and if the changes work add it to salt repo). I will have a look later to see what's up with that.

I had a look at this, setting:

USE_L10N = False
TIME_FORMAT = 'H:i'                                                                                                                                                         

makes it so the format is 24H on messages (test it yourself, it's set right now). However as you can tell this is not preferable since we do want to do L10N. Everywhere else the strings are hard coded, but we could do localized strings depending on locale there too, as soon as I finish the PR that does that.

Actions #40

Updated by pjessen about 3 years ago

hellcp wrote:

somebody should probably verify there isn't anything glaringly obviously bad with it
I was gonna check if I have all urls covered, but I can't log into baloo

I'll do a check on baloo, maybe over Easter.

Actions #41

Updated by pjessen about 3 years ago

hellcp wrote:

I had a look at this, setting:

USE_L10N = False
TIME_FORMAT = 'H:i'                                                                                                                                                         

makes it so the format is 24H on messages (test it yourself, it's set right now). However as you can tell this is not preferable since we do want to do L10N. Everywhere else the strings are hard coded, but we could do localized strings depending on locale there too, as soon as I finish the PR that does that.

Hmm, I guess there is more than one place affected, see attached. Looks good on the individual messages, nice!

Actions #42

Updated by hellcp about 3 years ago

pjessen wrote:

Hmm, I guess there is more than one place affected, see attached.

That's addressed in https://gitlab.com/mailman/hyperkitty/-/merge_requests/337
I hope it will get merged someday :P

Actions #43

Updated by cboltz about 3 years ago

hellcp wrote:

I prepped the following rewrite rules:

Rewriting the search and the rss feed is a good idea.

For the actual archives - will your redirect end up on the specific mail, or will it only redirect to the month overview?

If "on the specific mail", that's fine. If not, then not ;-) - we'd break lots of links to the old list archives that exist out there, and that's something I'd like to avoid (even if it comes at the cost of having to keep the old archives).

Actions #44

Updated by hellcp about 3 years ago

cboltz wrote:

For the actual archives - will your redirect end up on the specific mail, or will it only redirect to the month overview?

If "on the specific mail", that's fine. If not, then not ;-) - we'd break lots of links to the old list archives that exist out there, and that's something I'd like to avoid (even if it comes at the cost of having to keep the old archives).

Sure, I can write that, though it may not fit in a message on progress :P

Actions #45

Updated by hellcp about 3 years ago

Ok, so I made the mapping in format like below, it's 288M and I don't have a place to upload it :P

opensuse/2004-10/msg03131 users@lists.opensuse.org/message/V3NRHOA33UZM3HBYHNKVGGPYPBH7ECNY

This would be the rewritemap syntax for that:

RewriteMap mailsmap "txt:/etc/apache2/mails.rewritemap"
RewriteRule "^/(.*).html$" "/archives/list/${mailsmap:$1}/" [PT]

There were 4429 rejects, it seems those are mails that may have been lost in migration, for a few reasons. One seems to be the issue with SUSE internal DNS when some mails landed in mlmmj after we already switched to mailman3:

25121e74-f144-ea33-5ac3-beb09fc34692@suse.de: heroes/2020-11/msg00000
922b724c-e278-dd95-a11d-673b4529fb87@suse.com: heroes/2020-11/msg00001
b381f7e8-3e0a-fc45-3e29-2270532fc9d8@suse.com: heroes/2020-11/msg00002
bug-1178634-88178@http.bugzilla.opensuse.org/: kernel-bugs/2020-11/msg00108
bug-1178634-88178-yN1TpffKVx@http.bugzilla.opensuse.org/: kernel-bugs/2020-11/msg00109
bug-1178601-21960-gqNtz5QU9t@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01047
bug-1172846-21960-LxK2aW2oPG@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01069
bug-1178582-21960-BJKHE5UlSM@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01081
bug-1167970-21960-D7ySmB1ibG@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01077
bug-1177491-21960-gQcYXEIYlN@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01079
bug-1178617-21960@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01043
bug-1169834-21960-EgrIxVGXMp@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01075
bug-1178543-21960-JHB6CJd1L1@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01046
bug-1171562-21960-VIlJoLC5qm@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01060
bug-1178534-21960-USMPkyJHr8@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01064
bug-1173279-21960-1XHB572XCc@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01080
bug-1178098-21960-RMbHfnVMZH@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01041
bug-1174075-21960-5UaRYtZSzh@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01048
bug-1178534-21960-3na74kCBJc@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01078
bug-1178476-21960-CqEio4HXXx@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01051
bug-1178476-21960-ufOozvqFFj@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01062
bug-1172920-21960-y7hHG52bQu@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01052
bug-1164274-21960-dZVQuuaAaf@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01058
bug-1178624-21960-tI4s6oWqSQ@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01068
bug-1178203-21960-U6AFykE0Ak@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01066
bug-1174817-21960-AusmVbUXa3@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01072
bug-1178203-21960-jYiR3JNeCj@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01082
bug-1178543-21960-Ag1cMfWfYO@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01045
bug-1174753-21960-OKFwINBCT9@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01071
bug-1178617-21960-SEYsIZve04@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01053
bug-1175168-21960-XNNUTFL8Wl@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01073
bug-1178603-21960-yQVFqjCSmm@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01055
bug-1178614-21960-TjMb7ihB1d@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01038
bug-1167970-21960-QtweNHmqsz@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01076
bug-1171016-21960-K3eQsUZgSF@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01059
bug-1173972-21960-2J05GJFa1g@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01070
bug-1178603-21960-Inf6gR71Jz@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01056
bug-1178603-21960-StQCKP0qIG@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01039
bug-1178321-21960-wSFOT3Q6WP@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01044
bug-1174593-21960-kjETGIQAm3@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01061
bug-1178619-21960@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01050
bug-1178543-21960-cidd2JNTof@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01049
bug-1178453-21960-XCv2gidyPl@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01065
bug-1178614-21960-ZN5efiGPIo@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01042
bug-1178604-21960-zlD4TMktr5@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01063
bug-1178603-21960-TYi7YKVJIE@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01054
bug-1178624-21960@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01067
bug-1178614-21960@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01037
bug-1178621-21960@http.bugzilla.opensuse.org/: opensuse-bugs/2020-11/msg01057
bug-1110697-21960-eF3efOuz3P@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01074
bug-1172920-21960-IrvsSi4oWk@http.bugzilla.suse.com/: opensuse-bugs/2020-11/msg01040
20201110125339.1DD1A9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00928
20201110140904.6E89F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00939
20201110125137.8743E9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00888
20201110123707.0D8B39B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00718
20201110125327.D63139B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00920
20201110123527.18A9B9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00688
20201110123648.B7CF89B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00712
20201110125246.C6BFF9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00904
20201110123919.ADE069B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00764
20201110125251.C09929B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00905
20201110123931.331EA9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00770
20201110125014.4EE1C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00858
20201110125333.348DE9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00925
20201110123558.8C31B9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00697
20201110123846.5406F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00752
20201110123908.2087D9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00759
20201110125208.0525A9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00894
20201110124710.268CE9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00784
20201110123626.AFD849B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00704
20201110125348.0353E9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00934
20201110125004.6B7CD9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00854
20201110123901.5123B9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00756
20201110123804.6A43E9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00734
20201110123832.77D4F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00748
20201110125310.55B139B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00912
20201110125205.04DA99B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00892
20201110123736.9D6DF9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00727
20201110123702.C204C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00716
20201110124846.B77E09B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00829
20201110125242.877CB9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00901
20201110123450.3AE1C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00672
20201110123904.C9D829B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00757
20201110123911.7537A9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00760
20201110125256.082C79B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00908
20201110123705.25F509B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00717
20201110125253.DA8209B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00906
20201110125041.A8AAA9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00873
20201110124802.C969D9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00809
20201110124914.E63A19B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00840
20201110124921.44B139B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00842
20201110125329.36A8C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00921
20201110124938.4CFBA9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00844
20201110124843.C30B99B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00826
20201110125027.B971B9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00865
20201110125212.198529B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00896
20201110123655.A55789B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00714
20201110123921.5CB6E9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00765
20201110123519.0F97F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00683
20201110125106.5A4459B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00884
20201110125309.4DBB49B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00911
20201110124739.70A859B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00801
20201110123601.406699B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00698
20201110125135.0B81C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00886
20201110124847.D070C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00830
20201110123651.A20A89B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00713
20201110124513.39CEA9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00781
20201110125346.E8E0F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00933
20201110124759.E6ABD9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00808
20201110123837.98A3B9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00750
20201110125059.AAAB79B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00879
20201110123513.7C7FF9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00685
20201110123334.766E99B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00670
20201110092614.3C53B9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00669
20201110123448.077769B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00671
20201110123819.9FB199B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00742
20201110123640.976F19B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00708
20201110124824.50F909B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00814
20201110123939.617199B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00773
20201110123913.549F59B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00761
20201110140905.4355F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00940
20201110124507.589299B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00780
20201110123747.7B5389B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00730
20201110123603.C77E49B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00699
20201110124828.4C2369B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00816
20201110123522.0823B9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00686
20201110125216.0B30F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00898
20201110124731.81DBE9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00796
20201110124822.A76E09B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00813
20201110125206.7CBC79B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00893
20201110125010.575809B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00861
20201110124952.EA96D9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00850
20201110123537.AA0C09B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00691
20201110125022.B55079B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00864
20201110123918.6E4CF9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00763
20201110125334.CBE5C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00926
20201110124012.320229B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00777
20201110124910.84ABF9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00838
20201110125306.E5EF09B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00909
20201110125318.070BE9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00917
20201110123821.9F12B9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00743
20201110123642.1A54A9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00709
20201110125104.21E1C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00883
20201110125035.8607F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00869
20201110123727.007FB9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00725
20201110124705.ACCCE9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00782
20201110124818.5005D9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00812
20201110123525.817DF9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00687
20201110125133.A1F749B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00885
20201110125101.1CC779B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00880
20201110124734.599879B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00798
20201110123511.A197C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00681
20201110125315.91EBC9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00916
20201110123850.74E1C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00753
20201110124727.5592F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00792
20201110124949.9280E9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00848
20201110125212.EE1669B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00897
20201110125033.1FA669B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00867
20201110124923.2890B9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00843
20201110125331.6D9EB9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00923
20201110125005.A440F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00855
20201110123801.5BB299B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00733
20201110123926.25C959B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00768
20201110123533.E96EA9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00690
20201110125350.0D3C19B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00936
20201110124756.0C9D59B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00807
20201110125341.EE0FD9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00930
20201110123836.760C89B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00749
20201110124836.8C5BA9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00821
20201110123611.F37659B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00701
20201110123501.577BF9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00677
20201110123531.77FC19B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00689
20201110123507.3F2629B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00679
20201110124827.302599B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00815
20201110123541.2EC089B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00693
20201110125008.E959C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00856
20201110124720.B3B3C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00787
20201110123808.A1E679B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00737
20201110124738.0D10C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00800
20201110123721.34E629B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00724
20201110123857.71F849B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00754
20201110123746.6E9F89B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00729
20201110125136.11BC29B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00887
20201110124948.6DC629B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00847
20201110124852.867889B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00832
20201110125254.C9C009B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00907
20201110124715.7C0FD9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00785
20201110123638.146259B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00707
20201110125102.24A749B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00881
20201110124728.201D79B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00793
20201110124903.2C9FC9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00835
20201110123710.5E0019B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00720
20201110124939.7B6009B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00845
20201110123828.5667A9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00745
20201110123708.10A259B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00719
20201110124812.EA9BA9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00811
20201110123520.6018D9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00684
20201110123657.3DCE49B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00715
20201110123810.4FEA39B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00738
20201110124807.0F6ED9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00810
20201110124719.6DE929B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00786
20201110123757.D14B39B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00732
20201110124837.83B819B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00822
20201110124830.F26589B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00818
20201110123922.91C399B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00766
20201110123554.18C219B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00695
20201110124730.9376A9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00795
20201110125043.2A9C09B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00874
20201110123813.04BAD9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00739
20201110125325.5625A9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00919
20201110125019.722199B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00863
20201110125239.797799B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00900
20201110125040.30C849B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00872
20201110124855.4311D9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00833
20201110123807.1D1779B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00736
20201110125339.E84D59B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00929
20201110125003.1BFF69B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00853
20201110124732.E7AEC9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00797
20201110123547.B6DC79B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00694
20201110124356.806EE9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00778
20201110125031.C6A799B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00866
20201110124742.207779B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00802
20201110125311.47A479B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00913
20201110123606.256AB9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00700
20201110123715.3274F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00722
20201110123839.423239B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00751
20201110123728.47E709B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00726
20201110125209.632069B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00895
20201110123742.CD5EA9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00728
20201110124736.5F09F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00799
20201110125036.E16B69B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00870
20201110092613.B26949B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00668
20201110124832.122F49B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00819
20201110123458.AA9AC9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00675
20201110124721.AB0179B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00788
20201110125011.694659B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00857
20201110124749.B88659B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00806
20201110123814.EA59C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00740
20201110123456.C02309B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00674
20201110123556.BC04A9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00696
20201110123636.830319B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00706
20201110123500.1F4149B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00676
20201110124919.967439B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00841
20201110123509.DDCD19B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00680
20201110140903.7428E9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00938
20201110123932.652829B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00771
20201110124001.729B79B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00775
20201110125313.09F839B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00915
20201110125344.55D5B9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00931
20201110123629.8EFEA9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00705
20201110124744.BF5F39B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00804
20201110123858.BE1FB9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00755
20201110124849.35A949B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00831
20201110123934.8C3469B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00772
20201110123924.D3A649B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00767
20201110124723.9BF7E9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00789
20201110125222.53F949B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00899
20201110124857.5036A9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00834
20201110123816.D63519B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00741
20201110125147.3AE969B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00889
20201110125015.E8A689B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00859
20201110125000.CB2BD9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00852
20201110124842.7D48E9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00825
20201110124845.B788E9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00828
20201110123754.1F2339B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00731
20201110125203.D75179B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00891
20201110125046.F11419B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00876
20201110123805.4E7739B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00735
20201110123624.4A6079B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00703
20201110125330.3F6FF9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00922
20201110124725.29D039B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00790
20201110125332.404969B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00924
20201110123829.DA33B9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00746
20201110125312.5AE4F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00914
20201110124743.0DA0D9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00803
20201110124951.A57E59B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00849
20201110125039.22B0B9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00871
20201110124003.ADBA89B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00776
20201110124000.195029B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00774
20201110124905.242C19B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00836
20201110125244.312629B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00902
20201110125018.914049B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00862
20201110123831.418899B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00747
20201110125103.266FC9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00882
20201110125057.B2D659B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00877
20201110124913.D52A69B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00839
20201110123643.993B59B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00710
20201110124747.133F09B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00805
20201110124844.C19859B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00827
20201110124947.4016F9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00846
20201110125058.C23D09B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00878
20201110125308.1355D9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00910
20201110125045.310699B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00875
20201110123826.645A29B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00744
20201110123716.D19FA9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00723
20201110123539.9EE409B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00692
20201110124729.4E41D9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00794
20201110123914.89D529B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00762
20201110124707.186A89B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00783
20201110125017.0B7C69B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00860
20201110125338.4D5379B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00927
20201110124906.D6A1A9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00837
20201110123712.841909B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00721
20201110123645.D1F1C9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00711
20201110123906.053589B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00758
20201110123502.E4D1B9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00678
20201110125319.74FED9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00918
20201110125349.4BE0A9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00935
20201110123516.6F36E9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00682
20201110124417.46BE59B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00779
20201110124840.8D8D49B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00824
20201110125345.9C6289B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00932
20201110124839.740CB9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00823
20201110124829.58F2D9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00817
20201110123618.083229B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00702
20201110125245.BB0DF9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00903
20201110124726.29C5D9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00791
20201110125202.7236E9B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00890
20201110123928.482659B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00769
20201110125034.53A559B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00868
20201110132230.A44969B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00937
20201110124957.3F4569B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00851
20201110123453.50F849B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00673
20201110124833.6E9759B883@Hilbert.suse.de: opensuse-commit/2020-11/msg00820
20201110141620.2807CFFAB@maintenance.suse.de: opensuse-security-announce/2020-11/msg00041
20201110103715.GA17724@suse.de: opensuse-security-announce/2020-11/msg00040
20201110141620.16F47FFAB@maintenance.suse.de: opensuse-updates/2020-11/msg00101
20201110142009.7B498FFAB@maintenance.suse.de: opensuse-updates/2020-11/msg00102
20201110111510.2EC1CFFA8@maintenance.suse.de: opensuse-updates/2020-11/msg00099
20201110111611.279B0FFA8@maintenance.suse.de: opensuse-updates/2020-11/msg00100

The remaining 4099 seem to be missing because of the importer not liking them for one reason or another and this is apparently a useful exercise to see what happened with them, I will try importing them and fix any issues as they arise.

Actions #46

Updated by hellcp about 3 years ago

ok, I'm done with rewritemap:

I skipped emails from these archives:

If anybody knows another place where those may be available, I would be glad to include them: the missing count comes down to 2864 emails.

I skipped 3 emails:

I don't think anyone will miss them.

The number of emails in the rewritemap is 2.951.028.

Actions #47

Updated by robin_listas about 3 years ago

I have opensuse-2007 (full year) locally. That is, what I received in my own email at the time.

I would have to find a way to select the proper mails for the month. And of course, the mails have my ISP headers and references to my own email, which would have to be removed somehow or trimmed.

HTH

Actions #48

Updated by hellcp about 3 years ago

robin_listas wrote:

I have opensuse-2007 (full year) locally. That is, what I received in my own email at the time.

I would have to find a way to select the proper mails for the month. And of course, the mails have my ISP headers and references to my own email, which would have to be removed somehow or trimmed.

HTH

I can provide the full list of Message-IDs for the mails we are missing, it would probably be easier to grab the mails that way than to do it by date ;)

Actions #49

Updated by robin_listas about 3 years ago

Ah! Well, then I only need something that would search for a message-id in an mbox file and copy to another, and loop a list. Do you have something like that, or imagine how to do it? Right now I don't see how.
Feel free to contact me directly.

Actions #50

Updated by hellcp about 3 years ago

robin_listas wrote:

Ah! Well, then I only need something that would search for a message-id in an mbox file and copy to another, and loop a list. Do you have something like that, or imagine how to do it? Right now I don't see how.
Feel free to contact me directly.

Here you go: I have a list of all of the missing email ids, since mhonarc collected at least that info in the database

Actions #51

Updated by robin_listas about 3 years ago

Ok, got it.
But I need a tool, that given an M...-id, peruses a mbox file and extracts that single email, hopefully in mbox format so that it can be appended.

The rest I can script.

Perhaps grepmail :-?
[...]
Bingo!

grepmail -h "Message-ID: Pine.LNX.4.64.0706221347000.29643@nimrodel.valinor" ~/Mail/_Lists/_filed/os-en.200705..08

cats the email to output. I can script it. :-)

Actions #52

Updated by hellcp about 3 years ago

robin_listas wrote:

cats the email to output. I can script it. :-)

Excellent, that would be highly appreciated

In the meanwhile I finished opensuse-commit mailing list with the help of marc.info. In total there are only 5 mails missing from opensuse-pt and limal-devel combined, so we might not even bother with those missing files and just go with what we will have with the opensuse mailing list when I import that and add references to those mails to redirect maps.

Speaking of those, they are pretty much ready as well, there is an MR on gitlab for config (which is live on the mailman machine, but only works on /opensuse-test* since only that's currently open for mailman3 machine in haproxy), and package containing the redirectmaps is hosted on obs.

Actions #53

Updated by robin_listas about 3 years ago

I have now opensuse-2007-06.mbox.gz, except 8 emails.
Two of them are mine, so I found them in the sent folder.
There are 6 I can't locate:

4673A349.5030701@gmx.net
200706012133.01430.thadeurj@terra.com.br
20070616184124.GF19067@blinkenlights.visv.net
200706071153.50160.wstephenson@suse.de
JM200706162234065.4685828@pop.707.to
BAY136-F6F3946075A76AD14C88DED2260@phx.gbl

I will attach the two resulting mbox folders:

3551248 output.2007tremis.mbox.gz
2678 output.ReallyFull.mbox.gz (sent folder)

I got help in this thread:
https://lists.opensuse.org/archives/list/users@lists.opensuse.org/thread/J45H4LLSFHSOHUP355MX3R3JB5Z65GBR/#J45H4LLSFHSOHUP355MX3R3JB5Z65GBR
https://lists.opensuse.org/archives/list/users@lists.opensuse.org/thread/3SKDYEDAVRAEB7YUWVG6WHX2I3FYBS72/#3SKDYEDAVRAEB7YUWVG6WHX2I3FYBS72

There is a remaining problem: removing at least some of the Received headers, at least those that are added by my ISP after sent by the list server. I don't know how to do that.

Actions #54

Updated by robin_listas about 3 years ago

Adding the 8 missing emails, courtesy of David Haller on the "users" mail list.

Actions #55

Updated by robin_listas about 3 years ago

Replacing 2007-06 mailbox with another version pruned of some headers, again courtesy of David Haller, using an awk script.

Actions #56

Updated by hellcp about 3 years ago

Ok, imported all of it, and we aren't missing any mails anymore (actually we are, but for explanation why read #77278). I also added the redirects to the nginx rewrite lists package. Thanks so much Carlos and David!

Actions #57

Updated by crameleon 5 months ago

Anyone still working on this?

Actions

Also available in: Atom PDF