openSUSE admin

lrupp wrote:

pjessen wrote:

The root filesystem on mailman3 keeps running out of space, can we please have it doubled in size?

We can. But before we just simply try to circumvent the symtomps, I like to know if we shouldn't check what exactly is filling it up.

Thank for the fast feedback, Lars.

We definitely should find out what's going on, but it might be easier if we fix the symptoms first :-)

1. /var/lib/mailman (more detail: /var/lib/mailman/messages/) needs 1.6G size. Does that make sense? - It looks to me like mailman is storing the mails in some crippled format inside these directories (instead of doing it like mlmmj in normal postfix format aka plain-text).

Mailman does things in weird and wonderful ways - I think those messages might be those that have been held back for moderation, typically either spam or from non-members. Currently 14935. I'm deleting some now (via the web interface), but they don't immediately disappear, maybe there is a regular tidy-up routine.

1. If I run ~~~ du -sxch * | sort -h ~~~ on '/', I get a total of 5.2G used. But df -h reports 8.7G used. I guess the difference of 3.5G is hidden below /var/lib/mailman_webui/xapian_index, which is now on a dedicated disk.

Oh, that's not good.

Suggestion:

1. Additional disk with 20G for /var/lib/mailman/
2. Short downtime for mailman to
   • see if /var/lib/mailman_webui/xapian_index on vda2 still contains data
   • sync /var/lib/mailman/ do the new disk

1) /var/lib/mailman is currently only 1.6Gb, of which /var/lib/mailman/messages is 1.2Gb. I would hope those will disappear as we look through messages held for moderation.
2) good idea, I'll do that now.

pjessen wrote:

lrupp wrote:

1. If I run ~~~ du -sxch * | sort -h ~~~ on '/', I get a total of 5.2G used. But df -h reports 8.7G used. I guess the difference of 3.5G is hidden below /var/lib/mailman_webui/xapian_index, which is now on a dedicated disk.

Oh, that's not good.

Have just stopped mailman, unmounted and checked -

mailman3 (lists.o.o):/var/log # umount /var/lib/mailman_webui/xapian_index
mailman3 (lists.o.o):/var/log # l /var/lib/mailman_webui/xapian_index
total 8
drwxr-xr-x 2 mailman mailman 4096 Mar  9 15:37 ./
drwxr-xr-x 6 mailman mailman 4096 Apr 21 12:34 ../

I don't understand why we should have such a discrepancy between what 'du' and 'df' reports - 3.5Gb is a third of the filesystem.

FWIW, I don't know what is being stored in /var/lib/mailman/messages - some of the messages are definitely pending review by a moderator, but some of them are very old and don't show as pending at all. I have discarded maybe a thousand messages today, does not seem to affect /var/lib/mailman/messages at all.

pjessen wrote:

FWIW, I don't know what is being stored in /var/lib/mailman/messages - some of the messages are definitely pending review by a moderator, but some of them are very old and don't show as pending at all. I have discarded maybe a thousand messages today, does not seem to affect /var/lib/mailman/messages at all.

I forgot I'd opened issue #90653 on the above, back in April.

Yeah, I saw that /dev/vdc the other day :-)
I don't know if it is worth doing much about /var/lib/mailman - the only thing that is growing is /var/lib/mailman/messages, and that seems to be due to a lack of deleting messages. Sasi suggested maybe a missing cronjob. See #90653. When we get that going, /var/lib/mailman/ will only have maybe 400-500Mb.