Actions
action #92338
closed[Alerting] File systems alert, / on osd
Start date:
2021-05-08
Due date:
2021-06-02
% Done:
100%
Estimated time:
(Total: 0.00 h)
Description
Observation¶
[Alerting] File systems alert
One of the file systems is too full
Metric name
Value
/: Used Percentage
90.049
see https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?tab=alert&viewPanel=74&orgId=1
output of du -x --max-depth=1 -BM | sort -n
1M ./lost+found
1M ./mnt
1M ./selinux
1M ./storage
2M ./bin
6M ./sbin
12M ./lib64
26M ./etc
46M ./root
99M ./boot
147M ./opt
1085M ./lib
1284M ./var
4128M ./usr
10083M ./tmp
16915M .
seems like /tmp has a very big contribution now. A lot of temporary directories like 6TyfduRNJ6, oldest one since 2021-03-24 03:48 . Unfortunately there are hardly any logs going back in time, like because / is that full that also the systemd journal does not save more. 2021-03-24 is not a date where we commonly automatically reboot the system so not sure if non-openQA package upgrades caused a change.
I found some files like tmp.vvDweS5srZ which look like autoinst-log.txt or worker-log.txt . I assume that these are temporary files from openqa-investigate
Actions