Project

General

Profile

action #59388

arm-1 / out-of-space warning

Added by okurz 7 months ago. Updated 7 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Start date:
2019-11-13
Due date:
% Done:

0%

Estimated time:
Duration:

Description

Observation

regarding the osd post-deploy monitoring I see https://gitlab.suse.de/openqa/osd-deployment/-/jobs/138860 failed pointing to / being overly full on arm-1. looks like we do not have snapshots but still use 34G.

# du -m -d1 --exclude /var/lib/openqa/share --exclude /dev --exclude /var/lib/openqa/nvme | sort -n
0       ./mnt
0       ./proc
0       ./selinux
0       ./srv
0       ./sys
1       ./dev
1       ./opt
1       ./root
2       ./run
3       ./bin
4       ./home
13      ./sbin
16      ./lib64
22      ./etc
86      ./boot
776     ./lib
2570    ./usr
23796   ./tmp
3878882 ./var
3906166 .

and

# ls -ltrahS
total 24G
drwxrwxrwt 1 root           root       0 Feb 26  2018 .font-unix
drwxrwxrwt 1 root           root       0 Feb 26  2018 .XIM-unix
drwxrwxrwt 1 root           root       0 Feb 26  2018 .X11-unix
drwxrwxrwt 1 root           root       0 Feb 26  2018 .Test-unix
drwxrwxrwt 1 root           root       0 Feb 26  2018 .ICE-unix
drwx------ 1 root           root       6 Nov 13 06:36 systemd-private-6730890f71064e969da9ab546ac26fb6-ntpd.service-95h4ck
drwx------ 1 root           root       6 Sep 30 11:18 namespace-dev-KkodUZ
-rw-r--r-- 1 root           root     115 Nov 13 07:04 osd-deployment_rpm_q
drwxr-xr-x 1 root           root     136 Feb 26  2018 ..
-rw-r--r-- 1 okurz          users    211 Sep  5 13:00 override.conf
drwxrwxrwt 1 root           root     742 Nov 13 08:07 .
-rw-r--r-- 1 root           root     44K Oct 29 13:04 log
-rw------- 1 _openqa-worker nogroup 969M Sep 28 14:56 mojo.tmp.nq0vLzabb1zWmjGO
-rw------- 1 _openqa-worker nogroup 1.1G Sep 28 15:35 mojo.tmp.F3I7oq122kFrKSfR
-rw------- 1 _openqa-worker nogroup 1.6G Sep 19 19:20 mojo.tmp.JaJQjPsRKeKN_uNA
-rw------- 1 _openqa-worker nogroup 1.8G Sep 28 14:35 mojo.tmp._AGyK7gXhVtqG_nr
-rw------- 1 _openqa-worker nogroup 3.5G Sep 19 18:48 mojo.tmp.bsfcU_u1vvxM0DBk
-rw------- 1 _openqa-worker nogroup 3.5G Nov  8 10:26 mojo.tmp.An73wQN6Zn7AgEX6
-rw------- 1 _openqa-worker nogroup 5.5G Sep 28 14:29 mojo.tmp.7oNEbwY_XExxQnfQ
-rw------- 1 _openqa-worker nogroup 5.6G Sep 28 15:33 mojo.tmp.FOnWm_q01JT9NAEM
openqaworker-arm-1:/tmp #

what are these 'mojo.tmp' files? I assume I can delete them but this looks like a symptom we could have on any machine


Related issues

Copied to openQA Project - action #59391: Prevent depletion of space on /tmp due to mojo.tmp files from os-autoinstResolved2019-11-132020-05-15

History

#1 Updated by okurz 7 months ago

  • Status changed from In Progress to Resolved

Manually deleted on arm-1, did on osd sudo salt --no-color --state-output=changes \* "ls -lS /tmp/mojo.tmp*", returns no files on any machine. So far this issue looks limited to arm-1, maybe some personal, temporary debugging by someone? Assuming fixed.

#2 Updated by okurz 7 months ago

  • Copied to action #59391: Prevent depletion of space on /tmp due to mojo.tmp files from os-autoinst added

Also available in: Atom PDF