Project

General

Profile

Actions

action #55574

closed

openQA Infrastructure - action #55178: ** PROBLEM Service Alert: openqa.suse.de/fs_/var/lib/openqa is WARNING **

coordination #55556: [epic][osd][functional][u] osd: Untracked assets that most likely should be tracked

[osd][sle][functional][y] Untracked assets that most likely should be tracked: s390x iso files that are not used (should be not even synced)

Added by okurz over 4 years ago. Updated over 4 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Bugs in existing tests
Target version:
-
Start date:
2019-08-15
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

The space available on osd is limited. https://openqa.suse.de/admin/assets reveals some assets as "untracked" but probably they should be tracked by jobs, for example the following subset:

iso/SLE-15-SP2-Packages-s390x-Build16.1-Media1.iso 4.97 GiB
iso/SLE-12-SP5-SDK-DVD-s390x-Build0202-Media1.iso 1.32 GiB
Actions #1

Updated by okurz over 4 years ago

  • Copied from action #55571: [osd][staging][sle] Untracked assets that most likely should be tracked: SLE staging added
Actions #2

Updated by okurz over 4 years ago

  • Subject changed from [osd][sle][functional][y] Untracked assets that most likely should be tracked: SLE staging to [osd][sle][functional][y] Untracked assets that most likely should be tracked: s390x iso files that are not used (should be not even synced)
  • Assignee set to riafarov

@riafarov can QSF-y take responsibility for that?

Actions #3

Updated by okurz over 4 years ago

  • Copied from deleted (action #55571: [osd][staging][sle] Untracked assets that most likely should be tracked: SLE staging)
Actions #4

Updated by okurz over 4 years ago

  • Parent task set to #55556
Actions #5

Updated by riafarov over 4 years ago

  • Assignee changed from riafarov to okurz

I cannot handle it as high prio, so if urgent action is required, please, fix yourself. Otherwise, I am happy to help.

Actions #6

Updated by okurz over 4 years ago

  • Assignee changed from okurz to riafarov
  • Priority changed from High to Normal

ok, fine. You can handle it with "normal" prio then. Of course we can take the "urgent" actions. But please keep in mind that this might mean you – same as every other team – might loose assets or results+logs which might have been helpful when we need to take the drastic actions to reduce job group quotas and limit the result retention periods to ensure not running out of space.

Actions #7

Updated by riafarov over 4 years ago

okurz wrote:

ok, fine. You can handle it with "normal" prio then. Of course we can take the "urgent" actions. But please keep in mind that this might mean you – same as every other team – might loose assets or results+logs which might have been helpful when we need to take the drastic actions to reduce job group quotas and limit the result retention periods to ensure not running out of space.

We have this issues every now and then, so you don't have to explain me the consequences.

Actions #8

Updated by riafarov over 4 years ago

  • Status changed from New to Feedback
Actions #9

Updated by okurz over 4 years ago

merged. Let's see if this causes any problems in the next build and that the assets are really not synced. Then this should be good.

Actions #10

Updated by okurz over 4 years ago

so there was a small followup fix necessary to get the build ids right again.

What I am not so sure about: Seems the original iso assets are still synced:

openqa:/var/lib/openqa/share/factory/iso # ls -l *{Installer,Server}*s390x*
-rw-r--r-- 2 geekotest nogroup 4045406208 Aug 28 10:34 SLE-12-SP5-Server-DVD-s390x-Build0296-Media1.iso
-rw-r--r-- 2 geekotest nogroup 4045406208 Aug 28 10:34 SLE-12-SP5-Server-DVD-s390x-CURRENT-Media1.iso
-rw-r--r-- 1 geekotest nogroup  812646400 Aug 16 02:19 SLE-15-Installer-DVD-s390x-Build0045-Media1.iso
-rw-r--r-- 1 geekotest nogroup  812646400 Aug 23 02:26 SLE-15-Installer-DVD-s390x-Build0047-Media1.iso
-rw-r--r-- 2 geekotest nogroup  840957952 Aug 27 13:40 SLE-15-SP2-Installer-DVD-s390x-Build22.2-Media1.iso
-rw-r--r-- 2 geekotest nogroup  840957952 Aug 27 13:40 SLE-15-SP2-Installer-DVD-s390x-CURRENT-Media1.iso
Actions #11

Updated by riafarov over 4 years ago

okurz wrote:

so there was a small followup fix necessary to get the build ids right again.

What I am not so sure about: Seems the original iso assets are still synced:

openqa:/var/lib/openqa/share/factory/iso # ls -l *{Installer,Server}*s390x*
-rw-r--r-- 2 geekotest nogroup 4045406208 Aug 28 10:34 SLE-12-SP5-Server-DVD-s390x-Build0296-Media1.iso
-rw-r--r-- 2 geekotest nogroup 4045406208 Aug 28 10:34 SLE-12-SP5-Server-DVD-s390x-CURRENT-Media1.iso
-rw-r--r-- 1 geekotest nogroup  812646400 Aug 16 02:19 SLE-15-Installer-DVD-s390x-Build0045-Media1.iso
-rw-r--r-- 1 geekotest nogroup  812646400 Aug 23 02:26 SLE-15-Installer-DVD-s390x-Build0047-Media1.iso
-rw-r--r-- 2 geekotest nogroup  840957952 Aug 27 13:40 SLE-15-SP2-Installer-DVD-s390x-Build22.2-Media1.iso
-rw-r--r-- 2 geekotest nogroup  840957952 Aug 27 13:40 SLE-15-SP2-Installer-DVD-s390x-CURRENT-Media1.iso

Sergio did the part to unset installer images from the build. So not sure why this part didn't work. I've fixed the issue for the assets mentioned in the description only.

Actions #12

Updated by riafarov over 4 years ago

  • Status changed from Feedback to Resolved
Actions

Also available in: Atom PDF