Project

General

Profile

action #38804

coordination #38798: [functional][u][epic] Unaccounted ISOs on SP4

[functional][u][fast] Make sure Media2 isos from SLE12SP4 are accounted for in ISO_* variables in any job

Added by okurz about 3 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
Immediate
Category:
Infrastructure
Target version:
SUSE QA - Milestone 18
Start date:
2018-07-25
Due date:
2018-07-31
% Done:

0%

Estimated time:
Difficulty:

Description

Motivation

To prevent filling up all available storage on osd we need to account for all assets that are used by tests. There is a fallback to delete unaccounted assets after e.g. 2 weeks (or was it 3?) but this is not enough to keep the space usage under control. If we do not do anything we will kill whole osd soon.

Acceptance criteria

  • AC1: iso/SLE-12-SP4-Server-DVD-x86_64-Build????-Media2.iso is set as ISO_ variable, e.g. ISO_* in any test or all tests relying on data from it, could be dummy test

Related issues

Related to openQA Project - action #38807: Make sure all used assets are accounted for in tests on osd (#38804) but not as assets which people need to download on cloning the job as the ISO is not actually usedNew2018-07-25

History

#1 Updated by SLindoMansilla about 3 years ago

  • Assignee set to SLindoMansilla

#2 Updated by SLindoMansilla about 3 years ago

Findings:

The ISOs are registered when the job is executed, the registration logic is called for each job.

Suggested solution:

  1. Set the settings for the other ISOs
    • Pro: Only changing settings in the media
    • Cons: ISOs mounted for each job
  2. Set the settings for only one job
    • Pro: only one job will mount the ISOs
    • Cons: Logic lost on one specific job
  3. Add ISOs as _ISO* job settings, so they are not mounted. And then change the GRU behavior to take _ISO into account
  4. rsync.pl: Remove ISOs after extracting the FTP repositories

We find number 4 the best approach as we haven't found any use of source DVD for version in development of SLE.
(Inform QA-SLE virtualization team about XEN scenarios

os-autoinst-distri-opensuse/lib/repo_tools.pm:

        # use dvd2 as the src-repository
        # Xen PV has different device for 2nd CDROM
        elsif (check_var('VIRSH_VMM_TYPE', 'linux')) {
            $cmd = 'ar --type plaindir hd:///?device=/dev/xvda repo-source';
        }
        else {
            $cmd = "ar --type plaindir cd:///?devices=/dev/sr1 repo-source";
        }

#4 Updated by riafarov about 3 years ago

  • Status changed from New to Feedback
  • Assignee deleted (SLindoMansilla)

PR merged, let's keep ticket open in case someone used source ISO, and potentially switch to option 3.

#5 Updated by riafarov about 3 years ago

  • Assignee set to SLindoMansilla

Accidentally removed assignee, reverting.

#6 Updated by okurz about 3 years ago

  • Subject changed from [functional][y][fast] Make sure Media2 isos from SLE12SP4 are accounted for in ISO_* variables in any job to [functional][u][fast] Make sure Media2 isos from SLE12SP4 are accounted for in ISO_* variables in any job

#7 Updated by SLindoMansilla about 3 years ago

  • Related to action #38807: Make sure all used assets are accounted for in tests on osd (#38804) but not as assets which people need to download on cloning the job as the ISO is not actually used added

#8 Updated by SLindoMansilla about 3 years ago

See https://progress.opensuse.org/issues/38807 for handling module ISOs (eg. WE, SDK)

#10 Updated by mgriessmeier about 3 years ago

PR merged - can we resolve this?

#11 Updated by riafarov about 3 years ago

  • Status changed from Feedback to Resolved

Yes, it's resolved and Sergio even did more than expected. Cheers!

Also available in: Atom PDF