action #38804
closedcoordination #38798: [functional][u][epic] Unaccounted ISOs on SP4
[functional][u][fast] Make sure Media2 isos from SLE12SP4 are accounted for in ISO_* variables in any job
0%
Description
Motivation¶
To prevent filling up all available storage on osd we need to account for all assets that are used by tests. There is a fallback to delete unaccounted assets after e.g. 2 weeks (or was it 3?) but this is not enough to keep the space usage under control. If we do not do anything we will kill whole osd soon.
Acceptance criteria¶
- AC1: iso/SLE-12-SP4-Server-DVD-x86_64-Build????-Media2.iso is set as ISO_ variable, e.g. ISO_* in any test or all tests relying on data from it, could be dummy test
Updated by SLindoMansilla over 6 years ago
Findings:
- https://gitlab.suse.de/SLindoMansilla/scripts/blob/master/rsync_sle.pm
- sub add_sle_addons($)
- https://github.com/os-autoinst/openQA/blob/master/lib/OpenQA/Schema/Result/Jobs.pm
- sub register_assets_from_settings
- https://github.com/os-autoinst/openQA/blob/master/lib/OpenQA/Utils.pm
- sub parse_assets_from_settings
- sub asset_type_from_setting
The ISOs are registered when the job is executed, the registration logic is called for each job.
Suggested solution:
- Set the settings for the other ISOs
- Pro: Only changing settings in the media
- Cons: ISOs mounted for each job
- Set the settings for only one job
- Pro: only one job will mount the ISOs
- Cons: Logic lost on one specific job
- Add ISOs as _ISO* job settings, so they are not mounted. And then change the GRU behavior to take _ISO into account
- rsync.pl: Remove ISOs after extracting the FTP repositories
We find number 4 the best approach as we haven't found any use of source DVD for version in development of SLE.
(Inform QA-SLE virtualization team about XEN scenarios
os-autoinst-distri-opensuse/lib/repo_tools.pm:
# use dvd2 as the src-repository
# Xen PV has different device for 2nd CDROM
elsif (check_var('VIRSH_VMM_TYPE', 'linux')) {
$cmd = 'ar --type plaindir hd:///?device=/dev/xvda repo-source';
}
else {
$cmd = "ar --type plaindir cd:///?devices=/dev/sr1 repo-source";
}
Updated by SLindoMansilla over 6 years ago
Updated by riafarov over 6 years ago
- Status changed from New to Feedback
- Assignee deleted (
SLindoMansilla)
PR merged, let's keep ticket open in case someone used source ISO, and potentially switch to option 3.
Updated by riafarov over 6 years ago
- Assignee set to SLindoMansilla
Accidentally removed assignee, reverting.
Updated by okurz over 6 years ago
- Subject changed from [functional][y][fast] Make sure Media2 isos from SLE12SP4 are accounted for in ISO_* variables in any job to [functional][u][fast] Make sure Media2 isos from SLE12SP4 are accounted for in ISO_* variables in any job
Updated by SLindoMansilla over 6 years ago
- Related to action #38807: API call that allows to search for test settings (was: Make sure all used assets are accounted for in tests on osd (#38804)) added
Updated by SLindoMansilla over 6 years ago
See https://progress.opensuse.org/issues/38807 for handling module ISOs (eg. WE, SDK)
Updated by SLindoMansilla over 6 years ago
PR to remove dead code (<12-SP4): https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/5467
Updated by riafarov over 6 years ago
- Status changed from Feedback to Resolved
Yes, it's resolved and Sergio even did more than expected. Cheers!