action #92788
closedcoordination #64746: [saga][epic] Scale up: Efficient handling of large storage to be able to run current tests efficiently but keep big archives of old results
coordination #80546: [epic] Scale up: Enable to store more results
Use openQA archiving feature on osd size:S
Description
Motivation¶
See parent #80546 . To be able to scale-up openQA we want to be able to separate recent openQA results (on expensive+fast storage) from older, important openQA results (on slow+cheap storage). With #91782 we have an archiving feature which we can use within osd in conjunction with storage.qa.suse.de
Acceptance criteria¶
- AC1: results on openQA osd can be automatically archived to /space-slow on osd itself
Suggestions¶
- Make all the changes persistent within salt
- Enable in /etc/openqa/openqa.ini
Updated by okurz almost 3 years ago
- Copied from action #91782: Add support for archived jobs added
Updated by mkittler almost 3 years ago
- Assignee set to mkittler
I've started to work on that as part of #88546.
Updated by okurz almost 3 years ago
- Status changed from Workable to New
We should update the ticket to save the archive to /space-slow on OSD instead and save a backup to storage.qa as NetApp storage backing osd is more reliable
Updated by okurz almost 3 years ago
- Blocked by action #88546: Make use of the new "Storage Server", e.g. complete OSD backup added
Updated by okurz almost 3 years ago
- Status changed from New to Blocked
- Assignee set to okurz
Updated by okurz almost 3 years ago
- Subject changed from Use openQA archiving feature on osd to Use openQA archiving feature on osd size:S
Updated by okurz over 2 years ago
- Copied to action #103953: Use openQA archiving feature on o3 size:S added
Updated by okurz over 2 years ago
- Status changed from Blocked to Feedback
Updated by okurz over 2 years ago
Was merged and activated. Trying to see on https://openqa.suse.de/minion/jobs?task=limit_results_and_logs how it behaves.
Updated by okurz over 2 years ago
- Related to action #104136: "archive_job_results" fail with "Unable to copy ... File exists" size:M added
Updated by okurz over 2 years ago
https://openqa.suse.de/minion/jobs?task=archive_job_results shows quite some success. Multiple jobs have been successfully moved to the archive, e.g. https://openqa.suse.de/tests/7314117 . In https://monitor.qa.suse.de/d/WebuiDb/webui-summary?viewPanel=74&orgId=1&from=1639650488173&to=1639727886018 we can see that the usage of the results partition reduced from 80% to currently 67% and "space-slow" which holds some assets and the archived results went from 40% to currently 48%. There is a fraction of archive minion jobs that failed, reported in #104136