Project

General

Profile

action #92788

coordination #64746: [saga][epic] Scale up: Efficient handling of large storage to be able to run current tests efficiently but keep big archives of old results

coordination #80546: [epic] Scale up: Enable to store more results

Use openQA archiving feature on osd size:S

Added by okurz about 1 year ago. Updated 5 months ago.

Status:
Resolved
Priority:
Low
Assignee:
Category:
Feature requests
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Motivation

See parent #80546 . To be able to scale-up openQA we want to be able to separate recent openQA results (on expensive+fast storage) from older, important openQA results (on slow+cheap storage). With #91782 we have an archiving feature which we can use within osd in conjunction with storage.qa.suse.de

Acceptance criteria

  • AC1: results on openQA osd can be automatically archived to /space-slow on osd itself

Suggestions

  • Make all the changes persistent within salt
  • Enable in /etc/openqa/openqa.ini

Related issues

Related to openQA Project - action #104136: "archive_job_results" fail with "Unable to copy ... File exists" size:MResolved2021-12-17

Blocked by openQA Infrastructure - action #88546: Make use of the new "Storage Server", e.g. complete OSD backupResolved

Copied from openQA Project - action #91782: Add support for archived jobsResolved2021-04-26

Copied to openQA Project - action #103953: Use openQA archiving feature on o3 size:SResolved2021-12-14

History

#1 Updated by okurz about 1 year ago

#2 Updated by mkittler 12 months ago

  • Assignee set to mkittler

I've started to work on that as part of #88546.

#3 Updated by mkittler 11 months ago

  • Assignee deleted (mkittler)

#4 Updated by okurz 11 months ago

  • Status changed from Workable to New

We should update the ticket to save the archive to /space-slow on OSD instead and save a backup to storage.qa as NetApp storage backing osd is more reliable

#5 Updated by okurz 10 months ago

  • Description updated (diff)

#6 Updated by okurz 10 months ago

  • Blocked by action #88546: Make use of the new "Storage Server", e.g. complete OSD backup added

#7 Updated by okurz 10 months ago

  • Status changed from New to Blocked
  • Assignee set to okurz

#8 Updated by okurz 10 months ago

  • Subject changed from Use openQA archiving feature on osd to Use openQA archiving feature on osd size:S

#9 Updated by okurz 5 months ago

  • Copied to action #103953: Use openQA archiving feature on o3 size:S added

#10 Updated by okurz 5 months ago

  • Status changed from Blocked to Feedback

#11 Updated by okurz 5 months ago

Was merged and activated. Trying to see on https://openqa.suse.de/minion/jobs?task=limit_results_and_logs how it behaves.

#12 Updated by okurz 5 months ago

  • Related to action #104136: "archive_job_results" fail with "Unable to copy ... File exists" size:M added

#13 Updated by okurz 5 months ago

https://openqa.suse.de/minion/jobs?task=archive_job_results shows quite some success. Multiple jobs have been successfully moved to the archive, e.g. https://openqa.suse.de/tests/7314117 . In https://monitor.qa.suse.de/d/WebuiDb/webui-summary?viewPanel=74&orgId=1&from=1639650488173&to=1639727886018 we can see that the usage of the results partition reduced from 80% to currently 67% and "space-slow" which holds some assets and the archived results went from 40% to currently 48%. There is a fraction of archive minion jobs that failed, reported in #104136

#14 Updated by okurz 5 months ago

  • Status changed from Feedback to Resolved

All good now

Also available in: Atom PDF