Project

General

Profile

Actions

action #92788

closed

coordination #64746: [saga][epic] Scale up: Efficient handling of large storage to be able to run current tests efficiently but keep big archives of old results

coordination #80546: [epic] Scale up: Enable to store more results

Use openQA archiving feature on osd size:S

Added by okurz over 3 years ago. Updated almost 3 years ago.

Status:
Resolved
Priority:
Low
Assignee:
Category:
Feature requests
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:

Description

Motivation

See parent #80546 . To be able to scale-up openQA we want to be able to separate recent openQA results (on expensive+fast storage) from older, important openQA results (on slow+cheap storage). With #91782 we have an archiving feature which we can use within osd in conjunction with storage.qa.suse.de

Acceptance criteria

  • AC1: results on openQA osd can be automatically archived to /space-slow on osd itself

Suggestions

  • Make all the changes persistent within salt
  • Enable in /etc/openqa/openqa.ini

Related issues 4 (0 open4 closed)

Related to openQA Project - action #104136: "archive_job_results" fail with "Unable to copy ... File exists" size:MResolvedmkittler2021-12-17

Actions
Blocked by openQA Infrastructure - action #88546: Make use of the new "Storage Server", e.g. complete OSD backupResolvedokurz

Actions
Copied from openQA Project - action #91782: Add support for archived jobsResolvedmkittler2021-04-26

Actions
Copied to openQA Project - action #103953: Use openQA archiving feature on o3 size:SResolvedokurz2021-12-14

Actions
Actions #1

Updated by okurz over 3 years ago

Actions #2

Updated by mkittler over 3 years ago

  • Assignee set to mkittler

I've started to work on that as part of #88546.

Actions #3

Updated by mkittler over 3 years ago

  • Assignee deleted (mkittler)
Actions #4

Updated by okurz over 3 years ago

  • Status changed from Workable to New

We should update the ticket to save the archive to /space-slow on OSD instead and save a backup to storage.qa as NetApp storage backing osd is more reliable

Actions #5

Updated by okurz over 3 years ago

  • Description updated (diff)
Actions #6

Updated by okurz over 3 years ago

  • Blocked by action #88546: Make use of the new "Storage Server", e.g. complete OSD backup added
Actions #7

Updated by okurz over 3 years ago

  • Status changed from New to Blocked
  • Assignee set to okurz
Actions #8

Updated by okurz over 3 years ago

  • Subject changed from Use openQA archiving feature on osd to Use openQA archiving feature on osd size:S
Actions #9

Updated by okurz almost 3 years ago

  • Copied to action #103953: Use openQA archiving feature on o3 size:S added
Actions #10

Updated by okurz almost 3 years ago

  • Status changed from Blocked to Feedback
Actions #11

Updated by okurz almost 3 years ago

Was merged and activated. Trying to see on https://openqa.suse.de/minion/jobs?task=limit_results_and_logs how it behaves.

Actions #12

Updated by okurz almost 3 years ago

  • Related to action #104136: "archive_job_results" fail with "Unable to copy ... File exists" size:M added
Actions #13

Updated by okurz almost 3 years ago

https://openqa.suse.de/minion/jobs?task=archive_job_results shows quite some success. Multiple jobs have been successfully moved to the archive, e.g. https://openqa.suse.de/tests/7314117 . In https://monitor.qa.suse.de/d/WebuiDb/webui-summary?viewPanel=74&orgId=1&from=1639650488173&to=1639727886018 we can see that the usage of the results partition reduced from 80% to currently 67% and "space-slow" which holds some assets and the archived results went from 40% to currently 48%. There is a fraction of archive minion jobs that failed, reported in #104136

Actions #14

Updated by okurz almost 3 years ago

  • Status changed from Feedback to Resolved

All good now

Actions

Also available in: Atom PDF