Project

General

Profile

Actions

action #88546

closed

openQA Project - coordination #64746: [saga][epic] Scale up: Efficient handling of large storage to be able to run current tests efficiently but keep big archives of old results

openQA Project - coordination #80546: [epic] Scale up: Enable to store more results

Make use of the new "Storage Server", e.g. complete OSD backup

Added by okurz about 3 years ago. Updated about 2 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:

Description

Acceptance criteria

  • AC1: The SUSE QA storage server is used within our production and we (the team) know what is used for

Suggestions

  • Ask nsinger where to connect to, what steps to start with? The hostname is storage.qa.suse.de
  • Try to connect to storage.qa with the same credentials as for osd machines maintained with salt, e.g. just ssh with your user should work SSH access should work at this point
  • Add changes and make sure the changes are in salt
    • When populating the btrfs filesystem storage.qa.suse.de:/storage it would make sense to create dedicated subvolumes for different things
      • e.g. do a full or partial backup of OSD
      • e.g. mount storage.qa.suse.de:/storage on OSD and configure the archiving feature to use it
  • What is included in a complete OSD backup?: To be answered by #96269
  • Also include postgres? okurz: No, to be covered by #94015
  • Which backups solution to use, e.g. rsnapshot?: okurz: Yes, use rsnapshot, same as we currently do on backup.qa.suse.de already

Further details

If we try to conduct a "complete OSD backup" by this we can also learn the performance impact, e.g. how long does it initially take to synchronize, how long does it take to do individual, e.g. daily syncs


Related issues 6 (0 open6 closed)

Related to openQA Infrastructure - action #92701: backup of etc/ from both o3 was not working since some days due to OOM on backup.qa.suse.de (was: … and osd not updated anymore since 2019)Resolvedmkittler2021-05-142021-06-30

Actions
Related to openQA Infrastructure - action #44078: Implement proper backups for o3 size:MResolvedmkittler2018-11-20

Actions
Related to openQA Infrastructure - action #121282: Recover storage.qa.suse.de size:SResolvednicksinger2022-12-01

Actions
Blocks openQA Project - action #92788: Use openQA archiving feature on osd size:SResolvedokurz

Actions
Copied from openQA Infrastructure - action #69577: Handle installation of the new "Storage Server"Resolvednicksinger2020-08-04

Actions
Copied to openQA Infrastructure - action #96269: Define what a "complete OSD backup" should or can includeResolvedokurz2021-07-29

Actions
Actions

Also available in: Atom PDF