action #161786: QE-Performance team request 2TB storage for performance test data backup size:S - openQA Infrastructure (public) - openSUSE Project Management Tool

Custom queries

openQA Infrastructure Project
openqa-review - Closed tickets last updated by openqa-review, last 30 days
QA roadmap long-term
QA SLE functional
QA SLE Functional - closed in last 14 days
QA SLE Functional - High, need to be refined
QA SLE Functional - over cycle time median
QA SLE u
QA SLE y
QA tools (tag not necessary in openQA and subprojects)
QA tools tag (tag not necessary in openQA and subprojects; excluding tickets in "Ready" version as they are already on the backlog)
QAC - Backlog
QE tools team - backlog (dev)
QE tools team - backlog (ready issues)
QE tools team - backlog SLA high
QE tools team - backlog SLA immediate
QE tools team - backlog SLA no immediate/urgent in feedback/blocked
QE tools team - backlog SLA normal
QE tools team - backlog SLA urgent
QE tools team - backlog SLO high
QE tools team - backlog SLO normal
QE tools team - backlog SLO urgent
QE tools team - backlog, high-level view (epics and higher)
QE tools team - backlog, non-reactive work, needs parent
QE tools team - backlog, top-level view (all sagas)
QE tools team - closed within last 14 days
QE tools team - closed within last 60 days
QE tools team - closed yesterday
QE Tools Team - Collaborative Session
QE tools team - due date forecast
QE tools team - exceeding due-date
QE tools team - infrastructure backlog
QE tools team - next - sorted by update time
QE tools team - next issues
QE tools team - non-estimated (unblocked) issues (dev)
QE tools team - non-estimated (unblocked) issues (infra)
QE tools team - ready issues - Workable
QE tools team - ready, not assigned/blocked/low
QE tools team - SLO high forecast
QE tools team - update forecast
QE tools team - updated by priority
QE tools team - what members of the team are working on - Feedback (not-low)
QE Tools Team Backlog By Assignee
Tools Team Retrospective
Tools Team Retrospective (not estimated or assigned)

Actions

Copy link

action #161786

closed

QE-Performance team request 2TB storage for performance test data backup size:S

Added by cachen 7 months ago. Updated 6 months ago.

Status:

Resolved

Priority:

Normal

Assignee:

okurz

Category:

Support

Target version:

openQA Project (public) - Ready

Start date:

2024-06-05

Due date:

% Done:

Estimated time:

Tags:

storage, salt, infra, backup

Description

Motivation¶

Backup performance test data from dashboard.qa2.suse.asia to reduce the risk of loosing test result by any incident in the service or physical hardware.
Performance comparison test result and test raw data are presenting in performance dashboard and linking in bug report, loosing the data will critically block performance test/debug progress.

Requirement¶

2TB storage size sharing in storage.qe.prg2.suse.org by both TFTP and NFS way for QE-Performance team to syncing their test results from 10.67.128.0/24.

Contact person¶

@jerrytang Jerry Tang and @JNa Joyce Na

Acceptance Criteria¶

AC1: 2TB of storage is accessible and available for use by the team

Suggestions¶

Adapt/use/copy the current NFS+FTP server states from the webui role to the storage role as well and apply for storage.qe.prg2.suse.org
Ensure the team has access to read and write to the server e.g. sftp using existing keys

History
Notes
Property changes

Actions

Copy link

Updated by okurz 7 months ago

Assignee set to okurz
Target version set to Ready

Are you sure you want to upload data using TFTP or do you mean FTP?
We can setup an FTP+NFS server on storage.qe.prg2.suse.org and you can upload data there, ok?

Actions

Copy link

Updated by cachen 7 months ago

okurz wrote in #note-1:

Are you sure you want to upload data using TFTP or do you mean FTP?
We can setup an FTP+NFS server on storage.qe.prg2.suse.org and you can upload data there, ok?

Hello Oliver, thank you for the offer, FTP+NFS is fine!

Actions

Copy link

Updated by okurz 7 months ago

Tags set to infra, salt, storage, backup
Status changed from New to In Progress

Actions

Copy link

Updated by livdywan 7 months ago

Subject changed from QE-Performance team request 2TB storage for performance test data backup to QE-Performance team request 2TB storage for performance test data backup size:S
Description updated (diff)

Actions

Copy link

Updated by okurz 7 months ago

On the host storage.qe.prg2.suse.org I prepared a folder /storage/backup:

mkdir -p /storage/backup
chown .users /storage/backup
chmod g+w /storage/backup

@jerrytang @JNa as the host storage.qe.prg2.suse.org is already under salt-control all user accounts that are in https://gitlab.suse.de/openqa/salt-pillars-openqa/-/blob/master/sshd/users.sls already have ssh access. that you could use for the purpose of storing backups using ssh as an access protocol so for example using ssh/scp/rsync/unison. I think that is enough and also easier than using FTP or NFS. Can you work with that or do you actually need NFS and/or FTP?

Actions

Copy link

Updated by okurz 7 months ago

Status changed from In Progress to Feedback

Waiting for response for continuing. I have prepared changes for salt to enable FTP/NFS at least readonly but would only deploy that if necessary.

Actions

Copy link

Updated by jerrytang 7 months ago

okurz wrote in #note-5:

On the host storage.qe.prg2.suse.org I prepared a folder /storage/backup:
mkdir -p /storage/backup
chown .users /storage/backup
chmod g+w /storage/backup
@jerrytang @JNa as the host storage.qe.prg2.suse.org is already under salt-control all user accounts that are in https://gitlab.suse.de/openqa/salt-pillars-openqa/-/blob/master/sshd/users.sls already have ssh access. that you could use for the purpose of storing backups using ssh as an access protocol so for example using ssh/scp/rsync/unison. I think that is enough and also easier than using FTP or NFS. Can you work with that or do you actually need NFS and/or FTP?

I think rsync is good way to sync, I'd like to use it.

How would we apply for the access for storage.qe.prg2.suse.org ? by just submit MR for this https://gitlab.suse.de/openqa/salt-pillars-openqa/-/blob/master/sshd/users.sls ?

Thanks

Actions

Copy link