action #55652
closedaction #55178: ** PROBLEM Service Alert: openqa.suse.de/fs_/var/lib/openqa is WARNING **
** PROBLEM Service Alert: openqa.suse.de/fs_/var/lib/openqa is WARNING ** - Cleanup of results+logs
0%
Description
This ticket should focus on results+logs rather than assets. I conducted a query in the database to see which job group is excessive with the age of results or logs it wants to save:
openqa=> select id,name,size_limit_gb,parent_id,keep_results_in_days,keep_logs_in_days from job_groups where (keep_results_in_days > '90' or keep_logs_in_days > '90') order by keep_results_in_days DESC;
id | name | size_limit_gb | parent_id | keep_results_in_days | keep_logs_in_days
-----+-----------------------------------------------+---------------+-----------+----------------------+-------------------
115 | Virtualization-Acceptance | 5 | 25 | 365 | 30
136 | MicroOS 3.0 - DVD | 0 | 16 | 365 | 30
85 | SLE 12 SP3 Migration (post): Server | 1 | 1 | 365 | 30
178 | CaaSP 4.0 - DVD | 13 | 18 | 365 | 30
187 | Maintenance: SLES4SAP 12 SP3 | 6 | 21 | 365 | 30
134 | CaaSP 3.0 - DVD | 10 | 16 | 365 | 30
213 | Virtualization-Milestone | 20 | 25 | 365 | 30
130 | HPC | 5 | 15 | 365 | 30
216 | Maintenance: SLE 12 SP4 HPC Incidents | 20 | 21 | 365 | 30
257 | File Systems | 80 | 15 | 365 | 30
224 | Maintenance: SLE 12 GA Update Install | 100 | 1 | 365 | 30
260 | SLES4SAP+HA 15 Public Cloud | 10 | | 365 | 30
191 | Maintenance: 12-SP3-TERADATA Incidents | 12 | 21 | 365 | 30
198 | RT Acceptance: SLE 12 SP4 | 20 | 9 | 365 | 200
145 | SLE 15 Migration (post) | 10 | 1 | 365 | 30
111 | Migration | 40 | 25 | 365 | 30
217 | Maintenance: SLE 12 SP4 HA Incidents | 20 | 21 | 365 | 30
193 | Maintenance: 12-SP3-TERADATA Kernel Incidents | 8 | 21 | 365 | 30
129 | YaST | 40 | 15 | 365 | 30
182 | MicroOS 4.0 - VMX | 10 | 18 | 365 | 30
181 | MicroOS 4.0 - DVD | 13 | 18 | 365 | 30
219 | SLES 15 Public Cloud | 100 | | 365 | 30
117 | Network | 5 | 25 | 365 | 30
222 | Migration : Milestone | 60 | 25 | 365 | 30
137 | MicroOS 3.0 - VMX | 0 | 16 | 365 | 30
179 | CaaSP 4.0 - VMX | 20 | 18 | 365 | 30
228 | Maintenance: SLE 12-SP4 Update Install | 100 | 1 | 365 | 30
113 | Security | 30 | 25 | 365 | 30
(28 rows)
Updated by okurz over 4 years ago
- Status changed from New to Feedback
- Assignee set to okurz
I sent an email to openqa@suse.de and other MLs asking for help, in particular about the issue described in this ticket.
Updated by coolo over 4 years ago
We already got another 5TB volume that I intent to use for /assets - but we need to format it under kernel > 4.10 or we still won't be able to use reflinks on xfs. And as such the order is:
- upgrade to 15
- format /assets
- move share/factory there
- shrink /var/lib/openqa
Updated by okurz over 4 years ago
- Related to action #54137: Upgrade osd to a supported Leap version (from 42.3) added
Updated by okurz over 4 years ago
- Status changed from Feedback to Resolved
All points from comment 2 were done except the shrinking as we tricked Engineering Infrastructure and they can't resize the volume without moving to another, newer rack or something. AFAIU coolo was more severe in stripping down the retention periods in all job groups by himself so problem solved.