Project

General

Profile

action #64574

Updated by okurz about 4 years ago

## Problem ### problem and use case 

 The disk space used by job results [on OSD is increasing](https://stats.openqa-monitor.qa.suse.de/d/WebuiDb/webui-summary?orgId=1&refresh=30s&fullscreen&panelId=74&from=now-7d&to=now) despite the nightly cleanup. It is not clear how the different job groups contribute to that growth. As admin of that instance it would be helpful to know so e.g. cleanup quotas can be adjusted accordingly. 


 ## Notes 

 ### notes 

 For assets the cleanup quote is defined by a max. total file size for each group and the size of each asset is tracked. For results/logs there is just a time limit for each group and we don't keep track of the occupied disk space at all. 


 ## Suggestions 

 ### suggestions 

 1. Keep track of the disk space occupied by results/logs. 
     * The PR https://github.com/os-autoinst/openQA/pull/2845 implements that on job level. 
         * Statistics for whole groups can be easily accumulated. 
         * Shared screenshots are accounted to *each* job using them individually. Not sure whether that is sufficient. 
 2. Show the data gathered via 1. for each job group in a graph on https://stats.openqa-monitor.qa.suse.de. 
 3. Extend the result cleanup to allow a file size based quota if it turns out that the time based quote is not useful even with 1. and 2..

Back