action #67087
opencoordination #92323: [saga][epic] Scale up: Fine-grained control over use and removal of results, assets, test data
Allow to configure retention period for the video individually
0%
Description
problem¶
The video often needs the most disk space but is not necessarily very important. Hence it makes sense to allow configuring the retention period for the video individually.
This is for instance the case for the filesystem group on OSD but it makes generally sense for jobs which take long to execute (and therefore have a long video).
acceptance criteria¶
AC1: The retention period for videos is configurable on job group level similarly to the already existing retention periods. That includes the possibility to set a distinct value for important builds.
AC2: The GRU task for cleaning results and logs deletes videos of jobs when the configured retention period has been expired.
AC3: When the retention period for logs or all results has been expired anyways the behavior does not change. (This feature is not meant to keep videos "extra long".)
notes¶
- When adding another cleanup configuration we can also implement the idea mentioned here. This retention period would allow to remove everything from the disk but still keep only the job entry in the database. (Job settings should likely be deleted as well.)
- Maybe it makes sense to refactor the UI code a little bit so it does not become even more repetitive.
- Not sure whether it makes sense follow the current approach and add a column
video_present
to the jobs table like the already existing columnlogs_present
. An extra column for every details we might want to configure specifically doesn't make sense. So maybe we betterstat
for the video on the fly iflogs_present
is true or simply try to delete and ignore if it fails because it doesn't exist.