action #97412: Reduce I/O load on OSD by using more cache size on workers with using free disk space when available instead of hardcoded space - openQA Infrastructure (public) - openSUSE Project Management Tool

Actions

action #97412

open

openQA Project (public) - coordination #103944: [saga][epic] Scale up: More robust handling of diverse infrastructure with varying performance

openQA Project (public) - coordination #98463: [epic] Avoid too slow asset downloads leading to jobs exceeding the timeout with or run into auto_review:"(timeout: setup exceeded MAX_SETUP_TIME|Cache service queue already full)":retry

Reduce I/O load on OSD by using more cache size on workers with using free disk space when available instead of hardcoded space

Added by okurz over 3 years ago. Updated over 3 years ago.

Status:

New

Priority:

Normal

Assignee:

Category:

Target version:

QA (public) - future

Start date:

Due date:

% Done:

Estimated time:

Description

Motivation¶

I am sure we could spread the load on OSD when many job start a bit if we manage to have less assets that need to be downloaded at the same time. We can increase the cache size, e.g. use all available space instead of the artifical limits of the cache directory.

The worker cache could just ensure a certain percentage of free disk space in the file system.