Project

General

Profile

action #129619

Updated by okurz 9 months ago

## Motivation 
 OSD suffers from high response times or alerts about http responses. As it's likely due to too many jobs trying to upload concurrently we should introduce limits. Likely the easiest limit is on the number of jobs that the scheduler assigns to workers to prevent too many running in parallel 

 ## Acceptance criteria 
 * **AC1:** openQA configuration options can limit the number of jobs that will be picked up at once currently uploading 
 * **AC2:** By default there is no limit 

 ## Suggestions 
 * Look into the scheduler code, likely in lib/OpenQA/Scheduler/Model/Jobs.pm . code. Maybe it is possible to simply not assign any jobs to workers based on a config setting, if defined 
 * Confirm in production, e.g. try it out on OSD 
 * Come up with a good limit for osd 

 ## Further details 
 * by default "no limit" because otherwise admins and users might be surprised if jobs are limited and they never configured something 

 ## Out of scope 
 * Type of workers or type of jobs don't matter. Of course jobs with 10k job modules are more heavy but here we really focus on the number of jobs

Back