Actions
action #40811
closedSingle Machine jobs starve clusters
Start date:
2018-09-10
Due date:
% Done:
0%
Estimated time:
Description
As the scheduler tries to fill all available slots, the workers that can run
multi machine and single machine jobs will be filled with single machine jobs
as the clusters don't fit. The only way that clusters fit is if 4 jobs finish
within one scheduling round.
This is a tricky problem in general, but it has been solved before :)
Updated by coolo over 6 years ago
The general idea is: whenver a job would be scheduled according to priority - but can't be scheduled due to cluster dependency, we increase a counter (or decrease the priority).
Once that counter reached a limit (or the priority turned 0), we reserve a worker slot for the job - and just won't allocate it until we have the full cluster.
Updated by coolo over 6 years ago
- Target version changed from Ready to Current Sprint
Updated by coolo about 6 years ago
- Status changed from New to Resolved
Updated by szarate about 6 years ago
- Target version changed from Current Sprint to Done
Updated by coolo about 6 years ago
- Target version changed from Done to Current Sprint
Updated by coolo about 6 years ago
- Target version changed from Current Sprint to Done
Actions