Looks like this is really just about abandoned jobs because
select count(minion_jobs.id) as minion_job_count, args[0] as openqa_job_id, string_agg(reason, ',') as reasons from minion_jobs join jobs on jobs.id = args[0]::bigint where task = 'finalize_job_results' and not (reason like '%abandoned%') group by args having count(minion_jobs.id) > 1 order by args[0]::bigint desc limit 50;
returns no jobs but
openqa=> select count(minion_jobs.id) as minion_job_count, args[0] as openqa_job_id, string_agg(reason, ',') as reasons from minion_jobs join jobs on jobs.id = args[0]::bigint where task = 'finalize_job_results' group by args having count(minion_jobs.id) > 1 order by args[0]::bigint desc limit 50;
returned many:
minion_job_count | openqa_job_id | reasons
------------------+---------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
3 | 15998350 | abandoned: associated worker sapworker1:25 has not sent any status updates for too long,abandoned: associated worker sapworker1:25 has not sent any status updates for too long,abandoned: associated worker sapworker1:25 has not sent any status updates for too long
3 | 15998310 | abandoned: associated worker sapworker1:25 has not sent any status updates for too long,abandoned: associated worker sapworker1:25 has not sent any status updates for too long,abandoned: associated worker sapworker1:25 has not sent any status updates for too long
3 | 15997970 | abandoned: associated worker sapworker1:14 has not sent any status updates for too long,abandoned: associated worker sapworker1:14 has not sent any status updates for too long,abandoned: associated worker sapworker1:14 has not sent any status updates for too long
3 | 15997722 | abandoned: associated worker sapworker1:15 has not sent any status updates for too long,abandoned: associated worker sapworker1:15 has not sent any status updates for too long,abandoned: associated worker sapworker1:15 has not sent any status updates for too long
3 | 15997699 | abandoned: associated worker sapworker1:19 has not sent any status updates for too long,abandoned: associated worker sapworker1:19 has not sent any status updates for too long,abandoned: associated worker sapworker1:19 has not sent any status updates for too long
3 | 15997698 | abandoned: associated worker sapworker1:22 has not sent any status updates for too long,abandoned: associated worker sapworker1:22 has not sent any status updates for too long,abandoned: associated worker sapworker1:22 has not sent any status updates for too long
3 | 15997688 | abandoned: associated worker sapworker1:17 has not sent any status updates for too long,abandoned: associated worker sapworker1:17 has not sent any status updates for too long,abandoned: associated worker sapworker1:17 has not sent any status updates for too long
3 | 15997687 | abandoned: associated worker sapworker1:20 has not sent any status updates for too long,abandoned: associated worker sapworker1:20 has not sent any status updates for too long,abandoned: associated worker sapworker1:20 has not sent any status updates for too long
3 | 15997656 | abandoned: associated worker sapworker1:25 has not sent any status updates for too long,abandoned: associated worker sapworker1:25 has not sent any status updates for too long,abandoned: associated worker sapworker1:25 has not sent any status updates for too long
3 | 15997655 | abandoned: associated worker sapworker1:16 has not sent any status updates for too long,abandoned: associated worker sapworker1:16 has not sent any status updates for too long,abandoned: associated worker sapworker1:16 has not sent any status updates for too long
3 | 15997654 | abandoned: associated worker sapworker1:13 has not sent any status updates for too long,abandoned: associated worker sapworker1:13 has not sent any status updates for too long,abandoned: associated worker sapworker1:13 has not sent any status updates for too long
3 | 15997653 | abandoned: associated worker sapworker1:14 has not sent any status updates for too long,abandoned: associated worker sapworker1:14 has not sent any status updates for too long,abandoned: associated worker sapworker1:14 has not sent any status updates for too long
3 | 15997569 | abandoned: associated worker sapworker1:37 has not sent any status updates for too long,abandoned: associated worker sapworker1:37 has not sent any status updates for too long,abandoned: associated worker sapworker1:37 has not sent any status updates for too long
3 | 15997489 | abandoned: associated worker sapworker1:15 has not sent any status updates for too long,abandoned: associated worker sapworker1:15 has not sent any status updates for too long,abandoned: associated worker sapworker1:15 has not sent any status updates for too long
3 | 15997466 | abandoned: associated worker sapworker1:25 has not sent any status updates for too long,abandoned: associated worker sapworker1:25 has not sent any status updates for too long,abandoned: associated worker sapworker1:25 has not sent any status updates for too long
3 | 15997465 | abandoned: associated worker sapworker1:16 has not sent any status updates for too long,abandoned: associated worker sapworker1:16 has not sent any status updates for too long,abandoned: associated worker sapworker1:16 has not sent any status updates for too long
…