Project

General

Profile

action #76774

Updated by okurz over 3 years ago

## Observation ### observation 
 The issue has persisted for 2 days now and re-triggering didn't help: https://gitlab.suse.de/openqa/auto-review/-/pipelines 
 I've attached an example log file. 

 In particular, the jobs "monitor and label incomplete jobs - dry run label" (1) and "monitor and label incomplete jobs - osd" (2) fail. I assume (1) is about o3 and (2) is about OSD. 

 ## Acceptance criteria 
 * **AC1:** auto-review gitlab CI pipeline jobs can finish in time, i.e. do not run into timeout 

 ## Suggestions 
 * Investigate the CI jobs 


 ## Additional ### additional notes 

 * I've already tried to reproduce the issue locally. Yesterday and today there were not a big number of incomplete jobs found by `openqa-monitor-incompletes`. That counts for o3 and OSD. So the problem is not just caused by too many incomplete jobs. 
 * Likely some `openqa-client` call hangs. 
 * I wasn't able to conduct a non-dry run locally where it would actually label some jobs. It is unclear how to reproduce the issue outside of the CI and whether the issue is CI-specific or not.

Back