Project

General

Profile

action #98862

Updated by livdywan almost 2 years ago

Comment about intermittent/sporadic test issues on original job if openqa-investigate retry job passes 

 ## User story 
 When a job fails, we will investigate the job by triggering a new job with different conditions, such as re-run, rerun, re-run with the last good build, or last commit in the test distribution. 
 If a retry job passes, the original job may be a intermittent/sporadic case. 
 We should provide that assessment as a comment back on the original job. 

 ## Acceptance criteria 
 * **AC1:** If an openqa-investigate retry job passes, passes a comment is created on the original job with the assessment that the issue is intermittent or a sporadic test issue 

 ## Suggestions 
 * Call the hook script with a setting to run the hook on passed jobs, e.g. `_TRIGGER_JOB_DONE_HOOK=0` or `=1` 
 * Consider exiting early from openqa-label-known-issues to ensure it does not handle passed jobs 
 * Take a look at how we identify likely sporadic issues as a result of *failed* "retry" jobs in https://github.com/os-autoinst/scripts/blob/master/openqa-investigate#L136= 
 * Extend to react according on *passed* retry 
 * Ensure that hook scripts in github.com/os-autoinst/scripts/ act as one should expect when called on *passed* jobs 
 * Use  
 * Alternative: Extend o3 config to also run job_done_hooks on passed jobs and monitor performance impact 
 * Same on osd as on o3

Back