action #68836
t/api/14-plugin_obs_rsync_async.t fails sporadically in OBS
Start date:
2020-07-10
Due date:
% Done:
0%
Estimated time:
Difficulty:
Description
Observation¶
[ 1127s] # Premature connection close [ 1127s] [ 1127s] # Failed test 'PUT /api/v1/obs_rsync/Proj1/runs' [ 1127s] # at ./t/api/14-plugin_obs_rsync_async.t line 163. [ 1127s] [ 1127s] # Failed test 'Proj1 just starts as gru should empty queue for now' [ 1127s] # at ./t/api/14-plugin_obs_rsync_async.t line 163. [ 1127s] # got: undef [ 1127s] # expected: '201' [ 1127s] # Looks like you failed 2 tests of 22. [ 1127s] [ 1127s] # Failed test 'test concurrenctly long running jobs' [ 1127s] # at ./t/api/14-plugin_obs_rsync_async.t line 168. [ 1127s] [ 1127s] # Failed test 'Number of finished jobs' [ 1127s] # at ./t/api/14-plugin_obs_rsync_async.t line 173. [ 1127s] # got: '4' [ 1127s] # expected: '5' [ 1132s] [ 1132s] # Failed test 'Number of finished jobs' [ 1132s] # at ./t/api/14-plugin_obs_rsync_async.t line 182. [ 1132s] # got: '9' [ 1132s] # expected: '10' [ 1133s] [ 1133s] # Failed test 'Number of finished jobs' [ 1133s] # at ./t/api/14-plugin_obs_rsync_async.t line 189. [ 1133s] # got: '9' [ 1133s] # expected: '10' [ 1145s] [ 1145s] # Failed test 'Job should retry succeed' [ 1145s] # at ./t/api/14-plugin_obs_rsync_async.t line 209. [ 1145s] # got: '10' [ 1145s] # expected: '11' [ 1145s] # Looks like you failed 1 test of 6. [ 1145s] [ 1145s] # Failed test 'test max retry count' [ 1145s] # at ./t/api/14-plugin_obs_rsync_async.t line 219. [ 1149s] # Looks like you failed 5 tests of 10.
Acceptance criteria¶
- AC1: t/api/14-plugin_obs_rsync_async.t is stable in 20/20 tries within OBS checks
- AC2: t/api/14-plugin_obs_rsync_async.t is removed from any workaround handling, e.g. within openQA.spec
Suggestions¶
- Exclude from normal testing on OBS side
- Try to reproduce to gather fail ratio within OBS
- Identify causes of sporadic failures and fix in either production code or tests
- Prove stability locally and in CI
- Remove from .circleci/unstable_tests.txt and/or openQA.spec again
Related issues
History
#1
Updated by okurz 9 months ago
- Status changed from Workable to Feedback
https://github.com/os-autoinst/openQA/pull/3253 for the first step
#2
Updated by okurz 9 months ago
- Related to action #59043: Fix unstable/flaky full-stack test, i.e. remove sleep, and ui tests added