QA » openQA Project

Observation¶

https://build.opensuse.org/package/live_build_log/devel:openQA:TestGithub:PR-3251/openQA/openSUSE_Tumbleweed/x86_64

[ 1127s]     # Premature connection close
[ 1127s] 
[ 1127s]     #   Failed test 'PUT /api/v1/obs_rsync/Proj1/runs'
[ 1127s]     #   at ./t/api/14-plugin_obs_rsync_async.t line 163.
[ 1127s] 
[ 1127s]     #   Failed test 'Proj1 just starts as gru should empty queue for now'
[ 1127s]     #   at ./t/api/14-plugin_obs_rsync_async.t line 163.
[ 1127s]     #          got: undef
[ 1127s]     #     expected: '201'
[ 1127s]     # Looks like you failed 2 tests of 22.
[ 1127s] 
[ 1127s] #   Failed test 'test concurrenctly long running jobs'
[ 1127s] #   at ./t/api/14-plugin_obs_rsync_async.t line 168.
[ 1127s] 
[ 1127s] #   Failed test 'Number of finished jobs'
[ 1127s] #   at ./t/api/14-plugin_obs_rsync_async.t line 173.
[ 1127s] #          got: '4'
[ 1127s] #     expected: '5'
[ 1132s] 
[ 1132s] #   Failed test 'Number of finished jobs'
[ 1132s] #   at ./t/api/14-plugin_obs_rsync_async.t line 182.
[ 1132s] #          got: '9'
[ 1132s] #     expected: '10'
[ 1133s] 
[ 1133s] #   Failed test 'Number of finished jobs'
[ 1133s] #   at ./t/api/14-plugin_obs_rsync_async.t line 189.
[ 1133s] #          got: '9'
[ 1133s] #     expected: '10'
[ 1145s] 
[ 1145s]     #   Failed test 'Job should retry succeed'
[ 1145s]     #   at ./t/api/14-plugin_obs_rsync_async.t line 209.
[ 1145s]     #          got: '10'
[ 1145s]     #     expected: '11'
[ 1145s]     # Looks like you failed 1 test of 6.
[ 1145s] 
[ 1145s] #   Failed test 'test max retry count'
[ 1145s] #   at ./t/api/14-plugin_obs_rsync_async.t line 219.
[ 1149s] # Looks like you failed 5 tests of 10.

Acceptance criteria¶

• AC1: t/api/14-plugin_obs_rsync_async.t is stable in 20/20 tries within OBS checks
• AC2: t/api/14-plugin_obs_rsync_async.t is removed from any workaround handling, e.g. within openQA.spec

Suggestions¶

• Exclude from normal testing on OBS side
• Try to reproduce to gather fail ratio within OBS
• Identify causes of sporadic failures and fix in either production code or tests
• Prove stability locally and in CI
• Remove from .circleci/unstable_tests.txt and/or openQA.spec again