Project

General

Profile

action #68836

t/api/14-plugin_obs_rsync_async.t fails sporadically in OBS

Added by okurz about 1 year ago. Updated about 1 year ago.

Status:
Workable
Priority:
Low
Assignee:
-
Category:
Concrete Bugs
Target version:
Start date:
2020-07-10
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

https://build.opensuse.org/package/live_build_log/devel:openQA:TestGithub:PR-3251/openQA/openSUSE_Tumbleweed/x86_64

[ 1127s]     # Premature connection close
[ 1127s] 
[ 1127s]     #   Failed test 'PUT /api/v1/obs_rsync/Proj1/runs'
[ 1127s]     #   at ./t/api/14-plugin_obs_rsync_async.t line 163.
[ 1127s] 
[ 1127s]     #   Failed test 'Proj1 just starts as gru should empty queue for now'
[ 1127s]     #   at ./t/api/14-plugin_obs_rsync_async.t line 163.
[ 1127s]     #          got: undef
[ 1127s]     #     expected: '201'
[ 1127s]     # Looks like you failed 2 tests of 22.
[ 1127s] 
[ 1127s] #   Failed test 'test concurrenctly long running jobs'
[ 1127s] #   at ./t/api/14-plugin_obs_rsync_async.t line 168.
[ 1127s] 
[ 1127s] #   Failed test 'Number of finished jobs'
[ 1127s] #   at ./t/api/14-plugin_obs_rsync_async.t line 173.
[ 1127s] #          got: '4'
[ 1127s] #     expected: '5'
[ 1132s] 
[ 1132s] #   Failed test 'Number of finished jobs'
[ 1132s] #   at ./t/api/14-plugin_obs_rsync_async.t line 182.
[ 1132s] #          got: '9'
[ 1132s] #     expected: '10'
[ 1133s] 
[ 1133s] #   Failed test 'Number of finished jobs'
[ 1133s] #   at ./t/api/14-plugin_obs_rsync_async.t line 189.
[ 1133s] #          got: '9'
[ 1133s] #     expected: '10'
[ 1145s] 
[ 1145s]     #   Failed test 'Job should retry succeed'
[ 1145s]     #   at ./t/api/14-plugin_obs_rsync_async.t line 209.
[ 1145s]     #          got: '10'
[ 1145s]     #     expected: '11'
[ 1145s]     # Looks like you failed 1 test of 6.
[ 1145s] 
[ 1145s] #   Failed test 'test max retry count'
[ 1145s] #   at ./t/api/14-plugin_obs_rsync_async.t line 219.
[ 1149s] # Looks like you failed 5 tests of 10.

Acceptance criteria

  • AC1: t/api/14-plugin_obs_rsync_async.t is stable in 20/20 tries within OBS checks
  • AC2: t/api/14-plugin_obs_rsync_async.t is removed from any workaround handling, e.g. within openQA.spec

Suggestions

  • Exclude from normal testing on OBS side
  • Try to reproduce to gather fail ratio within OBS
  • Identify causes of sporadic failures and fix in either production code or tests
  • Prove stability locally and in CI
  • Remove from .circleci/unstable_tests.txt and/or openQA.spec again

Related issues

Related to openQA Project - action #59043: Fix unstable/flaky full-stack test, i.e. remove sleep, and ui testsResolved2019-11-04

History

#1 Updated by okurz about 1 year ago

  • Status changed from Workable to Feedback

#2 Updated by okurz about 1 year ago

  • Related to action #59043: Fix unstable/flaky full-stack test, i.e. remove sleep, and ui tests added

#3 Updated by okurz about 1 year ago

  • Status changed from Feedback to Workable
  • Assignee deleted (okurz)
  • Priority changed from High to Low
  • Target version changed from Ready to future

disabled from tests for now.

Also available in: Atom PDF