https://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842019-06-20T15:15:56ZopenSUSE Project Management ToolopenQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.thttps://progress.opensuse.org/issues/37638?journal_id=2221252019-06-20T15:15:56Zokurzokurz@suse.com
<ul><li><strong>Category</strong> set to <i>Regressions/Crashes</i></li></ul> openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.thttps://progress.opensuse.org/issues/37638?journal_id=2346322019-08-13T09:46:15Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-3 priority-lowest closed" href="/issues/54032">action #54032</a>: flaky test: t/full-stack.t "not ok 44 - Cache tests", subtest: "not ok 17 - test 6 is passed" at /opt/testing_area/openqa/t/lib/OpenQA/Test/FullstackUtils.pm line 120.</i> added</li></ul> openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.thttps://progress.opensuse.org/issues/37638?journal_id=2346502019-08-13T09:53:57Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-4 priority-default closed" href="/issues/38276">action #38276</a>: Flaky 'test candidate list' at t/ui/18-tests-details.t</i> added</li></ul> openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.thttps://progress.opensuse.org/issues/37638?journal_id=2346742019-08-13T10:05:10Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Feedback</i></li><li><strong>Assignee</strong> set to <i>okurz</i></li></ul><p><a href="https://github.com/os-autoinst/openQA/pull/2259" class="external">https://github.com/os-autoinst/openQA/pull/2259</a> to remove "travis_retry" again after test stabilization – and proper testing in the PR</p>
openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.thttps://progress.opensuse.org/issues/37638?journal_id=2348482019-08-13T16:00:50Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-4 priority-default closed" href="/issues/55460">action #55460</a>: flaky test: t/33-developer_mode.t - not ok 308 - Wait for (?^:\"set_pause_on_screen_mismatch\":\"assert_screen\") timed out</i> added</li></ul> openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.thttps://progress.opensuse.org/issues/37638?journal_id=2348542019-08-13T16:00:56Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-4 priority-default closed" href="/issues/55457">action #55457</a>: flaky test: t/api/11-bugs.t</i> added</li></ul> openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.thttps://progress.opensuse.org/issues/37638?journal_id=2348602019-08-13T16:01:01Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-3 priority-lowest closed" href="/issues/53858">action #53858</a>: flaky test: 25-cache-service.t</i> added</li></ul> openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.thttps://progress.opensuse.org/issues/37638?journal_id=2348662019-08-13T16:01:26Zokurzokurz@suse.com
<ul></ul><p>Three issues found:</p>
<ul>
<li>25-cache-service.t: <a class="issue tracker-4 status-3 priority-3 priority-lowest closed" title="action: flaky test: 25-cache-service.t (Resolved)" href="https://progress.opensuse.org/issues/53858">#53858</a></li>
<li>api/11-bugs.t: <a class="issue tracker-4 status-3 priority-4 priority-default closed" title="action: flaky test: t/api/11-bugs.t (Resolved)" href="https://progress.opensuse.org/issues/55457">#55457</a></li>
<li>33-developer_mode.t: <a class="issue tracker-4 status-3 priority-4 priority-default closed" title="action: flaky test: t/33-developer_mode.t - not ok 308 - Wait for (?^:\"set_pause_on_screen_mismatch\":\"... (Resolved)" href="https://progress.opensuse.org/issues/55460">#55460</a></li>
</ul>
<p>After these are fixed we can come back to this specific and reconduct a full test run and see if it still appears.</p>
openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.thttps://progress.opensuse.org/issues/37638?journal_id=2516752019-10-21T16:14:49Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>Feedback</i> to <i>Workable</i></li><li><strong>Assignee</strong> deleted (<del><i>okurz</i></del>)</li></ul><p>We moved to circle CI, I did not yet look into the unstable tests on circle CI but we still have a list with "unstable" tests handled within circle CI as well.</p>
openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.thttps://progress.opensuse.org/issues/37638?journal_id=2716702020-01-15T15:29:12Zokurzokurz@suse.com
<ul></ul><p><a href="https://circleci.com/gh/os-autoinst/openQA/10986?utm_campaign=workflow-failed&utm_medium=email&utm_source=notification" class="external">https://circleci.com/gh/os-autoinst/openQA/10986?utm_campaign=workflow-failed&utm_medium=email&utm_source=notification</a> shows</p>
<pre><code>while :; do\
[ $n -lt "3" ] || exit 1;\
[ $n -eq 0 ] || echo Retrying...;\
prove -l --harness TAP::Harness::JUnit t/full-stack.t && break;\
n=$[$n+1];\
done
t/full-stack.t .. 40/?
# Failed test 'Test 4 crashed as expected'
# at /home/squamata/project/t/lib/OpenQA/Test/FullstackUtils.pm line 120.
# 'State: scheduled
# 50'
# doesn't match '(?^:Result: incomplete)'
t/full-stack.t .. 41/?
# Failed test 'job is running'
# at /home/squamata/project/t/lib/OpenQA/Test/FullstackUtils.pm line 120.
# 'State: scheduled
# Clone of 3
# 50'
# doesn't match '(?^:State: running)'
# Failed test 'findElement: no such element: Unable to locate element: {"method":"link text","selector":"Live View"}'
# at /home/squamata/project/t/lib/OpenQA/SeleniumTest.pm line 150.
# Failed test 'clickElement: stale element reference: element is not attached to the page document'
# at /home/squamata/project/t/lib/OpenQA/SeleniumTest.pm line 150.
make[1]: *** [Makefile:115: test-unit-and-integration] Hangup
make: *** [Makefile:128: test-with-database] Hangup
</code></pre> openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.thttps://progress.opensuse.org/issues/37638?journal_id=2720422020-01-17T05:31:01Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-5 priority-high3 closed" href="/issues/62015">action #62015</a>: jobs incomplete without logs as some workers are rejected (was: Scheduler does not work)</i> added</li></ul> openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.thttps://progress.opensuse.org/issues/37638?journal_id=3267702020-09-24T05:13:01Zokurzokurz@suse.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-4 status-3 priority-4 priority-default closed" href="/issues/71554">action #71554</a>: unstable/flaky/sporadic t/full-stack.t test failing in script waits on CircleCI</i> added</li></ul> openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.thttps://progress.opensuse.org/issues/37638?journal_id=3460632020-11-03T10:41:52Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>Workable</i> to <i>Resolved</i></li><li><strong>Assignee</strong> set to <i>okurz</i></li></ul><p>I think we have this covered. I did a lot of tests for stability of t/full-stack.t and this seems to have gone, not sure which specific change though. In ac0ccca26 we have removed retries for t/full-stack.t</p>