action #54032

flaky test: t/full-stack.t "not ok 44 - Cache tests", subtest: "not ok 17 - test 6 is passed" at /opt/testing_area/openqa/t/lib/OpenQA/Test/FullstackUtils.pm line 120.

Added by okurz 9 months ago. Updated about 1 month ago.

Status:ResolvedStart date:09/07/2019
Priority:LowDue date:
Assignee:okurz% Done:

0%

Category:Concrete Bugs
Target version:Current Sprint
Difficulty:
Duration:

Description

Observation

see https://travis-ci.org/os-autoinst/openQA/jobs/556194206#L1181

not ok 17 - test 6 is passed
    #   Failed test 'test 6 is passed'
    #   at /opt/testing_area/openqa/t/lib/OpenQA/Test/FullstackUtils.pm line 120.
    #                   'Result: incomplete finished less than a minute ago ( 02:27 minutes )
    # Clone of 5
    # Assigned worker: 295812b45692:1'
    #     doesn't match '(?^:Result: passed)'

Related issues

Related to openQA Project - action #53858: flaky test: 25-cache-service.t Resolved 04/07/2019
Related to openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-sta... Workable 21/06/2018
Related to openQA Project - action #38276: Flaky 'test candidate list' at t/ui/18-tests-details.t Resolved 06/07/2018
Related to openQA Project - action #59043: Fix unstable/flaky full-stack test, i.e. remove sleep Workable 04/11/2019

History

#1 Updated by okurz 8 months ago

#2 Updated by okurz 8 months ago

  • Related to action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.t added

#3 Updated by okurz 8 months ago

  • Related to action #38276: Flaky 'test candidate list' at t/ui/18-tests-details.t added

#4 Updated by okurz 8 months ago

  • Status changed from New to Feedback
  • Assignee set to okurz

https://github.com/os-autoinst/openQA/pull/2259 to remove "travis_retry" again after test stabilization – and proper testing in the PR

#5 Updated by okurz 5 months ago

  • Status changed from Feedback to Workable
  • Assignee deleted (okurz)

We moved to circle CI, I did not yet look into the unstable tests on circle CI but we still have a list with "unstable" tests handled within circle CI as well.

#6 Updated by okurz 2 months ago

  • Related to action #59043: Fix unstable/flaky full-stack test, i.e. remove sleep added

#7 Updated by okurz 2 months ago

  • Status changed from Workable to Feedback
  • Assignee set to okurz

#8 Updated by cdywan about 1 month ago

  • Target version set to Current Sprint

#9 Updated by okurz about 1 month ago

  • Status changed from Feedback to Resolved

The above PR seems to have helped. As our list of "unstable" tests is currently empty but tests seem to be stable I regard this as resolved.

Also available in: Atom PDF