Project

General

Profile

action #54032

flaky test: t/full-stack.t "not ok 44 - Cache tests", subtest: "not ok 17 - test 6 is passed" at /opt/testing_area/openqa/t/lib/OpenQA/Test/FullstackUtils.pm line 120.

Added by okurz 12 months ago. Updated 4 months ago.

Status:
Resolved
Priority:
Low
Assignee:
Category:
Concrete Bugs
Target version:
Start date:
2019-07-09
Due date:
% Done:

0%

Estimated time:
Difficulty:
Duration:

Description

Observation

see https://travis-ci.org/os-autoinst/openQA/jobs/556194206#L1181

not ok 17 - test 6 is passed
    #   Failed test 'test 6 is passed'
    #   at /opt/testing_area/openqa/t/lib/OpenQA/Test/FullstackUtils.pm line 120.
    #                   'Result: incomplete finished less than a minute ago ( 02:27 minutes )
    # Clone of 5
    # Assigned worker: 295812b45692:1'
    #     doesn't match '(?^:Result: passed)'

Related issues

Related to openQA Project - action #53858: flaky test: 25-cache-service.tResolved2019-07-04

Related to openQA Project - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.tWorkable2018-06-21

Related to openQA Project - action #38276: Flaky 'test candidate list' at t/ui/18-tests-details.tResolved2018-07-06

Related to openQA Project - action #59043: Fix unstable/flaky full-stack test, i.e. remove sleep, and ui testsFeedback2019-11-04

History

#1 Updated by okurz 11 months ago

#2 Updated by okurz 11 months ago

  • Related to action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.t added

#3 Updated by okurz 11 months ago

  • Related to action #38276: Flaky 'test candidate list' at t/ui/18-tests-details.t added

#4 Updated by okurz 11 months ago

  • Status changed from New to Feedback
  • Assignee set to okurz

https://github.com/os-autoinst/openQA/pull/2259 to remove "travis_retry" again after test stabilization – and proper testing in the PR

#5 Updated by okurz 9 months ago

  • Status changed from Feedback to Workable
  • Assignee deleted (okurz)

We moved to circle CI, I did not yet look into the unstable tests on circle CI but we still have a list with "unstable" tests handled within circle CI as well.

#6 Updated by okurz 5 months ago

  • Related to action #59043: Fix unstable/flaky full-stack test, i.e. remove sleep, and ui tests added

#7 Updated by okurz 5 months ago

  • Status changed from Workable to Feedback
  • Assignee set to okurz

#8 Updated by cdywan 5 months ago

  • Target version set to Current Sprint

#9 Updated by okurz 4 months ago

  • Status changed from Feedback to Resolved

The above PR seems to have helped. As our list of "unstable" tests is currently empty but tests seem to be stable I regard this as resolved.

Also available in: Atom PDF