Project

General

Profile

Actions
Copy link

action #38276

closed

Flaky 'test candidate list' at t/ui/18-tests-details.t

Added by szarate over 6 years ago. Updated almost 5 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
okurz
Category:
Regressions/Crashes
Target version:
QA (public) - future
Start date:
2018-07-06
Due date:
% Done:

0%

Estimated time:

Description

I've seen this one couple of times already... 

ok 31 - at most one needle is selected at a time (0 selected)
not ok 32 - 100%, 52%
ok 33 - can open JSON file for reading

Files

log.txt (1020 KB) log.txt szarate, 2018-07-06 12:09

Related issues 3 (0 open — 3 closed)

Related to openQA Project (public) - action #54032: flaky test: t/full-stack.t "not ok 44 - Cache tests", subtest: "not ok 17 - test 6 is passed" at /opt/testing_area/openqa/t/lib/OpenQA/Test/FullstackUtils.pm line 120.Resolvedokurz2019-07-09

Actions
Related to openQA Project (public) - action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.tResolvedokurz2018-06-21

Actions
Related to openQA Project (public) - action #53858: flaky test: 25-cache-service.tResolvedokurz2019-07-04

Actions
Actions
Copy link
 #1

Updated by szarate over 6 years ago

  • Subject changed from Flaky 'test candidate list' at t/ui/18-tests-details.t to Flaky 'test candidate list' at t/ui/18-tests-details.t
Actions
Copy link
 #2

Updated by okurz over 5 years ago

  • Category set to Regressions/Crashes
Actions
Copy link
 #3

Updated by okurz over 5 years ago

  • Related to action #54032: flaky test: t/full-stack.t "not ok 44 - Cache tests", subtest: "not ok 17 - test 6 is passed" at /opt/testing_area/openqa/t/lib/OpenQA/Test/FullstackUtils.pm line 120. added
Actions
Copy link
 #4

Updated by okurz over 5 years ago

  • Related to action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.t added
Actions
Copy link
 #5

Updated by okurz over 5 years ago

Actions
Copy link
 #6

Updated by okurz over 5 years ago

  • Status changed from New to Feedback
  • Assignee set to okurz

https://github.com/os-autoinst/openQA/pull/2259 to remove "travis_retry" again after test stabilization – and proper testing in the PR

Actions
Copy link
 #7

Updated by tinita over 5 years ago

I wonder why there isn't more output.
The test in question is is_deeply, which should at least report the difference...

Actions
Copy link
 #8

Updated by okurz about 5 years ago

  • Status changed from Feedback to Workable
  • Assignee deleted (okurz)

We moved to circle CI, I did not yet look into the unstable tests on circle CI but we still have a list with "unstable" tests handled within circle CI as well.

Actions
Copy link
 #9

Updated by okurz almost 5 years ago

  • Status changed from Workable to Feedback
  • Assignee set to okurz
Actions
Copy link
 #10

Updated by okurz almost 5 years ago

  • Status changed from Feedback to Resolved

I haven't seen this module failing since 62c5546ad so I assume this fixed it. Also, as our list of "unstable" tests is currently empty but tests seem to be stable I regard this as resolved.

Actions
Copy link

Also available in: Atom PDF