Project

General

Profile

Actions

action #108659

closed

t/22-dashboard.t fails in one step but overall test still succeeds, maybe Test::Warnings?

Added by okurz over 2 years ago. Updated over 2 years ago.

Status:
Rejected
Priority:
Low
Assignee:
Category:
Regressions/Crashes
Target version:
Start date:
2022-03-21
Due date:
% Done:

0%

Estimated time:

Description

Observation

I found that t/22-dashboard.t sporadically failed for me like this:

t/22-dashboard.t .. 161/?
    #   Failed test '200 OK'
    #   at t/22-dashboard.t line 432.
    #          got: '500'
    #     expected: '200'

    #   Failed test 'parent group builds shown sorted by date'
    #   at t/22-dashboard.t line 434.
    #     Structures begin differing at:
    #          $got->[0] = Does not exist
    #     $expected->[0] = '42.2-Build0002'
    # Looks like you failed 2 tests of 19.
t/22-dashboard.t .. ok
All tests successful.
Files=1, Tests=164, 13 wallclock secs ( 0.10 usr  0.00 sys + 10.88 cusr  0.35 csys = 11.33 CPU)
Result: PASS

this was called from runs=200 count_fail_ratio prove -l t/22-dashboard.t with an estimate fail ratio of 1/50. Disabling the import of Test::Warnings showed no such problems over 700 runs so far.


Related issues 1 (0 open1 closed)

Copied to openQA Project (public) - action #108701: Individual groups return 500 via group_overview routeResolvedtinita2022-03-212022-04-04

Actions
Actions #1

Updated by livdywan over 2 years ago

It looks to me like https://openqa.suse.de/group_overview/219 right now reproduces this issue, and it's probably a regression. Further more https://openqa.suse.de/ says Unable to fetch build results.

Actions #2

Updated by tinita over 2 years ago

cdywan wrote:

It looks to me like https://openqa.suse.de/group_overview/219 right now reproduces this issue, and it's probably a regression. Further more https://openqa.suse.de/ says Unable to fetch build results.

Just had a quick glance at the journal to see if there is an error logged when caling https://openqa.suse.de/group_overview/219 :

Mar 21 18:08:28 openqa openqa[15913]: [error] [tWelNRQVXNmi] Undefined subroutine &OpenQA::BuildResults::log_error called at /usr/share/openqa/script/../lib/OpenQA/BuildResults.pm line 64.
Actions #3

Updated by okurz over 2 years ago

  • Status changed from New to Rejected

Please report this as a separate issue. I can't see the relation.

Meanwhile I failed to reproduce the original error even with 600 runs.

Actions #4

Updated by livdywan over 2 years ago

  • Copied to action #108701: Individual groups return 500 via group_overview route added
Actions

Also available in: Atom PDF