QA » openQA Project

Observation¶

I found that t/22-dashboard.t sporadically failed for me like this:

t/22-dashboard.t .. 161/?
    #   Failed test '200 OK'
    #   at t/22-dashboard.t line 432.
    #          got: '500'
    #     expected: '200'

    #   Failed test 'parent group builds shown sorted by date'
    #   at t/22-dashboard.t line 434.
    #     Structures begin differing at:
    #          $got->[0] = Does not exist
    #     $expected->[0] = '42.2-Build0002'
    # Looks like you failed 2 tests of 19.
t/22-dashboard.t .. ok
All tests successful.
Files=1, Tests=164, 13 wallclock secs ( 0.10 usr  0.00 sys + 10.88 cusr  0.35 csys = 11.33 CPU)
Result: PASS

this was called from runs=200 count_fail_ratio prove -l t/22-dashboard.t with an estimate fail ratio of 1/50. Disabling the import of Test::Warnings showed no such problems over 700 runs so far.