QA » openQA Project

Observation¶

https://app.circleci.com/pipelines/github/os-autoinst/openQA/4187/workflows/3490f55a-1aea-4aad-860e-2d411fb95e1e/jobs/40008/steps shows failed tests like this:

[12:12:10] t/07-api_keys.t ........................................... ok     8238 ms ( 0.00 usr  0.00 sys +  7.54 cusr  0.40 csys =  7.94 CPU)
[12:12:18] t/09-job_clone.t .......................................... 1/?                                                                              [12:12:18] t/09-job_clone.t .......................................... Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/16 subtests 
[12:12:36] t/10-jobs.t ............................................... ok    19702 ms ( 0.07 usr  0.00 sys + 17.99 cusr  0.67 csys = 18.73 CPU)
…

Test Summary Report
-------------------
t/09-job_clone.t                                        (Wstat: 256 Tests: 16 Failed: 1)
  Failed test:  7
  Non-zero exit status: 1
t/20-stale-job-detection.t                              (Wstat: 256 Tests: 3 Failed: 1)
  Failed test:  1
  Non-zero exit status: 1
t/40-script_openqa-clone-custom-git-refspec.t           (Wstat: 0 Tests: 43 Failed: 0)
  TODO passed:   30, 32
Files=76, Tests=2120, 1141.99 wallclock secs ( 5.12 usr  0.42 sys + 900.28 cusr 101.21 csys = 1007.03 CPU)
Result: FAIL
make[2]: *** [Makefile:174: test-unit-and-integration] Error 1
make[2]: Leaving directory '/home/squamata/project'
make[1]: *** [Makefile:169: test-with-database] Error 2
make[1]: Leaving directory '/home/squamata/project'
make: *** [Makefile:137: test-t] Error 2

Exited with code exit status 2

CircleCI received exit code 2

so we see which test failed and also in the summary we get the information which individual test step failed but we do not have the output in particular. The tab
https://app.circleci.com/pipelines/github/os-autoinst/openQA/4187/workflows/3490f55a-1aea-4aad-860e-2d411fb95e1e/jobs/40008/tests shows the details, like:

not ok 7 - cannot clone again
[debug] [pid:202] Duplicating jobs: {
  99926 => {
    chained_children => [],
    chained_parents => [],
    directly_chained_children => [],
    directly_chained_parents => [],
    is_parent_or_initial_job => 1,
    ok => 0,
    parallel_children => [],
    parallel_parents => [],
    state => "done",
  },
}
[warn] [pid:202] Duplication rolled back after error: Unable to clone: Job 99926 already has clone 99982

Expected result¶

We should be able to see the complete output in case of failed tests in the log window of circleci as well.

Suggestion¶

https://github.com/os-autoinst/openQA/commit/f3b5dd95cc8b61b6a29e7502b877f8ee9d78059d already tried to address this but it seems this does not cover all cases. Needs to be reproduced and debugged.