Project

General

Profile

Actions
Copy link

action #178117

closed

coordination #127031: [saga][epic] openQA for SUSE customers

coordination #165393: [epic] Improved code coverage in openQA

[openQA][CI] Prevent unhandled output in prove test calls with automatic checks size:S

Added by okurz 3 months ago. Updated 27 days ago.

Status:
Resolved
Priority:
Low
Assignee:
gpuliti
Category:
Regressions/Crashes
Target version:
Ready
Start date:
2025-03-01
Due date:
% Done:

0%

Estimated time:
Tags:
openQA

Description

Motivation

https://app.circleci.com/pipelines/gh/os-autoinst/openQA/16015/workflows/93b25d9c-129a-40d0-8dec-82b2390fb56b/jobs/154230 shows a problem of unhandled output. We want to have a clean TAP output with all output from tested application code to be captured:

[23:50:36] t/05-scheduler-restart-and-duplicate.t .................... 22/?     # {
    #   '100006' => 100012,
    #   '100008' => 100013,
    #   '100009' => 100014,
    #   '100010' => 100015
    # }
[23:50:36] t/05-scheduler-restart-and-duplicate.t .................... ok    14366 ms ( 0.04 usr  0.01 sys + 13.61 cusr  0.37 csys = 14.03 CPU)
[

Acceptance criteria

  • AC1: Unhandled output from any openQA test called with prove is prevented by automatic checks
  • AC2: Other related projects have according improvements planned or implemented
  • AC3: Output of the tests should still be immediate and not printed with delay

Suggestions

  • Research how others might achieve it already or use our own check of logs or a "prove wrapper"
  • After that works for openQA fix it or report in tickets for related projects
  • Provide a regex representing a line of valid prove output to verify "no output"

Related issues 3 (0 open — 3 closed)

Copied from openQA Project (public) - action #178111: [beginner][openQA][CI] Unhandled output in t/05-scheduler-restart-and-duplicate.tResolvedtinita

Actions
Copied to openQA Project (public) - action #181358: [openQA][CI] Prevent unhandled output in prove test calls with automatic checks in os-autoinstResolvedgpuliti2025-03-01

Actions
Copied to openQA Project (public) - action #181760: [sporadic][openQA][CI] unhandled output in t/full-stack.t "Use of uninitialized value in numeric ne (!=) lib/OpenQA/Worker/Job.pm line 770"Resolvedmkittler

Actions
Actions
Copy link

Also available in: Atom PDF