QA » openQA Project

I'll try adding an "Uncollapse all" button.

Adding an uncollapse button would be easy: https://github.com/os-autoinst/openQA/pull/4668

It works in production, e.g. https://openqa.suse.de/tests/overview?distri=sle&version=15-SP1&build=20220608-1&groupid=412. I haven't seen any further complaints so I suppose the ticket can be resolved.

AdamWill wrote:

I don't really love this for Fedora's test suites, especially on updates, where we have many small groups of parallel children and aren't really gaining anything by having them collapsed.

Could you share some links to such test overviews where you don't like it?

But I can live with it. However, I would really prefer if "softfailed" was not considered "OK" for this purpose. I think it would be better to only collapse passes. "softfail" means "needs inspection", and you can't inspect something you don't see.

I wonder, why does "softfail" mean "needs inspection" to you? We try to stick to the definition from http://open.qa/docs/#concepts which states for softfailed: "At least one known, non-critical issue has been found. That could be that workaround needles are in place, a softfailure has been recorded explicitly via record_soft_failure (from os-autoinst) or a job failure has been ignored explicitly via a job label." Keeping that in mind we defined "passed" and "softfailed" as "ok-results" that do not need immediate work on the test overview page, at least not "review" work in the sense of understanding what is going on because for "softfailed" we assume that people have seen the issue at least once. If they decided to track it elsewhere or not is quite depending on project specific workflows.

@AdamWill Not sure what we should be able to see from the test overview. I would be happy to hear your opinion about #111470#note-6 as well as feedback about https://github.com/os-autoinst/openQA/pull/4731 if that would solve it for you.

PR merged. We are ok with it.