action #111470
closed
Reconsider folding ok results by default and/or uncollapse all on /tests/overview size:M
Added by okurz almost 2 years ago.
Updated almost 2 years ago.
Category:
Feature requests
- Copied from action #110719: Fold ok clusters by default, unfold if there is any non-ok result added
I'll try adding an "Uncollapse all" button.
- Status changed from New to Feedback
- Status changed from Feedback to Resolved
I don't really love this for Fedora's test suites, especially on updates, where we have many small groups of parallel children and aren't really gaining anything by having them collapsed. But I can live with it. However, I would really prefer if "softfailed" was not considered "OK" for this purpose. I think it would be better to only collapse passes. "softfail" means "needs inspection", and you can't inspect something you don't see. I was rather confused why the overview said 4 softfails but I could only see 1 on the build page, until tinita pointed out this was the cause.
- Status changed from Resolved to Feedback
AdamWill wrote:
I don't really love this for Fedora's test suites, especially on updates, where we have many small groups of parallel children and aren't really gaining anything by having them collapsed.
Could you share some links to such test overviews where you don't like it?
But I can live with it. However, I would really prefer if "softfailed" was not considered "OK" for this purpose. I think it would be better to only collapse passes. "softfail" means "needs inspection", and you can't inspect something you don't see.
I wonder, why does "softfail" mean "needs inspection" to you? We try to stick to the definition from http://open.qa/docs/#concepts which states for softfailed: "At least one known, non-critical issue has been found. That could be that workaround needles are in place, a softfailure has been recorded explicitly via record_soft_failure (from os-autoinst) or a job failure has been ignored explicitly via a job label." Keeping that in mind we defined "passed" and "softfailed" as "ok-results" that do not need immediate work on the test overview page, at least not "review" work in the sense of understanding what is going on because for "softfailed" we assume that people have seen the issue at least once. If they decided to track it elsewhere or not is quite depending on project specific workflows.
- Due date set to 2022-07-15
- Subject changed from Reconsider folding ok results by default and/or uncollapse all on /tests/overview to Reconsider folding ok results by default and/or uncollapse all on /tests/overview size:M
- Description updated (diff)
- Due date deleted (
2022-07-15)
- Status changed from Feedback to Resolved
PR merged. We are ok with it.
Also available in: Atom
PDF