action #136127
openImplement record warning feature similar to record softfail
0%
Description
Motivation¶
See #134723#note-19 for the original context.
The main problem with less fatal approaches to marking the buggy tests was that nobody would notice a log message or even a softfail. OpenQA lacks some kind of clearly visible non-fatal warning. Let's add a new function like record_code_warning()
that'll behave similarly to record_soft_fail()
. It'll add a result box to the test module with a warning icon <!> and a pop-up description.
The result box should have no effect on the module/job result but it'll set a special warning flag on the module and job. Test modules with the warning flag will stay visible if you click Show only failures on the job detail page (even if the module passed). Jobs with the warning flag will have the warning icon on the test overview page right next to the usual BSC and POO icons.
Acceptance criteria¶
- AC1: A testapi function is provided to record warnings
- AC2: Show only failures includes warnings
- AC3: A warning icon is visible in addition to issue/bug icons
Suggestions¶
Updated by livdywan about 1 year ago
- Copied from action #134723: Conduct lessons learned for making new-lines in script_run fatal size:S added
Updated by okurz about 1 year ago
- Category set to Feature requests
- Target version set to future