action #95455
closed[qac][kernel] Make record_soft_failure shows error as regression
0%
Description
The idea is that when there is a bug open we have record_soft_failure to workaround in the test level.
But when the bug is resolved there are two approach AFAIK. remove the softfail or leave it intact to find regressions.
however when the bug is gone and softfail still exists in the code, there is not an easy way to distinguish the regression.
I propose to enhance the record_soft_failure to show the regression. One idea is to introduce a flag(extra param?) which we can switch
when the bug has been resolved. Then we can either make the test fail*[1] or show the soft_fail with another colour.
I am not sure if this is the best approach so please comment below if something better comes in your mind.
*[1] maybe we can introduce a parameter to define severity. Then if(critical)->(fail)->else(pass)