QA » openQA Project » openQA Tests

hi, new testruns where added in RED state to Leap 15.3 Maintenance.

pelase either fix them immediately or remove them

This is the current state of the jobs running in Leap 15.3 Updates : https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=20210630-2&groupid=80

I have already fixed some configurations and some tests,done re-needling, added labels for progress tickets and bugs.
My question here is (as there is no PO for these tests + no specific squad responsible for the tests), should I just remove the failing tests, till they are fixed?

Anna, for now unscheduled the test for the time being, until responsibilities are clearer.

Marcus, does this block maintenance updates on the leap side? (I mean, failing tests in openQA's leap jobs)

@szarate, I will do the following : soft-fail the tests with the bugs and remove the others that need changes in the code. Is it ok like this?

Can someone explain to me why it is a problem to keep the failing tests visible in the leap runs?

Small update, the following testcases have been removed from the runs (https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=20210701-1&groupid=80):

• extra_tests_gnome
• extra_tests_textmode
• kde
• yast2_gui

There are already progress issues created for the tests that are failing.

punkioudi wrote:

@szarate, I will do the following : soft-fail the tests with the bugs and remove the others that need changes in the code. Is it ok like this?

Sounds good

Latest runs in Leap 15.3 Updates : https://openqa.opensuse.org/tests/overview?distri=opensuse&version=15.3&build=20210706-2&groupid=80