action #38621
closedopenQA Project (public) - coordination #39719: [saga][epic] Detection of "known failures" for stable tests, easy test results review and easy tracking of known issues
[functional][y] test fails in welcome - "Module is not signed with expected PKCS#7 message" (bsc#1093659) - Use serial exception catching feature from openQA to make sure the jobs reference the bug, e.g. as label
0%
Description
Observation¶
openQA test in scenario sle-12-SP4-Server-DVD-Staging:B-x86_64-ext4@uefi-staging fails in
welcome
on https://bugzilla.suse.com/show_bug.cgi?id=1093659
Acceptance criteria¶
- AC1: All jobs hitting bsc#1093659 will not need any work from manual reviewers
Suggestions¶
- Work on #36448 first
- Abort the test as soon as this soft-fail has been hit (or find a way how a job label can be created)
- Update documentation about feature detecting serial error
Further details¶
Always latest result in this scenario: latest
The "automatic label" in the acceptance criteria could be either (1) just soft-failing jobs showing up with the bug reference on http://s.qa.suse.de/test-status or (2) an automatic comment in the openQA webui. Most likely (1) would be easier but means we have to abort the whole test run as soon as we found the issue and recorded the soft failure to prevent any subsequent test module failing the module as "fail" overrides "softfail".