[qe-core][qem][maint][postfix] test fails in 1_postfix on SLE15-SP3
1_postfix fails on SLE15-SP3
openQA test in scenario sle-15-SP3-Server-DVD-Updates-x86_64-mau-qa_userspace_postfix@64bit fails in
It has never passed on 15-SP3. The testcases send, send_to_nonexistent, send_attachment and send_to_alias are failing as seen as QADB entry http://qadb2.suse.de/qadb/result.php?submission_id=3156836&search=1&testsuite_id=164
Logs attached also here. Somehow at least required files are missing.
It would seem like this test suite got updated in 2019 https://build.suse.de/package/show/QA:Head/qa_test_postfix (also in 2020 but says no source changes)
Successful run on 15-SP2 looks like this http://qadb2.suse.de/qadb/submission.php?submission_id=3158364
It is developed in git at https://github.com/SUSE/qa-testsuites
Test suite description¶
Fails since (at least) Build 20210505-1
Last good: (unknown) (or more recent)
Always latest result in this scenario: latest
See https://chat.suse.de/channel/testing/thread/TqjxT7RQF3XJacKvB for background related to these old tests.
AC1: Either test passes on 15-SP3, is deemed ok to disable, or a product bug is filed. Requires figuring out whether the change is intended upstream behavior change, a test (environment) problem or a product problem. The test is very old, and it can be evaluated whether it's worthsome to keep it enabled.
AC2: If test is disabled, contact PO or file a new ticket about implementing a new test for the utility.