QA » openQA Project » openQA Tests

For s390x found that version is fix a particular one and it is failing: https://openqa.suse.de/tests/1647514#step/php7_postgresql96/37. It needs for leap 15.0+ sle 15+ get the latest without specifying version or one specific available: https://openqa.suse.de/tests/1647514#comments. According to @mgriessmeier we need to do a couple of action with that:

• the s390x scenario shouldn't be called gnome
• we need to enable this test on other archs, which is not the case right now.

We have found inconsistency between job setting and vars.json for s390x, for instance:
we set here DESKTOP to text mode: https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/master/products/sle/main.pm#L128
but we found different value of this property in https://openqa.suse.de/tests/1647514#step/php7_postgresql96/36 and https://openqa.suse.de/tests/1647514/file/vars.json.

According to @okurz: The current way is like this: The table for "settings" are the input values, the vars.json is written at the end of the tests and test code is allowed to update the settings.

The effect that we see with this is a wrong scheduling comparing gnome+proxy_SCC+allmodules for different architectures, for instance php7 tests are only executed in s390x.

Work on SLE15 seems to be blocked by https://bugzilla.suse.com/show_bug.cgi?id=1104060
Work on SLE12SP4 seems to be blocked by pending SCC setup: https://openqa.suse.de/tests/1902069

Anyway this should do the job:

./openqa_clone_job_artemis_from_osd --skip-chained-deps 1806011 DESKTOP=textmode INSTALLONLY=

Alright, as we are in no rush you can decide yourself if you want to workaround these bugs, e.g. by not enabling the troubling modules in your test runs, or set the ticket to "Blocked" as you referenced the blocking bugs already. In the latter case actually I would not assume a fix available within this sprint so you can immediately set the ticket to a later sprint, e.g. Milestone 19, due date 2018-09-25. But please keep assigned to "blocked" tickets that we know you track the bugs and would update this progress ticket as soon as there is movement in the bug or at best fixes are available and we can continue the work.

I will try to workaround the issue analog to https://openqa.suse.de/tests/1806011#step/select_patterns_and_packages/130

./openqa_clone_job_osd --skip-chained-deps 1806011 SYSTEM_ROLE=textmode DESKTOP=textmode INSTALLONLY= _SKIP_POST_FAIL_HOOKS=1 SCC_REGCODE=??? SCC_URL= SCC_ADDONS=legacy,sdk,wsm,contm,desktop

Created new allmodules+allpatterns+textmode testsuite on osd for SLE15 and SPE12SP4.

Testsuite on OSD for SLE15-SP1: https://openqa.suse.de/tests/1916630

Testsuite on OSD for SLE12-SP4: https://openqa.suse.de/tests/1918585

Suggestions:

• Remove the "sp4" suffix in the test suite, that should be easy for us to agree on
• For SLE15: Do not enable the "sdk" as devel-packages should be part of the corresponding SCC modules already -> You should not need to tinker with SYSTEM_ROLE nor DESKTOP as you should end up with a textmode by default. I would still set DESKTOP=textmode to make it explicit. As the test suite is called "wsm+textmode" we should also set "DESKTOP=textmode" OR make it same as in https://openqa.suse.de/tests/1962609# for "mau-webserver" which is the same testsuite for the maintenance SLE12+SLE15 tests as well to end up with only one testsuite