[sle][functional][y] Inconsistency between job setting and vars.json
|Category:||Bugs in existing tests|
|Target version:||QA - future|
We have found inconsistency between job setting and vars.json for s390x, for instance:
we set here DESKTOP to text mode: https://github.com/os-autoinst/os-autoinst-distri-opensuse/blob/master/products/sle/main.pm#L128
but we found different value of this property in https://openqa.suse.de/tests/1647514#step/php7_postgresql96/36 and https://openqa.suse.de/tests/1647514/file/vars.json.
Probably in the same way that the source code displayed is not reliable in the web ui, this settings written during scheduling aren't neither, only be able to trust in the vars.json as is written at the end.
The effect that we see with this is a wrong scheduling comparing gnome+proxy_SCC+allmodules for different architectures, for instance php7 tests are only executed in s390x.
#2 Updated by okurz almost 2 years ago
- Subject changed from [sle][functional] Inconsistency between job setting and vars.json to [sle][functional][y] Inconsistency between job setting and vars.json
- Status changed from New to Feedback
- Assignee set to okurz
- Target version set to future
Well, I'm not sure what you expect should be done here.
The current way is like this: The table for "settings" are the input values, the
vars.json is written at the end of the tests and test code is allowed to update the settings so I would not see it as a general issue. It certainly is an interesting design choice ;)