QA » openQA Project » openQA Infrastructure

Observation¶

The pipeline test-monitor in salt-states-openqa failed today. It isn't clear what the problem is, the log is quite extensive: https://gitlab.suse.de/mkittler/salt-states-openqa/-/jobs/540688

This job ran as part of https://gitlab.suse.de/openqa/salt-states-openqa/-/merge_requests/562 but re-triggering the job helped. So it is likely not related to the SR but another sporadically happening issue.

Seems like something in /etc/salt/minion, wrong YAML syntax or likely salt states with the same ID from different files:

.[ERROR   ] Error parsing configuration file: /etc/salt/minion - while constructing a mapping
9868  in "/etc/salt/minion", line 936, column 1
9869found conflicting ID 'disable_grains'
9870  in "/etc/salt/minion", line 942, column 1
9871[ERROR   ] Error parsing configuration file: /etc/salt/minion - while constructing a mapping
[...]
9890    raise ConstructorError(
9891yaml.constructor.ConstructorError: while constructing a mapping
9892  in "/etc/salt/minion", line 936, column 1
9893found conflicting ID 'disable_grains'
9894  in "/etc/salt/minion", line 942, column 1

Maybe a consequence of the other error?

Traceback (most recent call last):
  File "/usr/lib/python3.8/site-packages/salt/loader.py", line 1778, in _load_module
    module_init(self.opts)
  File "/usr/lib/python3.8/site-packages/salt/modules/boto3_elasticsearch.py", line 87, in __init__
    __utils__["boto3.assign_funcs"](__name__, "es")
  File "/usr/lib/python3.8/site-packages/salt/loader.py", line 1283, in __getitem__
    func = super().__getitem__(item)
  File "/usr/lib/python3.8/site-packages/salt/utils/lazy.py", line 108, in __getitem__
    raise KeyError(key)
KeyError: 'boto3.assign_funcs'

Suggestions¶

• Stare at https://gitlab.suse.de/mkittler/salt-states-openqa/-/jobs/540688 for at least 10 minutes trying to find the actual error cause before giving up
• Investigate what could cause the YAML/id issues
• Confirm if this is really flaky (re-trigger a couple more times)