QA » openQA Project

I did not realize that https://openqa.opensuse.org/group_overview/24?limit_builds=50&limit_builds=100&limit_builds=400 looks so bad, bumping prio to "Urgent". I assume this is related to #138302 and possibly missing notifications due to #150956

Not sure whether os-autoinst-setup-multi-machine really timed out (it generally seemed to work; I couldn't spot an error message or stuck command in the video). So maybe the problem is that the end marker 2HR0K- doesn't appear in the serial log.

I had a look at os-autoinst's code to see how assert_script_run works. Apparently it is using the same serial device that also ends up as serial0.txt log for the marker. And that file contains the marker:

[  495.644496][T19426] Failed to associated timeout policy `ovs_test_tp'
[  496.217552][T19426] tap137: entered promiscuous mode
2HR0K-0-
[  496.781360][T19426] tap138: entered promiscuous mode
[  497.539160][T19426] tap139: entered promiscuous mode

There were some other messages but the marker it left in one piece. So probably this is really just a time out - as the error message suggests.

The last output we see (in the video) from the setup script is the symlinking that corresponds to systemctl enable os-autoinst-openvswitch. So the script is already almost done (and not stuck somewhere in the middle). The only further command is systemctl restart openvswitch os-autoinst-openvswitch and most likely os-autoinst-openvswitch took too long to restart. The restart will really block until the service is ready because it is of type dbus so systemd will wait until it actually appears on the dbus - and that in turn won't happen until all the initialization logic in os-autoinst-openvswitch has happened. Considering we have already

[Service]
Environment="OS_AUTOINST_OPENVSWITCH_INIT_TIMEOUT=1200"

as an override for this systemd unit in production it is fair to assume that 90 seconds for the whole os-autoinst-setup-multi-machine is probably not enough. So I'll be increasing the timeout.

PR for fixing the worker module running into the screen saver: https://github.com/os-autoinst/os-autoinst-distri-openQA/pull/166