There was some old service-file floating around on this worker:
QA-Power8-5-kvm.qa.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
QA-Power8-4-kvm.qa.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
powerqaworker-qam-1:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
malbec.arch.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
grenache-1.qa.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker8.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker7.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker5.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker2.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker6.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker9.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqa.suse.de:
Unit os-autoinst-openvswitch.service is not loaded: No such file or directory
openqaworker3.suse.de:
# /etc/systemd/system/os-autoinst-openvswitch.service
openqaworker-arm-1.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaw1.qa.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaw2.qa.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker-arm-2.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker13.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
This file had wrong dependencies on network:
[Unit]
Description=os-autoinst openvswitch helper
BindsTo=openvswitch.service
After=openvswitch.service
Before=openqa-worker.target salt-minion.service SuSEfirewall2.service
I had the impression of wrong deps after restarting the service by hand. Before it showed the auto-generated hostname in the logs:
Feb 25 17:03:32 linux-5h37 systemd[1]: Starting os-autoinst openvswitch helper...
While it shows the actual hostname after a manual restart:
Mar 06 10:00:37 openqaworker3 systemd[1]: Starting os-autoinst openvswitch helper...
and indeed, a systemctl cat os-autoinst-openvswitch
showed that it actually uses /etc/systemd/system/os-autoinst-openvswitch.service
instead of /usr/lib/systemd/system/os-autoinst-openvswitch.service
.
I've moved the old service-file away to /root/poo48674_old_service.os-autoinst-openvswitch.service
and did a systemctl daemon-reload
and restarted the service once again to have the new service startup this time.
Now every worker is using exactly the same service file:
openqa:~ # salt '*' cmd.run 'systemctl cat os-autoinst-openvswitch.service | head -n 1'
QA-Power8-5-kvm.qa.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
malbec.arch.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
powerqaworker-qam-1:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
QA-Power8-4-kvm.qa.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
grenache-1.qa.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker8.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker6.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker2.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker7.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker9.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker5.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqa.suse.de:
Unit os-autoinst-openvswitch.service is not loaded: No such file or directory
openqaworker3.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker-arm-1.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaw2.qa.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaw1.qa.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker-arm-2.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service
openqaworker13.suse.de:
# /usr/lib/systemd/system/os-autoinst-openvswitch.service