QA » openQA Project

I've also just wanted to compare against the last successful job. However, it looks like this scenario has actually never worked before.

I don't know the particular web UI instance and worker host but maybe you can apply the patch from my PR manually on the relevant worker hosts¹?

¹ You can patch a worker like this:

cd /tmp
wget https://github.com/os-autoinst/os-autoinst/pull/2182.patch
sudo patch -d /usr/lib/os-autoinst -p1 -i /tmp/2182.patch

Of course you can also just play around yourself modifying some of the backend code within /usr/lib/os-autoinst and its subdirs yourself. You can always restore the default state by simply re-installing the os-autoinst package.

I can't see any output after applying this path, and the last command 'virsh dumpxml' failed. But I can't reproduce this error by manual, even using the same xml file to define & start VM.

http://10.67.129.66/tests/1412/logfile?filename=autoinst-log.txt

[2022-09-27T13:06:03.181517+08:00] [debug] [run_ssh_cmd(virsh -c esx://root@10.67.131.2/?no_verify=1\&authfile=/tmp/ilPcNHDHp6  dumpxml openQA-SUT-1)] stdout:


[2022-09-27T13:06:03.181708+08:00] [debug] [run_ssh_cmd(virsh -c esx://root@10.67.131.2/?no_verify=1\&authfile=/tmp/ilPcNHDHp6  dumpxml openQA-SUT-1)] stderr:
  2022-09-27 05:06:03.067+0000: 15623: info : libvirt version: 7.1.0
  2022-09-27 05:06:03.067+0000: 15623: info : hostname: qa2-dhcp-66
  2022-09-27 05:06:03.067+0000: 15623: warning : esxUtil_ParseUri:147 : Ignoring unexpected query parameter 'authfile'
  error: configuration file syntax error: memory conf:36: numbers not allowed in VMX format

Not sure if any issue on my local openqa worker, I can't see this issue on OSD. Probably, we could rerun an OSD job to verify it after the PR(https://github.com/os-autoinst/os-autoinst/pull/2180) merged.

https://openqa.suse.de/tests/9564774/logfile?filename=autoinst-log.txt

[2022-09-22T10:56:12.406952+02:00] [debug] [run_ssh_cmd(virsh -c esx://root@esxi7.qa.suse.cz/?no_verify=1\&authfile=/tmp/Y33UgkNWHY  dumpxml openQA-SUT-2)] stdout:
  <domain type='vmware' id='25' xmlns:vmware='http://libvirt.org/schemas/domain/vmware/1.0'>
    <name>openQA-SUT-2</name>
    <uuid>79026f57-2272-4d78-85e4-15c8361d7a84</uuid>
....
....
[2022-09-22T10:56:12.407102+02:00] [debug] [run_ssh_cmd(virsh -c esx://root@esxi7.qa.suse.cz/?no_verify=1\&authfile=/tmp/Y33UgkNWHY  dumpxml openQA-SUT-2)] stderr:
  2022-09-22 08:56:11.929+0000: 3241: info : libvirt version: 6.0.0
  2022-09-22 08:56:11.929+0000: 3241: info : hostname: openqaw5-xen
  2022-09-22 08:56:11.929+0000: 3241: warning : esxUtil_ParseUri:149 : Ignoring unexpected query parameter 'authfile'

[2022-09-22T10:56:12.407175+02:00] [debug] [run_ssh_cmd(virsh -c esx://root@esxi7.qa.suse.cz/?no_verify=1\&authfile=/tmp/Y33UgkNWHY  dumpxml openQA-SUT-2)] exit-code: 0

It looks like the patch has worked but the domain config XML is simply empty as only the newline is logged:

  virsh domain XML does not specify VM ID which is required from VNC over WebSockets:

   at /usr/lib/os-autoinst/backend/console_proxy.pm line 46.

That means the error must be somewhere before and that we cannot find the ID is just a symptom.

The following log messages look suspicious:

  2022-09-27 05:06:02.426+0000: 15619: warning : esxUtil_ParseUri:147 : Ignoring unexpected query parameter 'authfile'

However, "warning" and "Ignoring" don't sound like this should cause the config to be rejected completely. Besides, those messages are also logged in http://10.67.129.66/tests/1397/logfile?filename=autoinst-log.txt which softfailed.

There's actually another error at the end of:

[2022-09-27T13:06:03.181517+08:00] [debug] [run_ssh_cmd(virsh -c esx://root@10.67.131.2/?no_verify=1\&authfile=/tmp/ilPcNHDHp6  dumpxml openQA-SUT-1)] stdout:


[2022-09-27T13:06:03.181708+08:00] [debug] [run_ssh_cmd(virsh -c esx://root@10.67.131.2/?no_verify=1\&authfile=/tmp/ilPcNHDHp6  dumpxml openQA-SUT-1)] stderr:
  2022-09-27 05:06:03.067+0000: 15623: info : libvirt version: 7.1.0
  2022-09-27 05:06:03.067+0000: 15623: info : hostname: qa2-dhcp-66
  2022-09-27 05:06:03.067+0000: 15623: warning : esxUtil_ParseUri:147 : Ignoring unexpected query parameter 'authfile'
  error: configuration file syntax error: memory conf:36: numbers not allowed in VMX format

That's not logged in the supposedly good tests. It sounds like something is misconfigured on the VMWare side (which you might be more familiar with than me).

OK, the error indicated that there was a syntax issue at line 36. After checking the vmx file, I can see the property which missing double quotes around the value.

/vmfs/volumes/5ffc09f2-d9e8dde4-1604-0cc47ac51e38/openQA/openQA-SUT-1.vmx
Line 36: bios.bootDelay = 10000

consoles/sshVirtsh.pm
Line 528: $self->run_cmd("echo bios.bootDelay = \"10000\" >> $vmx", domain => 'sshVMwareServer');

So does it help to change that line to e.g. $self->run_cmd("echo bios.bootDelay = \\\"10000\\\" >> $vmx", domain => 'sshVMwareServer');? (I haven't tested it yet, maybe you need to play around with it yourself.)

You are right. The syntax error got fixed after updated code - http://10.67.129.66/tests/1418

Created PR https://github.com/os-autoinst/os-autoinst/pull/2184

Got one more successful runs:
default_install_svirt - http://10.67.129.66/tests/1421 [passed]
online_upgrade_sles15sp4_vmware - http://10.67.129.66/tests/1419 [passed]
textmode_svirt - http://10.67.129.66/tests/1420 [passed]