QA (public) » openQA Project (public)

I started setting up a new VM for this only to discover that openQA in openQA tests don't appear to work in a VM (various kvm errors). :)

I do have a first observation though about our documentation. It has gotten very large, and there is a lot of detailed information that someone just starting out doesn't really need right away. I think we would benefit from a second, more condensed version of the documentation, just for getting started with test development. Like a playbook that only contains the essential steps for installing openQA, writing your very first test case, and running it locally. The key point would be to make this playbook as short as possible, and keep all the detailed context information in the main documentation.

kraih wrote:

I think we would benefit from a second, more condensed version of the documentation, just for getting started with test development.

That is supposed to be https://github.com/os-autoinst/openQA/blob/master/docs/GettingStarted.asciidoc . This document is included in the complete one-document format as well. Maybe we can rework the titles a bit and move content around to make that more obvious? We can also explicitly mention just that document on http://open.qa/documentation/

I previously forgot to keep a record of the exact error i ran into, here it is:

[2021-08-16T17:10:35.703 CEST] [debug] QEMU: Please use wait=off instead
[2021-08-16T17:10:35.703 CEST] [warn] !!! : qemu-system-x86_64: error: failed to set MSR 0x48d to 0x5600000016
[2021-08-16T17:10:35.703 CEST] [warn] !!! : qemu-system-x86_64: ../target/i386/kvm/kvm.c:2753: kvm_buf_set_msrs: Assertion `ret == cpu->kvm_msr_buf->nmsrs' failed.
[2021-08-16T17:10:35.704 CEST] [debug] sending magic and exit
[2021-08-16T17:10:35.704 CEST] [debug] received magic close
[2021-08-16T17:10:35.705 CEST] [debug] backend process exited: 0
failed to start VM at /usr/lib/os-autoinst/backend/driver.pm line 126.

It seems to be related to nested virtualization. I've run many other tests (successfully) in the same VM, but never seen this before.

wow, never seen that in before. I wonder what the Please use wait=off instead means.

About the assertion I agree that it seems to be related to nested virtualization. There is https://bugs.launchpad.net/qemu/+bug/1661386 . I assume you run an openSUSE VM within vmware. A comment in the bug suggest to supply "-cpu host,pmu=off". Try to trigger the openQA test with QEMUCPU=host,pmu=off.

Running the same job with QEMU_NO_KVM=1 results in:

[2021-08-16T17:30:39.585 CEST] [debug] QEMU: Please use wait=off instead
[2021-08-16T17:30:39.585 CEST] [warn] !!! : qemu-system-x86_64: CPU model 'host' requires KVM
[2021-08-16T17:30:39.585 CEST] [debug] sending magic and exit
[2021-08-16T17:30:39.586 CEST] [debug] received magic close
[2021-08-16T17:30:39.588 CEST] [debug] backend process exited: 0
failed to start VM at /usr/lib/os-autoinst/backend/driver.pm line 126.

okurz wrote:

About the assertion I agree that it seems to be related to nested virtualization. There is https://bugs.launchpad.net/qemu/+bug/1661386 . I assume you run an openSUSE VM within vmware. A comment in the bug suggest to supply "-cpu host,pmu=off". Try to trigger the openQA test with QEMUCPU=host,pmu=off.

Ok, i do see -cpu host,pmu=off in the command line, so it was passed. But it does not appear to make any difference in the result.

[2021-08-16T17:34:11.103 CEST] [debug] starting: /usr/bin/qemu-system-x86_64 -only-migratable -chardev ringbuf,id=serial0,logfile=serial0,logappend=on -serial chardev:serial0 -audiodev none,id=snd0 -device intel-hda -device hda-output,audiodev=snd0 -global isa-fdc.fdtypeA=none -m 2048 -cpu host,pmu=off -netdev user,id=qanet0 -device virtio-net,netdev=qanet0,mac=52:54:00:12:34:56 -boot once=d -device usb-ehci -device usb-tablet -smp 1 -enable-kvm -no-shutdown -vnc :91,share=force-shared -device virtio-serial -chardev pipe,id=virtio_console,path=virtio_console,logfile=virtio_console.log,logappend=on -device virtconsole,chardev=virtio_console,name=org.openqa.console.virtio_console -chardev socket,path=qmp_socket,server,nowait,id=qmp_socket,logfile=qmp_socket.log,logappend=on -qmp chardev:qmp_socket -S -device virtio-scsi-pci,id=scsi0 -blockdev driver=file,node-name=hd0-overlay0-file,filename=/home/sri/work/openQA/openqa/pool/1/raid/hd0-overlay0,cache.no-flush=on -blockdev driver=qcow2,node-name=hd0-overlay0,file=hd0-overlay0-file,cache.no-flush=on -device virtio-blk,id=hd0-device,drive=hd0-overlay0,serial=hd0
[2021-08-16T17:34:11.105 CEST] [debug] Waiting for 0 attempts
[2021-08-16T17:34:11.179 CEST] [debug] Waiting for 1 attempts
[2021-08-16T17:34:11.179 CEST] [info] ::: backend::baseclass::die_handler: Backend process died, backend errors are reported below in the following lines:
  QEMU terminated before QMP connection could be established. Check for errors below
[2021-08-16T17:34:11.179 CEST] [info] ::: OpenQA::Qemu::Proc::save_state: Saving QEMU state to qemu_state.json
[2021-08-16T17:34:11.180 CEST] [debug] Passing remaining frames to the video encoder
[2021-08-16T17:34:11.216 CEST] [debug] Waiting for video encoder to finalize the video
[2021-08-16T17:34:11.216 CEST] [debug] The built-in video encoder (pid 104862) terminated
[2021-08-16T17:34:11.216 CEST] [debug] QEMU: QEMU emulator version 6.0.0 (openSUSE Tumbleweed)
[2021-08-16T17:34:11.216 CEST] [debug] QEMU: Copyright (c) 2003-2021 Fabrice Bellard and the QEMU Project developers
[2021-08-16T17:34:11.217 CEST] [warn] !!! : qemu-system-x86_64: -chardev socket,path=qmp_socket,server,nowait,id=qmp_socket,logfile=qmp_socket.log,logappend=on: warning: short-form boolean option 'server' deprecated
[2021-08-16T17:34:11.217 CEST] [debug] QEMU: Please use server=on instead
[2021-08-16T17:34:11.217 CEST] [warn] !!! : qemu-system-x86_64: -chardev socket,path=qmp_socket,server,nowait,id=qmp_socket,logfile=qmp_socket.log,logappend=on: warning: short-form boolean option 'nowait' deprecated
[2021-08-16T17:34:11.217 CEST] [debug] QEMU: Please use wait=off instead
[2021-08-16T17:34:11.217 CEST] [warn] !!! : qemu-system-x86_64: error: failed to set MSR 0x48d to 0x5600000016
[2021-08-16T17:34:11.217 CEST] [warn] !!! : qemu-system-x86_64: ../target/i386/kvm/kvm.c:2753: kvm_buf_set_msrs: Assertion `ret == cpu->kvm_msr_buf->nmsrs' failed.
[2021-08-16T17:34:11.217 CEST] [debug] sending magic and exit
[2021-08-16T17:34:11.220 CEST] [debug] backend process exited: 0
[2021-08-16T17:34:11.220 CEST] [debug] received magic close
failed to start VM at /usr/lib/os-autoinst/backend/driver.pm line 126.

This is the latest Tumbleweed running in vmware fusion 12.

Edit: Updated with the complete QEMU output for completeness sake.

okurz wrote:

I wonder what the Please use wait=off instead means.

Just an unrelated deprecation warning.