action #96311
closedqemu error message is still "debug", should be "warn" or more severe size:S
Description
See #96272 , https://openqa.opensuse.org/tests/1860795 shows
[2021-07-29T11:35:35.119 UTC] [info] ::: backend::baseclass::die_handler: Backend process died, backend errors are reported below in the following lines:
QEMU terminated before QMP connection could be established at /usr/lib/os-autoinst/OpenQA/Qemu/Proc.pm line 453.
[2021-07-29T11:35:35.120 UTC] [info] ::: OpenQA::Qemu::Proc::save_state: Saving QEMU state to qemu_state.json
[2021-07-29T11:35:35.122 UTC] [debug] Passing remaining frames to the video encoder
[image2pipe @ 0x55a04934b9c0] Could not find codec parameters for stream 0 (Video: ppm, none): unspecified size
Consider increasing the value for the 'analyzeduration' and 'probesize' options
Input #0, image2pipe, from 'pipe:':
Duration: N/A, bitrate: N/A
Stream #0:0: Video: ppm, none, 24 tbr, 24 tbn, 24 tbc
Output #0, webm, to '/var/lib/openqa/pool/2/video.webm':
Output file #0 does not contain any stream
[2021-07-29T11:35:35.130 UTC] [debug] Waiting for video encoder to finalize the video
[2021-07-29T11:35:35.130 UTC] [debug] The external video encoder (pid 20283) terminated
[2021-07-29T11:35:35.130 UTC] [debug] The built-in video encoder (pid 20284) terminated
[2021-07-29T11:35:35.132 UTC] [debug] QEMU: QEMU emulator version 4.2.1 (openSUSE Leap 15.2)
[2021-07-29T11:35:35.132 UTC] [debug] QEMU: Copyright (c) 2003-2019 Fabrice Bellard and the QEMU Project developers
[2021-07-29T11:35:35.132 UTC] [debug] QEMU: qemu-system-x86_64: Could not find '/usr/sbin/smbd', please install it
Suggestion¶
- the last line should be warn since https://github.com/os-autoinst/os-autoinst/pull/1706, maybe https://github.com/os-autoinst/os-autoinst/pull/1727 broke it again?
- Check
OpenQA/Qemu/Proc.pm
,backend/qemu.pm
- Investigate why
Could not find '/usr/sbin/smbd', please install it
doesn't stop qemu - should the job abort?
Updated by okurz over 3 years ago
- Copied from action #96272: Test failed incomplete: "Reason: backend died: QEMU exited unexpectedly, see log for details" size:M added
Updated by livdywan over 3 years ago
- Subject changed from qemu error message is still "debug", should be "warn" or more severe to qemu error message is still "debug", should be "warn" or more severe size:S
- Description updated (diff)
- Status changed from New to Workable
- Priority changed from High to Normal
Updated by osukup over 3 years ago
job with windows VM
[debug] starting: /usr/bin/qemu-system-x86_64 -vga qxl -only-migratable -chardev ringbuf,id=serial0,logfile=serial0,logappend=on -serial chardev:serial0 -audiodev none,id=snd0 -device intel-hda -device hda-output,audiodev=snd0 -global isa-fdc.fdtypeA=none -m 2048 -machine q35 -cpu host -netdev user,id=qanet0,smb=/var/lib/openqa/pool/2 -device virtio-net,netdev=qanet0,mac=52:54:00:12:34:56 -device usb-ehci -device usb-tablet -smp 1 -enable-kvm -no-shutdown -vnc :92,share=force-shared -device virtio-serial -chardev pipe,id=virtio_console,path=virtio_console,logfile=virtio_console.log,logappend=on -device virtconsole,chardev=virtio_console,name=org.openqa.console.virtio_console -chardev socket,path=qmp_socket,server,nowait,id=qmp_socket,logfile=qmp_socket.log,logappend=on -qmp chardev:qmp_socket -S -blockdev driver=file,node-name=hd0-overlay0-file,filename=/var/lib/openqa/pool/2/raid/hd0-overlay0,cache.no-flush=on -blockdev driver=qcow2,node-name=hd0-overlay0,file=hd0-overlay0-file,cache.no-flush=on -device virtio-blk,id=hd0-device,drive=hd0-overlay0,bootindex=0,serial=hd0 -drive id=pflash-code-overlay0,if=pflash,file=/var/lib/openqa/pool/2/raid/pflash-code-overlay0,unit=0,readonly=on -drive id=pflash-vars-overlay0,if=pflash,file=/var/lib/openqa/pool/2/raid/pflash-vars-overlay0,unit=1
in definition of -netdev user,id=qanet0,smb=/var/lib/openqa/pool/2
is defined samba protocol by QEMU_ENABLE_SMBD=1
in vars.
which makes samba mandatory dep
Updated by livdywan over 3 years ago
osukup wrote:
in definition of
-netdev user,id=qanet0,smb=/var/lib/openqa/pool/2
is defined samba protocol byQEMU_ENABLE_SMBD=1
in vars.which makes samba mandatory dep
Mandatory sounds like this is an error and the job can't run 🤔️ During the estimation the assumption was that the job can still finish successfully and it's really a warning, also because qemu seems to continue to run going by the logs
Updated by osukup over 3 years ago
cdywan wrote:
osukup wrote:
in definition of
-netdev user,id=qanet0,smb=/var/lib/openqa/pool/2
is defined samba protocol byQEMU_ENABLE_SMBD=1
in vars.which makes samba mandatory dep
Mandatory sounds like this is an error and the job can't run 🤔️ During the estimation the assumption was that the job can still finish successfully and it's really a warning, also because qemu seems to continue to run going by the logs
yes ,this is little weird ...
from QEMU documentation:
smb=dir[,smbserver=addr]
When using the user mode network stack, activate a built-in SMB server so that Windows OSes can access to the host files in dir transparently. The IP address of the SMB server can be set to addr. By default the 4th IP in the guest network is used, i.e. x.x.x.4.
In the guest Windows OS, the line:
10.0.2.4 smbserver
must be added in the file C:\WINDOWS\LMHOSTS (for windows 9x/Me) or C:\WINNT\SYSTEM32\DRIVERS\ETC\LMHOSTS (Windows NT/2000).
Then dir can be accessed in \\smbserver\qemu.
Note that a SAMBA server must be installed on the host OS.
Updated by osukup over 3 years ago
- When I look at history of imagetester:2 worker .. all WSL related jobs failed on same problem .. so probadly QEMU has loong timeout for contacting samba server, and then dies
Updated by osukup over 3 years ago
- Status changed from Workable to Feedback
For reporting this in 'debug' instead of 'warn' problem isn't in os-autoinst, but worker has old version of os-autoinst installed:
os-autoinst> git show 5361bf1c
commit 5361bf1c6c542b41f7dac978ca59e43e267789b0
Merge: 96b32687 75fb10e0
Author: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Date: Mon Jun 21 08:09:14 2021 +0000
Merge pull request #1697 from okurz/feature/remove_file_content
Simplify bmwqemu::fileContent and mark as deprecated before removal`
but logging changes in PR 1706 and 1727 are from 29.6 and 20.7
Updated by livdywan over 3 years ago
- Blocked by action #96719: recover imagetester with broken filesystem/hardware (was: automatic updates on imagetester don't work and it failed to come up after reboot) added
Updated by osukup over 3 years ago
to be on safe side testes on SUT without samba:
[2021-08-16T13:59:16.118 CEST] [debug] running /usr/bin/qemu-img create -f qcow2 -b /var/lib/openqa/pool/2/windows-10-x86_64-21H1@windows_bios_boot.qcow2 /var/lib/openqa/pool/2/raid/hd0-overlay0 85899345920
[2021-08-16T13:59:16.394 CEST] [debug] qemu-img: warning: Deprecated use of backing file without explicit backing format (detected format of qcow2)
Formatting '/var/lib/openqa/pool/2/raid/hd0-overlay0', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=85899345920 backing_file=/var/lib/openqa/pool/2/windows-10-x86_64-21H1@windows_bios_boot.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2021-08-16T13:59:16.394 CEST] [debug] init_blockdev_images: Finished creating block devices
[2021-08-16T13:59:16.396 CEST] [debug] starting: /usr/bin/qemu-system-x86_64 -vga qxl -only-migratable -chardev ringbuf,id=serial0,logfile=serial0,logappend=on -serial chardev:serial0 -audiodev none,id=snd0 -device intel-hda -device hda-output,audiodev=snd0 -global isa-fdc.fdtypeA=none -m 2048 -machine q35 -cpu qemu64 -netdev user,id=qanet0,smb=/var/lib/openqa/pool/2 -device virtio-net,netdev=qanet0,mac=52:54:00:12:34:56 -boot order=c -device usb-ehci -device usb-tablet -smp 1 -enable-kvm -no-shutdown -vnc :92,share=force-shared -device virtio-serial -chardev pipe,id=virtio_console,path=virtio_console,logfile=virtio_console.log,logappend=on -device virtconsole,chardev=virtio_console,name=org.openqa.console.virtio_console -chardev pipe,id=virtio_console1,path=virtio_console1,logfile=virtio_console1.log,logappend=on -device virtconsole,chardev=virtio_console1,name=org.openqa.console.virtio_console1 -chardev socket,path=qmp_socket,server,nowait,id=qmp_socket,logfile=qmp_socket.log,logappend=on -qmp chardev:qmp_socket -S -device virtio-scsi-pci,id=scsi0 -blockdev driver=file,node-name=hd0-overlay0-file,filename=/var/lib/openqa/pool/2/raid/hd0-overlay0,cache.no-flush=on -blockdev driver=qcow2,node-name=hd0-overlay0,file=hd0-overlay0-file,cache.no-flush=on -device virtio-blk,id=hd0-device,drive=hd0-overlay0,bootindex=0,serial=hd0
[2021-08-16T13:59:16.399 CEST] [debug] Waiting for 0 attempts
dmesg: read kernel buffer failed: Operation not permitted
[2021-08-16T13:59:16.641 CEST] [debug] Waiting for 1 attempts
[2021-08-16T13:59:16.642 CEST] [info] ::: backend::baseclass::die_handler: Backend process died, backend errors are reported below in the following lines:
QEMU terminated before QMP connection could be established. Check for errors below
[2021-08-16T13:59:16.642 CEST] [info] ::: OpenQA::Qemu::Proc::save_state: Saving QEMU state to qemu_state.json
[2021-08-16T13:59:16.643 CEST] [debug] Passing remaining frames to the video encoder
[2021-08-16T13:59:16.682 CEST] [debug] Waiting for video encoder to finalize the video
[2021-08-16T13:59:16.682 CEST] [debug] The built-in video encoder (pid 23538) terminated
[2021-08-16T13:59:16.684 CEST] [debug] QEMU: QEMU emulator version 5.2.0 (SUSE Linux Enterprise 15)
[2021-08-16T13:59:16.684 CEST] [debug] QEMU: Copyright (c) 2003-2020 Fabrice Bellard and the QEMU Project developers
[2021-08-16T13:59:16.684 CEST] [warn] !!! : qemu-system-x86_64: Could not find '/usr/sbin/smbd', please install it
[2021-08-16T13:59:16.685 CEST] [debug] sending magic and exit
and qemu was correctly highligted with warn
Updated by livdywan over 3 years ago
- Blocked by deleted (action #96719: recover imagetester with broken filesystem/hardware (was: automatic updates on imagetester don't work and it failed to come up after reboot))
Updated by livdywan over 3 years ago
- Status changed from Feedback to Resolved
Thank you! As discussed in chat, we can consider this resolved then. I was assuming it was blocked from an earlier conversation but you demonstrated that this is at best an issue with outdated code now and we have another ticket for fixing imagetester.