Project

General

Profile

action #96311

qemu error message is still "debug", should be "warn" or more severe size:S

Added by okurz 11 months ago. Updated 11 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Concrete Bugs
Target version:
Start date:
2021-07-29
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

See #96272 , https://openqa.opensuse.org/tests/1860795 shows

[2021-07-29T11:35:35.119 UTC] [info] ::: backend::baseclass::die_handler: Backend process died, backend errors are reported below in the following lines:
  QEMU terminated before QMP connection could be established at /usr/lib/os-autoinst/OpenQA/Qemu/Proc.pm line 453.

[2021-07-29T11:35:35.120 UTC] [info] ::: OpenQA::Qemu::Proc::save_state: Saving QEMU state to qemu_state.json
[2021-07-29T11:35:35.122 UTC] [debug] Passing remaining frames to the video encoder
[image2pipe @ 0x55a04934b9c0] Could not find codec parameters for stream 0 (Video: ppm, none): unspecified size
Consider increasing the value for the 'analyzeduration' and 'probesize' options
Input #0, image2pipe, from 'pipe:':
  Duration: N/A, bitrate: N/A
    Stream #0:0: Video: ppm, none, 24 tbr, 24 tbn, 24 tbc
Output #0, webm, to '/var/lib/openqa/pool/2/video.webm':
Output file #0 does not contain any stream
[2021-07-29T11:35:35.130 UTC] [debug] Waiting for video encoder to finalize the video
[2021-07-29T11:35:35.130 UTC] [debug] The external video encoder (pid 20283) terminated
[2021-07-29T11:35:35.130 UTC] [debug] The built-in video encoder (pid 20284) terminated
[2021-07-29T11:35:35.132 UTC] [debug] QEMU: QEMU emulator version 4.2.1 (openSUSE Leap 15.2)
[2021-07-29T11:35:35.132 UTC] [debug] QEMU: Copyright (c) 2003-2019 Fabrice Bellard and the QEMU Project developers
[2021-07-29T11:35:35.132 UTC] [debug] QEMU: qemu-system-x86_64: Could not find '/usr/sbin/smbd', please install it

Suggestion


Related issues

Copied from openQA Infrastructure - action #96272: Test failed incomplete: "Reason: backend died: QEMU exited unexpectedly, see log for details" size:MResolved2021-07-292021-11-02

History

#1 Updated by okurz 11 months ago

  • Copied from action #96272: Test failed incomplete: "Reason: backend died: QEMU exited unexpectedly, see log for details" size:M added

#2 Updated by cdywan 11 months ago

  • Subject changed from qemu error message is still "debug", should be "warn" or more severe to qemu error message is still "debug", should be "warn" or more severe size:S
  • Description updated (diff)
  • Status changed from New to Workable
  • Priority changed from High to Normal

#3 Updated by osukup 11 months ago

job with windows VM

[debug] starting: /usr/bin/qemu-system-x86_64 -vga qxl -only-migratable -chardev ringbuf,id=serial0,logfile=serial0,logappend=on -serial chardev:serial0 -audiodev none,id=snd0 -device intel-hda -device hda-output,audiodev=snd0 -global isa-fdc.fdtypeA=none -m 2048 -machine q35 -cpu host -netdev user,id=qanet0,smb=/var/lib/openqa/pool/2 -device virtio-net,netdev=qanet0,mac=52:54:00:12:34:56 -device usb-ehci -device usb-tablet -smp 1 -enable-kvm -no-shutdown -vnc :92,share=force-shared -device virtio-serial -chardev pipe,id=virtio_console,path=virtio_console,logfile=virtio_console.log,logappend=on -device virtconsole,chardev=virtio_console,name=org.openqa.console.virtio_console -chardev socket,path=qmp_socket,server,nowait,id=qmp_socket,logfile=qmp_socket.log,logappend=on -qmp chardev:qmp_socket -S -blockdev driver=file,node-name=hd0-overlay0-file,filename=/var/lib/openqa/pool/2/raid/hd0-overlay0,cache.no-flush=on -blockdev driver=qcow2,node-name=hd0-overlay0,file=hd0-overlay0-file,cache.no-flush=on -device virtio-blk,id=hd0-device,drive=hd0-overlay0,bootindex=0,serial=hd0 -drive id=pflash-code-overlay0,if=pflash,file=/var/lib/openqa/pool/2/raid/pflash-code-overlay0,unit=0,readonly=on -drive id=pflash-vars-overlay0,if=pflash,file=/var/lib/openqa/pool/2/raid/pflash-vars-overlay0,unit=1

in definition of -netdev user,id=qanet0,smb=/var/lib/openqa/pool/2 is defined samba protocol by QEMU_ENABLE_SMBD=1 in vars.

which makes samba mandatory dep

#4 Updated by cdywan 11 months ago

osukup wrote:

in definition of -netdev user,id=qanet0,smb=/var/lib/openqa/pool/2 is defined samba protocol by QEMU_ENABLE_SMBD=1 in vars.

which makes samba mandatory dep

Mandatory sounds like this is an error and the job can't run 🤔️ During the estimation the assumption was that the job can still finish successfully and it's really a warning, also because qemu seems to continue to run going by the logs

#5 Updated by osukup 11 months ago

cdywan wrote:

osukup wrote:

in definition of -netdev user,id=qanet0,smb=/var/lib/openqa/pool/2 is defined samba protocol by QEMU_ENABLE_SMBD=1 in vars.

which makes samba mandatory dep

Mandatory sounds like this is an error and the job can't run 🤔️ During the estimation the assumption was that the job can still finish successfully and it's really a warning, also because qemu seems to continue to run going by the logs

yes ,this is little weird ...

from QEMU documentation:

smb=dir[,smbserver=addr]
When using the user mode network stack, activate a built-in SMB server so that Windows OSes can access to the host files in dir transparently. The IP address of the SMB server can be set to addr. By default the 4th IP in the guest network is used, i.e. x.x.x.4.

In the guest Windows OS, the line:

10.0.2.4 smbserver
must be added in the file C:\WINDOWS\LMHOSTS (for windows 9x/Me) or C:\WINNT\SYSTEM32\DRIVERS\ETC\LMHOSTS (Windows NT/2000).

Then dir can be accessed in \\smbserver\qemu.

Note that a SAMBA server must be installed on the host OS.

#6 Updated by osukup 11 months ago

  • When I look at history of imagetester:2 worker .. all WSL related jobs failed on same problem .. so probadly QEMU has loong timeout for contacting samba server, and then dies

#7 Updated by osukup 11 months ago

  • Assignee set to osukup

#8 Updated by osukup 11 months ago

  • Status changed from Workable to Feedback

For reporting this in 'debug' instead of 'warn' problem isn't in os-autoinst, but worker has old version of os-autoinst installed:

os-autoinst> git show 5361bf1c
commit 5361bf1c6c542b41f7dac978ca59e43e267789b0
Merge: 96b32687 75fb10e0
Author: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Date:   Mon Jun 21 08:09:14 2021 +0000

    Merge pull request #1697 from okurz/feature/remove_file_content

    Simplify bmwqemu::fileContent and mark as deprecated before removal`

but logging changes in PR 1706 and 1727 are from 29.6 and 20.7

#9 Updated by cdywan 11 months ago

  • Blocked by action #96719: recover imagetester with broken filesystem/hardware (was: automatic updates on imagetester don't work and it failed to come up after reboot) added

#10 Updated by osukup 11 months ago

to be on safe side testes on SUT without samba:

[2021-08-16T13:59:16.118 CEST] [debug] running /usr/bin/qemu-img create -f qcow2 -b /var/lib/openqa/pool/2/windows-10-x86_64-21H1@windows_bios_boot.qcow2 /var/lib/openqa/pool/2/raid/hd0-overlay0 85899345920
[2021-08-16T13:59:16.394 CEST] [debug] qemu-img: warning: Deprecated use of backing file without explicit backing format (detected format of qcow2)
  Formatting '/var/lib/openqa/pool/2/raid/hd0-overlay0', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=85899345920 backing_file=/var/lib/openqa/pool/2/windows-10-x86_64-21H1@windows_bios_boot.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2021-08-16T13:59:16.394 CEST] [debug] init_blockdev_images: Finished creating block devices
[2021-08-16T13:59:16.396 CEST] [debug] starting: /usr/bin/qemu-system-x86_64 -vga qxl -only-migratable -chardev ringbuf,id=serial0,logfile=serial0,logappend=on -serial chardev:serial0 -audiodev none,id=snd0 -device intel-hda -device hda-output,audiodev=snd0 -global isa-fdc.fdtypeA=none -m 2048 -machine q35 -cpu qemu64 -netdev user,id=qanet0,smb=/var/lib/openqa/pool/2 -device virtio-net,netdev=qanet0,mac=52:54:00:12:34:56 -boot order=c -device usb-ehci -device usb-tablet -smp 1 -enable-kvm -no-shutdown -vnc :92,share=force-shared -device virtio-serial -chardev pipe,id=virtio_console,path=virtio_console,logfile=virtio_console.log,logappend=on -device virtconsole,chardev=virtio_console,name=org.openqa.console.virtio_console -chardev pipe,id=virtio_console1,path=virtio_console1,logfile=virtio_console1.log,logappend=on -device virtconsole,chardev=virtio_console1,name=org.openqa.console.virtio_console1 -chardev socket,path=qmp_socket,server,nowait,id=qmp_socket,logfile=qmp_socket.log,logappend=on -qmp chardev:qmp_socket -S -device virtio-scsi-pci,id=scsi0 -blockdev driver=file,node-name=hd0-overlay0-file,filename=/var/lib/openqa/pool/2/raid/hd0-overlay0,cache.no-flush=on -blockdev driver=qcow2,node-name=hd0-overlay0,file=hd0-overlay0-file,cache.no-flush=on -device virtio-blk,id=hd0-device,drive=hd0-overlay0,bootindex=0,serial=hd0
[2021-08-16T13:59:16.399 CEST] [debug] Waiting for 0 attempts
dmesg: read kernel buffer failed: Operation not permitted
[2021-08-16T13:59:16.641 CEST] [debug] Waiting for 1 attempts
[2021-08-16T13:59:16.642 CEST] [info] ::: backend::baseclass::die_handler: Backend process died, backend errors are reported below in the following lines:
  QEMU terminated before QMP connection could be established. Check for errors below
[2021-08-16T13:59:16.642 CEST] [info] ::: OpenQA::Qemu::Proc::save_state: Saving QEMU state to qemu_state.json
[2021-08-16T13:59:16.643 CEST] [debug] Passing remaining frames to the video encoder
[2021-08-16T13:59:16.682 CEST] [debug] Waiting for video encoder to finalize the video
[2021-08-16T13:59:16.682 CEST] [debug] The built-in video encoder (pid 23538) terminated
[2021-08-16T13:59:16.684 CEST] [debug] QEMU: QEMU emulator version 5.2.0 (SUSE Linux Enterprise 15)
[2021-08-16T13:59:16.684 CEST] [debug] QEMU: Copyright (c) 2003-2020 Fabrice Bellard and the QEMU Project developers
[2021-08-16T13:59:16.684 CEST] [warn] !!! : qemu-system-x86_64: Could not find '/usr/sbin/smbd', please install it
[2021-08-16T13:59:16.685 CEST] [debug] sending magic and exit

and qemu was correctly highligted with warn

#11 Updated by cdywan 11 months ago

  • Blocked by deleted (action #96719: recover imagetester with broken filesystem/hardware (was: automatic updates on imagetester don't work and it failed to come up after reboot))

#12 Updated by cdywan 11 months ago

  • Status changed from Feedback to Resolved

Thank you! As discussed in chat, we can consider this resolved then. I was assuming it was blocked from an earlier conversation but you demonstrated that this is at best an issue with outdated code now and we have another ticket for fixing imagetester.

Also available in: Atom PDF