Project

General

Profile

Actions
Copy link

action #46742

closed

test incompletes trying to revert to qemu snapshot auto_review:"Could not open backing file: Could not open .*.qcow.*No such file or directory", likely premature deletion of files from cache

Added by okurz almost 6 years ago. Updated almost 5 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
okurz
Category:
Regressions/Crashes
Target version:
Current Sprint
Start date:
2019-01-28
Due date:
2020-02-18
% Done:

0%

Estimated time:

Description

Observation

In https://openqa.opensuse.org/tests/841053/file/autoinst-log.txt

[2019-01-28T00:52:33.034 CET] [debug] Loading a VM snapshot lastgood
[2019-01-28T00:52:33.035 CET] [debug] Loading snapshot (Current VM state is running).
[2019-01-28T00:52:33.051 CET] [debug] EVENT {"event":"STOP","timestamp":{"microseconds":51576,"seconds":1548633153}}
[2019-01-28T00:52:33.053 CET] [info] ::: OpenQA::Qemu::Proc::save_state: Saving QEMU state to qemu_state.json
[2019-01-28T00:52:35.439 CET] [debug] QEMU: qemu-system-x86_64: terminating on signal 15 from pid 26050 (/usr/bin/isotovideo: backen)
[2019-01-28T00:52:35.623 CET] [debug] running /usr/bin/qemu-img create -f qcow2 -b /var/lib/openqa/pool/7/raid/hd0-overlay10 /var/lib/openqa/pool/7/raid/hd0-overlay11 42949672960
[2019-01-28T00:52:35.651 CET] [debug] qemu-img: warning: Could not verify backing image. This may become an error in future versions.
Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open '/var/lib/openqa/pool/7/opensuse-42.3-x86_64-GM-kde@64bit-2G.qcow2': No such file or directory
Formatting '/var/lib/openqa/pool/7/raid/hd0-overlay11', fmt=qcow2 size=42949672960 backing_file=/var/lib/openqa/pool/7/raid/hd0-overlay10 cluster_size=65536 lazy_refcounts=off refcount_bits=16

[2019-01-28T00:52:35.651 CET] [debug] running /usr/bin/qemu-img create -f qcow2 -b /var/lib/openqa/pool/7/raid/cd0-overlay10 /var/lib/openqa/pool/7/raid/cd0-overlay11 125829120
[2019-01-28T00:52:35.683 CET] [debug] Formatting '/var/lib/openqa/pool/7/raid/cd0-overlay11', fmt=qcow2 size=125829120 backing_file=/var/lib/openqa/pool/7/raid/cd0-overlay10 cluster_size=65536 lazy_refcounts=off refcount_bits=16

[2019-01-28T00:52:35.684 CET] [debug] starting: /usr/bin/qemu-system-x86_64 -vga cirrus -only-migratable -chardev ringbuf,id=serial0,logfile=serial0,logappend=on -serial chardev:serial0 -soundhw ac97 -global isa-fdc.driveA= -m 2048 -cpu qemu64 -netdev user,id=qanet0 -device virtio-net,netdev=qanet0,mac=52:54:00:12:34:56 -boot once=d,menu=on,splash-time=5000 -device usb-ehci -device usb-tablet -smp 1 -enable-kvm -no-shutdown -vnc :97,share=force-shared -device virtio-serial -chardev socket,path=virtio_console,server,nowait,id=virtio_console,logfile=virtio_console.log,logappend=on -device virtconsole,chardev=virtio_console,name=org.openqa.console.virtio_console -chardev socket,path=qmp_socket,server,nowait,id=qmp_socket,logfile=qmp_socket.log,logappend=on -qmp chardev:qmp_socket -S -device virtio-scsi-pci,id=scsi0 -blockdev driver=file,node-name=hd0-overlay11-file,filename=/var/lib/openqa/pool/7/raid/hd0-overlay11,cache.no-flush=on -blockdev driver=qcow2,node-name=hd0-overlay11,file=hd0-overlay11-file,cache.no-flush=on -device virtio-blk,id=hd0-device,drive=hd0-overlay11,serial=hd0 -blockdev driver=file,node-name=cd0-overlay11-file,filename=/var/lib/openqa/pool/7/raid/cd0-overlay11,cache.no-flush=on -blockdev driver=qcow2,node-name=cd0-overlay11,file=cd0-overlay11-file,cache.no-flush=on -device scsi-cd,id=cd0-device,drive=cd0-overlay11,serial=cd0 -incoming defer
Attempt 0 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 1 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 2 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 3 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 4 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 5 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 6 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 7 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 8 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 9 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 10 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 11 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 12 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 13 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 14 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 15 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 16 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 17 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 18 at /usr/lib/os-autoinst/osutils.pm line 130.
Attempt 19 at /usr/lib/os-autoinst/osutils.pm line 130.
[2019-01-28T00:52:54.848 CET] [debug] Backend process died, backend errors are reported below in the following lines:
can't open qmp at /usr/lib/os-autoinst/OpenQA/Qemu/Proc.pm line 404.

[2019-01-28T00:52:54.848 CET] [info] ::: OpenQA::Qemu::Proc::save_state: Saving QEMU state to qemu_state.json
last frame
[2019-01-28T00:52:54.880 CET] [info] ::: OpenQA::Qemu::Proc::save_state: Saving QEMU state to qemu_state.json
[2019-01-28T00:52:54.882 CET] [debug] QEMU: QEMU emulator version 2.11.2(openSUSE Leap 15.0)
[2019-01-28T00:52:54.882 CET] [debug] QEMU: Copyright (c) 2003-2017 Fabrice Bellard and the QEMU Project developers
[2019-01-28T00:52:54.882 CET] [debug] QEMU: qemu-system-x86_64: -blockdev driver=qcow2,node-name=hd0-overlay11,file=hd0-overlay11-file,cache.no-flush=on: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open backing file: Could not open '/var/lib/openqa/pool/7/opensuse-42.3-x86_64-GM-kde@64bit-2G.qcow2': No such file or directory
[2019-01-28T00:52:54.882 CET] [debug] sending magic and exit
[2019-01-28T00:52:54.883 CET] [debug] received magic close
[2019-01-28T00:52:54.884 CET] [debug] THERE IS NOTHING TO READ 15 4 3
[2019-01-28T00:52:54.913 CET] [debug] backend process exited: 0
[2019-01-28T00:52:54.916 CET] [debug] commands process exited: 0
[2019-01-28T00:52:55.917 CET] [debug] sysread failed: 
syswrite failed Broken pipe at /usr/lib/os-autoinst/myjsonrpc.pm line 40.
    myjsonrpc::send_json(GLOB(0x55b06c28be48), HASH(0x55b06c2c8b98)) called at /usr/lib/os-autoinst/autotest.pm line 313
    autotest::query_isotovideo("backend_reset_console", HASH(0x55b075dd80e0)) called at /usr/lib/os-autoinst/basetest.pm line 645
    basetest::rollback_activated_consoles(consoletest_finish=HASH(0x55b06d9443d8)) called at /usr/lib/os-autoinst/autotest.pm line 375
    autotest::runalltests() called at /usr/lib/os-autoinst/autotest.pm line 214
    eval {...} called at /usr/lib/os-autoinst/autotest.pm line 214
    autotest::run_all() called at /usr/lib/os-autoinst/autotest.pm line 267
    autotest::__ANON__(Mojo::IOLoop::ReadWriteProcess=HASH(0x55b06ddb32e8)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 325
    eval {...} called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 325
    Mojo::IOLoop::ReadWriteProcess::_fork(Mojo::IOLoop::ReadWriteProcess=HASH(0x55b06ddb32e8), CODE(0x55b06dcba0c8)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 476
    Mojo::IOLoop::ReadWriteProcess::start(Mojo::IOLoop::ReadWriteProcess=HASH(0x55b06ddb32e8)) called at /usr/lib/os-autoinst/autotest.pm line 268
    autotest::start_process() called at /usr/bin/isotovideo line 251

Related issues 8 (1 open — 7 closed)

Related to openQA Project (public) - action #12180: [webui] Prevent tests to be triggered when required assets are not present (anymore)New2016-05-31

Actions
Related to openQA Project (public) - action #34783: Don't let jobs incomplete if mandatory resources are missingResolvedmkittler2018-04-12

Actions
Related to openQA Infrastructure (public) - action #19238: setup pool devices+mounts+folders with salt(was: ext2 on workers busted)Resolvedokurz2017-05-19

Actions
Related to openQA Project (public) - action #57782: retrigger of job with failed gru download task ends up incomplete with 404 on asset, does not retry downloadResolvedmkittler2019-10-08

Actions
Has duplicate openQA Project (public) - action #55511: job failed to revert to lastgood snapshot "Could not open backing file: Could not open '/var/lib/openqa/pool/2/….iso': No such file or directory"Rejectedokurz2019-08-14

Actions
Has duplicate openQA Project (public) - action #54464: qemu-img convert failedRejectedokurz2019-07-19

Actions
Has duplicate openQA Tests (public) - action #34270: [tools]caching issue in openQA?Rejectedokurz2018-04-04

Actions
Copied to openQA Project (public) - action #60140: job incompletes failing on initial asset download with "Asset was already requested by another job"Resolvedkraih2019-01-28

Actions
Actions
Copy link

Also available in: Atom PDF