action #17790
closedNeed to detach HDDs before upload
0%
Description
Our disk images are not self contained:
coolo@openqa:/var/lib/openqa/factory/hdd> qemu-img info sle-12-SP3-x86_64-0285-Server-DVD@64bit-with-ltp.qcow2
image: sle-12-SP3-x86_64-0285-Server-DVD@64bit-with-ltp.qcow2
file format: qcow2
virtual size: 50G (53687091200 bytes)
disk size: 4.0G
cluster_size: 65536
backing file: /var/lib/openqa/pool/1/SLES-12-SP3-x86_64-0285-minimal_with_sdk0126_installed.qcow2
Snapshot list:
ID TAG VM SIZE DATE VM CLOCK
1 lastgood 2.2G 2017-03-19 09:35:05 00:06:34.824
Format specific information:
compat: 1.1
lazy refcounts: false
refcount bits:
And I wonder if we shouldn't strip the snapshots. To store and transfer unused 2.2GB sounds insane.
This is rather urgent to fix - it wasn't such a big problem when all images referenced /var/lib/openqa/share/factory - but without
global NFS this makes HDDs impossilble to port.
Updated by coolo about 7 years ago
- Related to action #17574: [tools]Add caching/syncing of assets added
Updated by coolo about 7 years ago
qemu-img convert is enough. I guess we need to run this at least if HDD_* is set
Updated by coolo about 7 years ago
We can workaround the issue by setting QEMU_COMPRESS_QCOW2 in the ltp test suite - and I actually wonder why we shouldn't do this by default.
without:
real 2m30.306s
3.6G
with:
real 4m11.117s
1.3G
Updated by okurz about 7 years ago
- Status changed from New to In Progress
- Assignee set to okurz
I don't see any reasons either why not to do the compress, especially if it helps us in that regard. I guess changing the default just has never been done since the introduction of compression by lnussel in 2015 as optional.
Updated by lnussel about 7 years ago
IIRC the compression was buggy and lead to random failures
Updated by coolo about 7 years ago
the upload was buggy and caused random failures - but let's watch it.
Updated by okurz about 7 years ago
- Status changed from In Progress to Feedback
https://github.com/os-autoinst/os-autoinst/pull/736 is merged now. Also with https://github.com/os-autoinst/openQA/pull/1263 we might have some issues fixed which have been seen today. Let's wait for confirmation after deployment and "another night".
Updated by okurz about 7 years ago
- Status changed from Feedback to Resolved
[23 Mar 2017 14:01:09] nsinger: can you crosscheck https://progress.opensuse.org/issues/17790 if e.g. openQA-in-openQA image now is self-contained?
[23 Mar 2017 14:07:57] okurz: HDD from today has no backing-file and boots up only with "opensuse-Tumbleweed-x86_64@64bit-:TW.1252.qcow2" (the exported image) -> seems all fine