Project

General

Profile

Actions

action #17790

closed

Need to detach HDDs before upload

Added by coolo almost 8 years ago. Updated over 7 years ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
Regressions/Crashes
Target version:
-
Start date:
2017-03-19
Due date:
% Done:

0%

Estimated time:

Description

Our disk images are not self contained:

coolo@openqa:/var/lib/openqa/factory/hdd> qemu-img info sle-12-SP3-x86_64-0285-Server-DVD@64bit-with-ltp.qcow2
image: sle-12-SP3-x86_64-0285-Server-DVD@64bit-with-ltp.qcow2
file format: qcow2
virtual size: 50G (53687091200 bytes)
disk size: 4.0G
cluster_size: 65536
backing file: /var/lib/openqa/pool/1/SLES-12-SP3-x86_64-0285-minimal_with_sdk0126_installed.qcow2
Snapshot list:
ID TAG VM SIZE DATE VM CLOCK
1 lastgood 2.2G 2017-03-19 09:35:05 00:06:34.824
Format specific information:
compat: 1.1
lazy refcounts: false
refcount bits:

And I wonder if we shouldn't strip the snapshots. To store and transfer unused 2.2GB sounds insane.

This is rather urgent to fix - it wasn't such a big problem when all images referenced /var/lib/openqa/share/factory - but without
global NFS this makes HDDs impossilble to port.


Related issues 1 (0 open1 closed)

Related to openQA Project (public) - action #17574: [tools]Add caching/syncing of assetsResolvedszarate2017-04-29

Actions
Actions #1

Updated by coolo almost 8 years ago

  • Related to action #17574: [tools]Add caching/syncing of assets added
Actions #2

Updated by coolo almost 8 years ago

qemu-img convert is enough. I guess we need to run this at least if HDD_* is set

Actions #3

Updated by coolo almost 8 years ago

We can workaround the issue by setting QEMU_COMPRESS_QCOW2 in the ltp test suite - and I actually wonder why we shouldn't do this by default.

without:
real 2m30.306s
3.6G

with:
real 4m11.117s
1.3G

Actions #4

Updated by okurz over 7 years ago

  • Status changed from New to In Progress
  • Assignee set to okurz

I don't see any reasons either why not to do the compress, especially if it helps us in that regard. I guess changing the default just has never been done since the introduction of compression by lnussel in 2015 as optional.

https://github.com/os-autoinst/os-autoinst/pull/736

Actions #5

Updated by lnussel over 7 years ago

IIRC the compression was buggy and lead to random failures

Actions #6

Updated by coolo over 7 years ago

the upload was buggy and caused random failures - but let's watch it.

Actions #7

Updated by okurz over 7 years ago

  • Status changed from In Progress to Feedback

https://github.com/os-autoinst/os-autoinst/pull/736 is merged now. Also with https://github.com/os-autoinst/openQA/pull/1263 we might have some issues fixed which have been seen today. Let's wait for confirmation after deployment and "another night".

Actions #8

Updated by okurz over 7 years ago

  • Status changed from Feedback to Resolved

[23 Mar 2017 14:01:09] nsinger: can you crosscheck https://progress.opensuse.org/issues/17790 if e.g. openQA-in-openQA image now is self-contained?
[23 Mar 2017 14:07:57] okurz: HDD from today has no backing-file and boots up only with "opensuse-Tumbleweed-x86_64@64bit-:TW.1252.qcow2" (the exported image) -> seems all fine

Actions

Also available in: Atom PDF