Project

General

Profile

action #17218

Can't publish HDD1: cksum: /var/lib/openqa/share/factory/hdd/sle-12-SP3-x86_64-0248-textmode@64bit.qcow2.TEMP-IMZWlhMn: Permission denied

Added by michalnowak about 5 years ago. Updated about 5 years ago.

Status:
Resolved
Priority:
High
Assignee:
oholecek
Category:
Concrete Bugs
Target version:
Milestone 6
Start date:
2017-02-20
Due date:
% Done:

100%

Estimated time:
Difficulty:

Description

Using: openQA-4.4.1487185841.20f2a62-75.2.noarch and latest Mojo.

openQA is unable to publish HDD due to:

cksum: /var/lib/openqa/share/factory/hdd/sle-12-SP3-x86_64-0248-textmode@64bit.qcow2.TEMP-IMZWlhMn: Permission denied
Use of uninitialized value $csum1 in concatenation (.) or string at /usr/share/openqa/script/../lib/OpenQA/Worker/Jobs.pm line 255.
Use of uninitialized value $size1 in concatenation (.) or string at /usr/share/openqa/script/../lib/OpenQA/Worker/Jobs.pm line 255.
Use of uninitialized value $csum1 in string eq at /usr/share/openqa/script/../lib/OpenQA/Worker/Jobs.pm line 257.

autoinst-log.txt:

15:44:40.4442 29040 QEMU: qemu-system-x86_64: terminating on signal 15 from pid 29040 (/usr/bin/isotovideo: backen)
15:44:40.4443 29040 sending magic and exit
15:44:40.4444 29034 received magic close
15:44:40.4487 29034 preparing hdd 1 for upload as sle-12-SP3-x86_64-0248-textmode@64bit.qcow2 in qcow2
15:44:40.4489 29034 running nice ionice qemu-img convert -O qcow2 raid/l1 assets_public/sle-12-SP3-x86_64-0248-textmode@64bit.qcow2 -c
29034: EXIT 0
+++ worker notes +++
end time: 2017-02-20 15:46:20
result: done
uploading install_and_reboot-y2logs.tar.bz2
uploading sle-12-SP3-x86_64-0248-textmode@64bit.qcow2
Checksum :3415784162 Sizes::1061024768
uploading video.ogv
uploading vars.json
uploading serial0.txt
uploading autoinst-log.txt

-rw-r--r-- 1 root      root    1015235072 Feb 17 14:25 sle-12-SP3-x86_64-0248-textmode@64bit.qcow2
-rw------- 1 geekotest nogroup 1061024768 Feb 20 16:46 sle-12-SP3-x86_64-0248-textmode@64bit.qcow2.TEMP-IMZWlhMn

This is how is worker started: su - _openqa-worker -c "/usr/bin/perl /usr/share/openqa/script/worker --instance 1". HDD gets published if it's started as root. This is a recent problem on my instance.

Related issues

Related to openQA Project - action #16430: [tools] qcow2 image upload fails with no apparent reason and job ends up incompleteResolved2017-02-02

Related to openQA Project - action #17408: Webinterface does not show any information when a worker fails to write to diskRejected2017-03-01

History

#1 Updated by szarate about 5 years ago

  • Related to action #16430: [tools] qcow2 image upload fails with no apparent reason and job ends up incomplete added

#2 Updated by coolo about 5 years ago

this is apparmor I bet

#3 Updated by szarate about 5 years ago

Probably:

/var/lib/openqa/share/factory/hdd/* r,

@mnowak can you try playing with apparmor and setting that line to /var/lib/openqa/share/factory/hdd/* rw, (i would even go as far as /var/lib/openqa/share/factory** rw).

But also, while writing this... @mnowak where are those files located? /var/lib/openqa/pool/%instance/assets_public? if so then apparmor shouldn't have anything to do with this. What do you think coolo?

#4 Updated by michalnowak about 5 years ago

I believe I have apparmor disabled:

# systemctl status apparmor
● apparmor.service
   Loaded: masked (/dev/null; bad)
   Active: inactive (dead)

#5 Updated by michalnowak about 5 years ago

But also, while writing this... @mnowak where are those files located? /var/lib/openqa/pool/%instance/assets_public?

Before they are being uploaded? I guess. Didn't change anything.

After upload files are in /var/lib/openqa/share/factory/hdd/.

Some paths in /var/lib/openqa/:

lrwxrwxrwx 1 root root 14 Mar 14  2016 assets -> share/factory/
lrwxrwxrwx 1 root root 13 Feb 20 08:10 factory -> share/factory
drwxr-xr-x 5 root root 51 Sep  8 07:45 share/

#6 Updated by asmorodskyi about 5 years ago

  • Related to action #17408: Webinterface does not show any information when a worker fails to write to disk added

#7 Updated by GraceWang about 5 years ago

I also met the same issue on my personal openQA environment.
And the apparmor is disabled.

#8 Updated by coolo about 5 years ago

apparmor is not guilty - the initial comment clearly shows 600 for geekotest, but the worker is running as _openqa-worker. So clearly plain permission denied

#9 Updated by okurz about 5 years ago

  • Category set to Concrete Bugs
  • Priority changed from Normal to High

I can confirm

#10 Updated by oholecek about 5 years ago

  • Status changed from New to In Progress
  • Assignee set to oholecek

#11 Updated by michel_mno about 5 years ago

I experienced a similar problem and previously created another issue
https://github.com/os-autoinst/openQA/issues/1249
I assume I can closed mine as duplicate of this one.

#12 Updated by oholecek about 5 years ago

  • Target version set to Milestone 6
  • % Done changed from 0 to 100

#13 Updated by oholecek about 5 years ago

  • Status changed from In Progress to Resolved

PR merged

Also available in: Atom PDF