Project

General

Profile

Actions

action #174295

closed

coordination #127031: [saga][epic] openQA for SUSE customers

coordination #80150: [epic] Scale out openQA: Easier openQA setup

The cache loading from the fixed folder is not working size:S

Added by snowmix about 2 months ago. Updated 14 days ago.

Status:
Resolved
Priority:
Low
Assignee:
Category:
Support
Target version:
Start date:
2024-12-12
Due date:
% Done:

0%

Estimated time:

Description

Motivation

Hello, I'm trying to set up caching using https://open.qa/docs/#asset-caching, but the loading of ISO and HDD from the fixed folders on the workers is not working.

Suggestions

  • Look at the provided os-autoinst.log in #note-1
  • Understand the relevancy of HDD_1 (not) being in hdd/fixed/
  • Talk to the OP

Files

Actions #1

Updated by snowmix about 2 months ago

Add log file.
HDD_1 is in hdd/fixed/
if you move it to hdd/, everything works out.

Actions #2

Updated by okurz about 2 months ago

  • Subject changed from The cache loading from the fixed folder is not working. to The cache loading from the fixed folder is not working
Actions #3

Updated by okurz about 2 months ago

  • Tags set to reactive work
  • Category set to Support
  • Assignee deleted (okurz)
  • Target version set to Ready
Actions #4

Updated by okurz about 2 months ago

  • Parent task set to #80150
Actions #5

Updated by livdywan about 1 month ago

  • Subject changed from The cache loading from the fixed folder is not working to The cache loading from the fixed folder is not working size:s
  • Description updated (diff)
  • Status changed from New to Workable
Actions #6

Updated by okurz about 1 month ago

  • Subject changed from The cache loading from the fixed folder is not working size:s to The cache loading from the fixed folder is not working size:S
  • Priority changed from Normal to High
Actions #7

Updated by gpathak about 1 month ago

  • Status changed from Workable to In Progress
  • Assignee set to gpathak

Updated by gpathak about 1 month ago

Hi @snowmix
I just tried loading an ISO from /var/lib/openqa/factory/iso/fixed/ and ISO got loaded from fixed folder successfully.

[2024-12-27T17:33:25.972607+05:30] [info] +++ setup notes +++
[2024-12-27T17:33:25.973039+05:30] [info] Running on odroidh2:1 (Linux 6.4.0-150600.23.30-default #1 SMP PREEMPT_DYNAMIC Sat Dec  7 08:37:53 UTC 2024 (8c25a0a) x86_64)
[2024-12-27T17:33:25.982095+05:30] [debug] Found ISO, caching openSUSE-Leap-15.6-NET-x86_64-Media.iso
[2024-12-27T17:33:25.992492+05:30] [info] Downloading openSUSE-Leap-15.6-NET-x86_64-Media.iso, request #2 sent to Cache Service
[2024-12-27T17:33:36.128724+05:30] [info] Download of openSUSE-Leap-15.6-NET-x86_64-Media.iso processed:
[info] [#2] Cache size of "/var/lib/openqa/cache" is 261 MiB, with limit 20 GiB
[info] [#2] Downloading "openSUSE-Leap-15.6-NET-x86_64-Media.iso" from "http://192.168.31.144/tests/4/asset/iso/openSUSE-Leap-15.6-NET-x86_64-Media.iso"
[info] [#2] Content of "/var/lib/openqa/cache/192.168.31.144/openSUSE-Leap-15.6-NET-x86_64-Media.iso" has not changed, updating last use
[2024-12-27T17:33:36.134835+05:30] [debug] +++ worker notes +++

The contents of /var/lib/openqa/factory/iso/fixed/ on my setup are:

/var/lib/openqa/factory/iso/
└── fixed
    ├── openSUSE-Leap-15.6-DVD-x86_64-Build710.3-Media.iso
    ├── openSUSE-Leap-15.6-DVD-x86_64-Current.iso
    └── openSUSE-Leap-15.6-NET-x86_64-Media.iso

I also tried booting an existing qcow2 image by putting it in hdd/fixed directory and it was successful:

The location of qcow2 image is as shown on my setup:

I used the below command to trigger the test on my setup:

openqa-cli api -X post jobs --host http://192.168.31.144 TEST=boot_to_snapshot HDD_1=opensuse-15.6-x86_64-710.3-gnome@64bit.qcow2 MACHINE=64bit

@snowmix Can you please share more details about your setup?

  • Are you running Web-UI and workers on the same machine?
  • Have you tired checking that the service openqa-worker-cacheservice and openqa-worker-cacheservice-minion are running?
Actions #9

Updated by openqa_review about 1 month ago

  • Due date set to 2025-01-11

Setting due date based on mean cycle time of SUSE QE Tools

Actions #10

Updated by gpuliti 29 days ago

  • Status changed from In Progress to Feedback
Actions #11

Updated by gpathak 23 days ago

Hi @snowmix
Can you please share more details about your setup?

Actions #12

Updated by livdywan 23 days ago

  • Due date changed from 2025-01-11 to 2025-01-16

Let's give them some time to get back to us

Actions #13

Updated by okurz 18 days ago

  • Due date changed from 2025-01-16 to 2025-01-31
  • Priority changed from High to Low

waiting for OP feedback

Actions #14

Updated by snowmix 18 days ago

We checked again, redeployed the servers, but unfortunately, after the new year, it doesn't reproduce. The task can be closed.

One small question: has there been any consideration for functionality that allows subfolders to be present in the fixed folder? Currently, we haven't been able to make it automatically search if there is the next path hdd/fixed/testdir.

Actions #15

Updated by okurz 16 days ago

snowmix wrote in #note-14:

One small question: has there been any consideration for functionality that allows subfolders to be present in the fixed folder? Currently, we haven't been able to make it automatically search if there is the next path hdd/fixed/testdir.

no, that was not considered so far. What would be the use case for this feature?

Actions #16

Updated by okurz 14 days ago

  • Due date deleted (2025-01-31)
  • Status changed from Feedback to Resolved

@snowmix if you have further feature requests feel welcome to create new tickets

Actions

Also available in: Atom PDF