Project

General

Profile

Actions

action #55373

closed

Worker::Cache thinks no space is used when cache resides in symlinked folder pointing to other partition

Added by okurz over 4 years ago. Updated over 4 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Regressions/Crashes
Target version:
Start date:
2019-06-18
Due date:
% Done:

0%

Estimated time:

Description

Observation

See #53261

Suggestion

Check how the used space is calculated


Related issues 1 (0 open1 closed)

Copied from openQA Infrastructure - action #53261: tests incomplete with "No space left on device" openqaworker-arm-2 ran out of space in uploading files in jobs -> cache takes 500G, should be only 50G?Resolvedokurz2019-06-18

Actions
Actions #1

Updated by okurz over 4 years ago

  • Copied from action #53261: tests incomplete with "No space left on device" openqaworker-arm-2 ran out of space in uploading files in jobs -> cache takes 500G, should be only 50G? added
Actions #2

Updated by coolo over 4 years ago

  • Priority changed from Normal to High
  • Target version set to Ready

That's strange as the cache size is calculcated by the sum of things inside it - how it's structured shouldn't matter.

Actions #3

Updated by coolo over 4 years ago

  • Priority changed from High to Normal

As the partitioning was changed, it's no longer high prio

Actions #4

Updated by mkittler over 4 years ago

  • Assignee set to mkittler
  • Target version changed from Ready to Current Sprint

I've just looked at the code and it uses Mojo::File::list_tree which apparently doesn't work with symlinks, e.g. I've just tried the following:

print(path('/hdd/openqa-devel/openqa/share/tests/opensuse')->list_tree->size);
31445

print(path('/hdd/openqa-devel/openqa/share/tests/sle')->list_tree->size);
0

(sle is a symlink to opensuse)

Actions #5

Updated by mkittler over 4 years ago

  • Status changed from New to In Progress
Actions #6

Updated by okurz over 4 years ago

  • Status changed from In Progress to Resolved

It's merged and deployed also to OSD. We do not use symlinks in our cache setup due to this ticket and I doubt it's worth the effort to change production setup back to crosscheck. I trust your testing :)

Actions #7

Updated by kraih over 4 years ago

  • Status changed from Resolved to In Progress
  • Assignee changed from mkittler to kraih

While working on #46742 i noticed that this fix only partially works. A symlinked cache directory currently causes all existing files to be purged from the cache with every new download. Think i know how to fix this though, so will prepare a PR.

Actions #8

Updated by kraih over 4 years ago

  • Status changed from In Progress to Feedback
Actions #9

Updated by kraih over 4 years ago

  • Status changed from Feedback to In Progress
Actions #10

Updated by kraih over 4 years ago

  • Status changed from In Progress to Feedback
Actions #11

Updated by okurz over 4 years ago

  • Status changed from Feedback to Resolved
  • Target version changed from Current Sprint to Done

PR was merged 12 days ago. This is life on both o3 and osd and there were no reports from other users, assuming Resolved.

Actions

Also available in: Atom PDF