Project

General

Profile

action #38780

[tools] Remove tmpfs from malbec again and give it a try

Added by oorlov almost 5 years ago. Updated about 3 years ago.

Status:
Rejected
Priority:
Normal
Assignee:
okurz
Target version:
-
Start date:
2018-07-24
Due date:
% Done:

0%

Estimated time:

Description

malbec is running with tmpfs for a long time to avoid the HDD as a bottleneck. This however can cause problems if many "big" jobs are running the same time since it could saturate the RAM/tmpfs pretty quickly (therefore the inital bug, see blow). However we're also running qa-power8-5 for a long time from spinning-disks now and don't see major problems so the idea is to switch malbec back to have its pool-directories written on the build-in HDDs instead of tmpfs.

Guess this would mainly involve modifying salt (to remove tmpfs) and adjust malbec to mount its HDD instead (mkfs, fstab-entry).

Previous bug description

Observation

openQA test in scenario sle-12-SP4-Server-DVD-ppc64le-cryptlvm@ppc64le finished as Incomplete due to "qemu-img: error while writing sector 17047168: No space left on device" while writing an image.

Related issues

Related to openQA Infrastructure - action #30595: [ppc64le] Deploy bcache on tmpfs workersNew2018-01-22

History

#1 Updated by oorlov almost 5 years ago

  • Description updated (diff)

#2 Updated by szarate almost 5 years ago

  • Related to action #30595: [ppc64le] Deploy bcache on tmpfs workers added

#3 Updated by szarate almost 5 years ago

We could reduce the number of workers to 3, and see if it improves the situation, pool for workers is mounted on tmpfs for malbec

#4 Updated by szarate almost 5 years ago

  • Priority changed from Urgent to Normal

#5 Updated by szarate almost 5 years ago

I don't think this is really urgent anymore :)

#6 Updated by coolo over 4 years ago

  • Project changed from openQA Project to openQA Infrastructure

#7 Updated by nicksinger over 4 years ago

  • Subject changed from [tools] No space left on worker malbec:5 to [tools] Remove tmpfs from malbec again and give it a try
  • Description updated (diff)
  • Status changed from New to Workable

#8 Updated by nicksinger over 4 years ago

  • Description updated (diff)

#9 Updated by okurz about 3 years ago

  • Status changed from Workable to Rejected
  • Assignee set to okurz

Overall we seem to have less issues with this since we moved some jobs from malbec to other machines. More important to followup I find #30595

Also available in: Atom PDF