Project

General

Profile

Actions

action #154237

closed

coordination #154777: [saga][epic] Shareable os-autoinst and test distribution plugins

coordination #108527: [epic] os-autoinst wheels for scalable code reuse of helper functions and segmented test distributions

[spike][timeboxed:10h] Ensure the worker cache doesn't duplicate git caching of test distributions on o3 size:S

Added by okurz 4 months ago. Updated about 1 month ago.

Status:
Resolved
Priority:
Low
Assignee:
Category:
Feature requests
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:

Description

Motivation

As part of #138029 support for git caching was included in os-autoinst covering test distributions as well as wheel repository. We can now look into caching test distributions from git fully enabled on a production openQA instance but also considering the worker cache service, e.g. circumvent the worker cache service or actually make use of it.

Acceptance criteria

  • AC1: There is no redundant syncing in the worker cache service, e.g. no cloning from github but the worker cache syncs test data that is never used

Suggestions

  • See what has been done in #154156
  • Consider the impact of the worker cache service, e.g. take a look into logs of affected openQA jobs and see how caching and git caching interact or not interact
  • One simple approach could be to simply not trigger syncing the worker test distribution directory caching in openQA jobs that have GIT_CACHE_DIR+CASEDIR+NEEDLESDIR includes a git URL set
  • Checkout the documentation of the worker cache to get started: https://open.qa/docs/#asset-caching
    • Consider adding something to the docs to make "worker cache" more discoverable
    • Add GIT_CACHE_DIR to the docs

Out of scope

  • Manage storage capacity long-term / clean-up

Related issues 2 (0 open2 closed)

Copied from openQA Project - action #154156: [spike][timeboxed:10h] Cache test distributions from git on production size:SResolvedmkittler

Actions
Copied to openQA Project - action #154240: Ensure cloning openQA jobs with GIT_CACHE_DIR works in usual use casesResolvedmkittler2024-01-25

Actions
Actions

Also available in: Atom PDF