Project

General

Profile

Actions

action #159174

open

coordination #58184: [saga][epic][use case] full version control awareness within openQA

coordination #152847: [epic] version control awareness within openQA for test distributions

Decrease load on remote git servers by not cloning CASEDIR/NEEDLE_DIR from every worker

Added by dheidler 13 days ago. Updated 12 days ago.

Status:
New
Priority:
Normal
Assignee:
Category:
Feature requests
Target version:
Start date:
2024-04-17
Due date:
% Done:

0%

Estimated time:

Description

Clone from the directory (see https://progress.opensuse.org/issues/159171) on the webui node to the worker cache.

  • Worker clones to local cache
    • Checks if webui has already a clone with the right url and branch in /var/lib/openqa/share/tests/DISTRI
    • Else worker fetches from remote git as referenced in CASEDIR/NEEDLE_DIR
    • Updates local cache from the webui
    • Analog with NEEDLES
  • --> Think of a protocol to use to share /var/lib/openqa/share/tests/DISTRI from webui to the workers
    • HTTP(S) - Propably the easiers way
    • Direct GIT Protocol (unencrypted, deprecated)
    • SSH (keys needed to set up)
  • Consider replacing rsync with git cache syncing (have a look at how the cacheservice handles that if CASEDIR and NEEDLE_DIR both are set - maybe nothing to do anymore)

Related issues 2 (2 open0 closed)

Related to openQA Project - action #157273: Run os-autoinst-distri-openQA directly from git without anything related in /var/lib/openqa/share/tests - Follow-up with ideas not tried out in the spike solution #157270 size:MBlockeddheidler2024-04-17

Actions
Blocked by openQA Project - action #159171: Create and maintain up to date version of test distri/needles for webui size:MIn Progressdheidler2024-04-17

Actions
Actions #1

Updated by dheidler 13 days ago

  • Blocked by action #159171: Create and maintain up to date version of test distri/needles for webui size:M added
Actions #2

Updated by tinita 12 days ago

  • Target version set to Tools - Next
Actions #3

Updated by okurz 12 days ago

  • Parent task changed from #157273 to #152847
Actions #4

Updated by okurz 12 days ago

  • Related to action #157273: Run os-autoinst-distri-openQA directly from git without anything related in /var/lib/openqa/share/tests - Follow-up with ideas not tried out in the spike solution #157270 size:M added
Actions #5

Updated by okurz 12 days ago

  • Category set to Feature requests
  • Assignee set to okurz

will need to think about this

Actions

Also available in: Atom PDF