Project

General

Profile

Actions

action #164898

open

coordination #58184: [saga][epic][use case] full version control awareness within openQA

coordination #152847: [epic] version control awareness within openQA for test distributions

Replace fetchneedles with a minion job

Added by tinita 14 days ago. Updated 1 day ago.

Status:
Blocked
Priority:
Normal
Assignee:
Category:
Feature requests
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:

Description

https://progress.opensuse.org/issues/164898

Replace fetchneedles with a minion job

Motivation

See #162125 for the spike solution.

fetchneedles is a script provided within the openQA repo and we call it on o3+osd in a cron job every minute to keep test distribution checkouts updated but it's not well documented, can interfer with openQA internal git handling and (probably) still needs initial checkout of test distributions.

Acceptance criteria

  • AC1: Instead of the fetchneedles cronjob test/needle repos are updated via a minion job when tests are started
  • AC2: If necessary, also call that minion job regularly

Suggestions

Out of scope

  • Doing any kind of initial checkout if git working copies do not exist yet

Related issues 5 (3 open2 closed)

Related to openQA Project - action #164889: Ensure git repos cloned by minions are cleaned up regularly size:SWorkable

Actions
Related to openQA Project - action #164886: Use OpenQA::Git for all our git wrappers size:SIn Progressrobert.richardson2024-08-27

Actions
Related to openQA Project - action #164883: Use same minion guard for save_needle, delete_needles and git_clone size:SIn Progresstinita2024-08-29

Actions
Related to openQA Infrastructure - action #164895: o3 had corrupted needles git repo, lost uncommitted needles between 2024-07-31 and 2024-08-02Resolvedtinita2024-08-02

Actions
Copied from openQA Project - action #162125: [timeboxed:10h][spike] Let openQA keep test distribution checkouts up to date without needing fetchneedles size:SResolvedtinita2024-06-122024-08-13

Actions
Actions #1

Updated by tinita 14 days ago

  • Copied from action #162125: [timeboxed:10h][spike] Let openQA keep test distribution checkouts up to date without needing fetchneedles size:S added
Actions #2

Updated by tinita 14 days ago

  • Related to action #164889: Ensure git repos cloned by minions are cleaned up regularly size:S added
Actions #3

Updated by tinita 14 days ago

  • Related to action #164886: Use OpenQA::Git for all our git wrappers size:S added
Actions #4

Updated by tinita 14 days ago

  • Related to action #164883: Use same minion guard for save_needle, delete_needles and git_clone size:S added
Actions #5

Updated by tinita 14 days ago

  • Related to action #164895: o3 had corrupted needles git repo, lost uncommitted needles between 2024-07-31 and 2024-08-02 added
Actions #6

Updated by tinita 11 days ago

  • Description updated (diff)
Actions #7

Updated by tinita 1 day ago

  • Description updated (diff)
  • Status changed from New to Blocked
  • Assignee set to tinita

Blocking on the mentioned related tickets

Actions

Also available in: Atom PDF