Project

General

Profile

Actions
Copy link

action #168376

closed

openQA Project (public) - coordination #58184: [saga][epic][use case] full version control awareness within openQA

openQA Project (public) - coordination #152847: [epic] version control awareness within openQA for test distributions

Enable automatic openQA git clone instead of fetchneedles on OSD size:S

Added by okurz 5 months ago. Updated 18 days ago.

Status:
Resolved
Priority:
Low
Assignee:
mkittler
Category:
Feature requests
Target version:
openQA Project (public) - Ready
Start date:
Due date:
% Done:

0%

Estimated time:
Tags:
osd, infra

Description

Motivation

After #164898 and stabilization on o3 we should disable fetchneedles cron on OSD and enable git auto-clone.

Acceptance criteria

  • AC1: Instead of the fetchneedles cronjob test/needle repos are updated via a minion job when tests are started on OSD
  • AC2: fetchneedles cron is ensured to be not enabled again by salt

Suggestions

Related issues 6 (0 open — 6 closed)

Related to openQA Project (public) - action #124487: [openqa_logwarn] Can't call method "BUILD" on an undefined value at /usr/share/openqa/script/../lib/OpenQA/WebAPI/Plugin/AMQP.pmResolvedtinita2023-02-142024-11-12

Actions
Related to openQA Infrastructure (public) - action #170464: Enable automatic openQA git clone instead of fetchneedles on o3Rejectedokurz2024-11-28

Actions
Blocked by openQA Project (public) - action #169342: Fix scheduling parallel clusters with `PARALLEL_ONE_HOST_ONLY=1` when the openQA jobs depend on Minion jobs e.g. `git_clone` tasks started for the `git_auto_update` feature size:MResolvedmkittler2024-11-05

Actions
Blocked by openQA Project (public) - action #169510: Improve non-transactional creation of Minion jobs for Git updates when restarting jobs size:MResolvedmkittler2025-01-23

Actions
Copied from openQA Project (public) - action #164898: Replace fetchneedles with a minion job for the regular update of git repos size:MResolvedtinita

Actions
Copied to openQA Project (public) - action #168379: Enable automatic openQA git clone by default size:SResolvedmkittler2024-10-17

Actions
Actions
Copy link
 #1

Updated by okurz 5 months ago

  • Copied from action #164898: Replace fetchneedles with a minion job for the regular update of git repos size:M added
Actions
Copy link
 #2

Updated by okurz 5 months ago

  • Copied to action #168379: Enable automatic openQA git clone by default size:S added
Actions
Copy link
 #3

Updated by tinita 5 months ago

  • Description updated (diff)
Actions
Copy link
 #4

Updated by okurz 5 months ago

  • Target version changed from Tools - Next to Ready
Actions
Copy link
 #5

Updated by okurz 5 months ago

  • Priority changed from Normal to High
Actions
Copy link
 #6

Updated by tinita 5 months ago

  • Description updated (diff)
Actions
Copy link
 #7

Updated by mkittler 4 months ago

  • Subject changed from Enable automatic openQA git clone instead of fetchneedles on OSD to Enable automatic openQA git clone instead of fetchneedles on OSD size:S
  • Description updated (diff)
  • Status changed from New to Workable
Actions
Copy link
 #8

Updated by mkittler 4 months ago

  • Status changed from Workable to In Progress
  • Assignee set to mkittler
Actions
Copy link
 #9

Updated by tinita 4 months ago

  • Description updated (diff)
Actions
Copy link
 #11

Updated by mkittler 4 months ago

  • Status changed from In Progress to Feedback
Actions
Copy link
 #12

Updated by mkittler 4 months ago

I merged https://gitlab.suse.de/openqa/salt-states-openqa/-/merge_requests/1294 today and the change has been effective since Oct 28 09:48:27 (UTC). I haven't seen any related failed Minion jobs since then.

Actions
Copy link
 #13

Updated by mkittler 4 months ago

  • Related to action #124487: [openqa_logwarn] Can't call method "BUILD" on an undefined value at /usr/share/openqa/script/../lib/OpenQA/WebAPI/Plugin/AMQP.pm added
Actions
Copy link
 #14

Updated by mkittler 4 months ago

Judging by the Minion dashboard we're still good. The related ticket #124487 became more apparent and @tinita is taking care of it.

Actions
Copy link
 #15

Updated by mkittler 4 months ago

No failing Minion jobs and the test and needle repos still seem up-to-date.

Actions
Copy link
 #16

Updated by mkittler 4 months ago

  • Status changed from Feedback to Resolved

It looks still good so I'm considering this resolved.

Actions
Copy link
 #17

Updated by mkittler 4 months ago

  • Status changed from Resolved to In Progress
Actions
Copy link
 #19

Updated by openqa_review 4 months ago

  • Due date set to 2024-11-15

Setting due date based on mean cycle time of SUSE QE Tools

Actions
Copy link
 #20

Updated by okurz 4 months ago

  • Due date deleted (2024-11-15)
  • Priority changed from High to Low

@mkittler please create a separate dev-task for whatever needs to be improved, e.g. related to scheduler, and block on that

Actions
Copy link
 #22

Updated by mkittler 4 months ago

  • Blocked by action #169342: Fix scheduling parallel clusters with `PARALLEL_ONE_HOST_ONLY=1` when the openQA jobs depend on Minion jobs e.g. `git_clone` tasks started for the `git_auto_update` feature size:M added
Actions
Copy link
 #23

Updated by mkittler 4 months ago

  • Status changed from In Progress to Blocked
Actions
Copy link
 #24

Updated by tinita 3 months ago

  • Related to action #170464: Enable automatic openQA git clone instead of fetchneedles on o3 added
Actions
Copy link
 #25

Updated by okurz 3 months ago

  • Status changed from Blocked to Workable

Unblocked

Actions
Copy link
 #26

Updated by dheidler 3 months ago

Enable new systemd timer

What timer?

Actions
Copy link
 #27

Updated by mkittler 3 months ago

  • Blocked by action #169510: Improve non-transactional creation of Minion jobs for Git updates when restarting jobs size:M added
Actions
Copy link
 #28

Updated by mkittler 3 months ago

We probably want to look into #169510 first.

@dheidler I can't access GitLab right now but when I remember correctly my MR enabled the timer so the diff should answer your question.

Actions
Copy link
 #29

Updated by mkittler 3 months ago

  • Status changed from Workable to Blocked
Actions
Copy link
 #30

Updated by tinita 3 months ago

  • Description updated (diff)
Actions
Copy link
 #31

Updated by okurz 3 months ago

  • Target version changed from Ready to Tools - Next
Actions
Copy link
 #32

Updated by okurz about 1 month ago

  • Target version changed from Tools - Next to Ready
Actions
Copy link
 #33

Updated by mkittler 21 days ago

  • Status changed from Blocked to Feedback
Actions
Copy link
 #34

Updated by mkittler 21 days ago

We now get many https://openqa.suse.de/minion/jobs?task=git_clone jobs but none are failing.

Actions
Copy link
 #35

Updated by mkittler 18 days ago

  • Status changed from Feedback to Blocked

I want to look into #177048 before resolving this because it might be related.

Actions
Copy link
 #36

Updated by mkittler 18 days ago

  • Status changed from Blocked to Resolved

I don't think the other ticket is related, see #177048#note-7.

The Minion dashboard still looks good, too. So I'm considering this resolved.

Actions
Copy link

Also available in: Atom PDF