Project

General

Profile

Actions
Copy link

action #120243

closed

[qe-core] Leap 15.4 CR test suite (replaces Quarterly Updates)

Added by lkocman about 2 years ago. Updated over 1 year ago.

Status:
Resolved
Priority:
High
Assignee:
dvenkatachala
Category:
Infrastructure
Target version:
QA - QE-Core: Ready
Start date:
2022-11-10
Due date:
% Done:

0%

Estimated time:
Difficulty:
Sprint:
QE-Core: April Sprint 23 (Apr 05 - May 03)
Tags:
qe-core-february-sprint

Description

Hello QA,

this is an action item from today's syncup call with Jan Heiko, Marcus, Max, and myself.
https://etherpad.opensuse.org/p/ReleaseEngineering-20221110-maintenance-discussion

We have completely stopped doing Quarterly Updates for Leap 15.X and instead we've started to provide Continously Rebuild DVD in parallel with GA image. This can be already seen here: https://get.opensuse.org/leap . In general we'd like to reduce rebuilds to weekly/bi-weekly. We're currently thining of enabling disabling build flag via a botmaster pipeline, so this would be then the expected cadence.

Reason for the transition is mostly various early (weeks after GA) requests to Respin DVDs outside SLE QU schedule from the ARM community, and then various issues that we've had with full refresh of ftp-trees and DVD e.g. boo#1202116

"Respin" test suite can be dropped:
https://openqa.opensuse.org/group_overview/88
https://github.com/os-autoinst/opensuse-jobgroups/blob/master/job_groups/opensuse_leap_15_respin.yaml

What we need is preferably very minimal test suite preferably focused on boot and default installation.
The idea is that we will always offer a GA media that users can always fall back to in case of any issues.

Heiko mentioned that similar effort of weekly/bi-weekly reviews on SLES side, so we should try to re-use as much as possible.

Thank you!

Acceptance Criteria

  1. Drop Respin JobGroup
  2. Define minimal test suites for the new "Continous Rebuild" medium/JobGroup
Actions
Copy link
 #1

Updated by lkocman about 2 years ago

  • Assignee set to jstehlik
Actions
Copy link
 #2

Updated by lkocman about 2 years ago

Jan mentioned that this will be discussed on Wed meeting.

Actions
Copy link
 #3

Updated by maritawerner about 2 years ago

  • Project changed from openQA Tests to 175
Actions
Copy link
 #4

Updated by lkocman about 2 years ago

Comments from Max

  1. Sync CR-DVD to openqa
  2. Need to adjust openSUSE:Leap:15.4:Images config in openqa-trigger-from-obs for adding the 15.4 CR DVD, from openSUSE:Leap:15.4:Images:ToTest

  3. We don't rebuild ftp-tree within CR, so there is no ftp-tree be able to sync to openqa, the asset repo should use GA official download repo instead

  4. Trigger tests

  5. openqa-jobgroups need to be adjusted in the 'openSUSE Leap 15.4 Images' jobgroup, we can resuse the testsuite we had in GA's test jobgroup, or we can simplify them if we don't need testsuites as much as we had in GA

Actions
Copy link
 #5

Updated by jstehlik almost 2 years ago

  • Project changed from 175 to openQA Tests
  • Assignee changed from jstehlik to szarate

Assigned to Santi and moved.

Actions
Copy link
 #6

Updated by maritawerner almost 2 years ago

  • Subject changed from Leap 15.4 CR test suite (replaces Quarterly Updates) to [qe-core] Leap 15.4 CR test suite (replaces Quarterly Updates)
Actions
Copy link
 #7

Updated by szarate almost 2 years ago

  • Tags set to qe-core-february-sprint
  • Category set to Infrastructure
Actions
Copy link
 #8

Updated by szarate almost 2 years ago

  • Sprint set to QE-Core: February Sprint (Feb 08 - Mar 08)
Actions
Copy link
 #9

Updated by szarate almost 2 years ago

  • Tracker changed from action to coordination
  • Description updated (diff)
  • Status changed from New to Workable
  • Target version set to QE-Core: Ready
Actions
Copy link
 #10

Updated by szarate over 1 year ago

  • Tracker changed from coordination to action
  • Assignee deleted (szarate)

I think this is a single task the team can take

Actions
Copy link
 #11

Updated by szarate over 1 year ago

  • Priority changed from Normal to High
Actions
Copy link
 #12

Updated by dvenkatachala over 1 year ago

  • Assignee set to dvenkatachala
Actions
Copy link
 #13

Updated by dvenkatachala over 1 year ago

  • Status changed from Workable to In Progress
Actions
Copy link
 #15

Updated by dvenkatachala over 1 year ago

@lkocman,
For the acceptance criteria - 2, Are you referring to reusing GA'S test jobgroup - https://openqa.opensuse.org/admin/job_templates/50?. Could you please confirm.

Actions
Copy link
 #16

Updated by lkocman over 1 year ago

Hello!

I hope we've clarified the details over slack. Copy & pasting transcript so we have some update :-)

Hi Lubos, I have a doubt on the ticket https://progress.opensuse.org/issues/120243. For AC-2, Are you expecting to reusing GA's jobgroup, which is LEAP15.5. I am confused here. Could you please clarify it?
progress.opensuse.orgprogress.opensuse.org
action #120243: [qe-core] Leap 15.4 CR test suite (replaces Quarterly Updates) - openQA Tests - openSUSE Project Management Tool
Redmine

Lubos Kocman
11:47 AM
Hello (edited)
11:48
so this is expected to be four continuously rebuild DVD of Leap after GA. Aka our approach on Quarterly images (edited)
11:48
we're not publishing it regularly, although I think we should
11:48
we could re-use it for 15.5 post GA
11:48
or create a new one
11:48
depends on your preference

Deepthi Yadabettu Venkatachala
11:49 AM
Sure. Thank you. I understood now. I got confused with the comment https://progress.opensuse.org/issues/120243#note-4
progress.opensuse.orgprogress.opensuse.org
action #120243: [qe-core] Leap 15.4 CR test suite (replaces Quarterly Updates) - openQA Tests - openSUSE Project Management Tool
Redmine
11:50
Will work on it.

Lubos Kocman
11:50 AM
thank you Deepthi
11:50
I think we were able to publish 15.4 post GA
11:50
so it seems to be working
11:50
not sure what's there left to do for 15.4

Deepthi Yadabettu Venkatachala
11:51 AM
Okay! Thanks for the update.

Actions
Copy link
 #18

Updated by szarate over 1 year ago

  • Sprint changed from QE-Core: February Sprint (Feb 08 - Mar 08) to QE-Core: March Sprint (Mar 08 - Apr 05)
Actions
Copy link
 #20

Updated by dvenkatachala over 1 year ago

  • Status changed from In Progress to Feedback
Actions
Copy link
 #21

Updated by szarate over 1 year ago

  • Sprint changed from QE-Core: March Sprint (Mar 08 - Apr 05) to QE-Core: April Sprint 23 (Apr 05 - May 03)
Actions
Copy link
 #22

Updated by szarate over 1 year ago

  • Status changed from Feedback to Resolved

builds are being triggered.

Actions
Copy link
 #23

Updated by favogt over 1 year ago

  • Status changed from Resolved to Workable

The implementation for this is wrong - this needs to sync the images from openSUSE:Leap:15.4:Images:ToTest and the tests need to be part of the 15.4 Images group.

Currently it tests the wrong iso and the openQA jobs are not looked at by anything.

Actions
Copy link
 #24

Updated by dvenkatachala over 1 year ago

The implementation has been changed, and now the image from openSUSE:Leap:15.4:Images:ToTest is synchronized. Additionally, the job group 'openSUSE Leap 15.4 Images' has been modified.

PRs:
https://github.com/os-autoinst/openqa-trigger-from-obs/pull/218
https://github.com/os-autoinst/opensuse-jobgroups/pull/340

Actions
Copy link
 #25

Updated by dvenkatachala over 1 year ago

  • Status changed from Workable to Feedback
Actions
Copy link

Also available in: Atom PDF