Project

General

Profile

Actions
Copy link

action #115007

closed

QA - coordination #99303: [saga][epic] Future improvements for SUSE Maintenance QA workflows with fully automated testing, approval and release

[qem][qe-core] split "qam-minimal+base" into 2 parts, one is for installation, one is for later tests

Added by rfan1 over 2 years ago. Updated about 2 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
rfan1
Category:
Enhancement to existing tests
Target version:
QA - QE-Core: Ready
Start date:
2022-08-04
Due date:
% Done:

100%

Estimated time:
8.00 h
Difficulty:
Sprint:
QE-Core: September Sprint (Aug 31 - Sep 28)
Tags:
qe-core-august-sprint

Description

Description

https://openqa.suse.de/tests/9251512
This job used to need ~4 hours to complete all test modules.
In this case, if any individual module fails whatever caused by network/performance/test code changes etc.
we may need re-run the full installation process.

It may waist time if the test failures are found after the installation process.

Suggestion

Split the test into 2 parts

  1. installation process and publish a qcow2 image
  2. later tests can use the publish qcow2 image
Actions
Copy link
 #1

Updated by szarate over 2 years ago

  • Parent task set to #114929
Actions
Copy link
 #2

Updated by szarate over 2 years ago

  • Sprint set to QE-Core: August Sprint (Aug 03 - Aug 31)
  • Tags set to qe-core-august-sprint
  • Subject changed from [qem][qe-core] can we split "qam-minimal+base" into 2 parts, one is for installation, one is for later tests? to [qem][qe-core] split "qam-minimal+base" into 2 parts, one is for installation, one is for later tests
  • Status changed from New to Workable
  • Target version set to QE-Core: Ready
Actions
Copy link
 #3

Updated by rfan1 over 2 years ago

  • Assignee set to rfan1
Actions
Copy link
 #4

Updated by rfan1 over 2 years ago

  • Status changed from Workable to In Progress

Action item 1:

  • Complete the installation process
  • Publish the qcow2 image
Actions
Copy link
 #5

Updated by rfan1 over 2 years ago

  • % Done changed from 0 to 30
Actions
Copy link
 #6

Updated by rfan1 over 2 years ago

  • % Done changed from 30 to 50
  • Estimated time set to 8.00 h

New test suite:
qam-minimal+base-installation

Added SLES15SP4 tests to dev job group: https://openqa.suse.de/admin/job_templates/220

Actions
Copy link
 #9

Updated by szarate about 2 years ago

  • Status changed from In Progress to Feedback
Actions
Copy link
 #10

Updated by szarate about 2 years ago

Carrying over to next sprint

Actions
Copy link
 #11

Updated by szarate about 2 years ago

  • Sprint changed from QE-Core: August Sprint (Aug 03 - Aug 31) to QE-Core: September Sprint (Aug 31 - Sep 28)
Actions
Copy link
 #12

Updated by rfan1 about 2 years ago

  • Status changed from Feedback to In Progress

Try to complete the installation task via autoyast.

Actions
Copy link
 #13

Updated by rfan1 about 2 years ago

All tests are added to dev job group https://openqa.suse.de/admin/job_templates/220
let us see the result via autoyast installation.

Actions
Copy link
 #14

Updated by rfan1 about 2 years ago

  • % Done changed from 80 to 90

Can get better results now, the failed cases can be excluded or workaround via settings
https://openqa.suse.de/tests/overview?groupid=220&distri=sle&build=20220907-1

Actions
Copy link
 #15

Updated by rfan1 about 2 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 90 to 100
Actions
Copy link
 #16

Updated by szarate about 2 years ago

  • Def we save a lot of time by using Autoyast.
Actions
Copy link

Also available in: Atom PDF