Project

General

Profile

coordination #29733

[epic][functional][u] Test suites that use "all patterns" boot from created qcow2 image

Added by SLindoMansilla over 3 years ago. Updated 9 months ago.

Status:
Rejected
Priority:
Normal
Assignee:
Category:
New test
Target version:
Start date:
2020-05-06
Due date:
% Done:

100%

Estimated time:
(Total: 84.00 h)
Difficulty:

Description

Motivation

There were three test suites in SLE12 that covered the installation with all patterns selected. For SLE15+ there is only one.

The execution time was long and the maintenance tedious. It would be easier if they would be split into create_hdd_*_allpatterns and extra_tests_*_allpatterns.
It would also be good to recover the lost coverage after the new SLE15 installation media.


Subtasks

action #66541: [functional][u] Add allmodules+allpatterns test suite to SLE15-SP2Resolvedzluo

action #66544: [functional][u] Split test suite "allpatterns"Rejectedszarate

action #66547: [functional][u] Split test suite "sdk+allpatterns"Rejectedszarate

action #66550: [functional][u] Split test suite "we+allpatterns"Rejectedszarate


Related issues

Related to openQA Tests - action #23628: [sle][functional][medium] Add SLE15 test corresponding to former "sdk+allpatterns" test suiteResolved2017-08-242018-02-13

Blocked by openQA Tests - action #29730: [sle][functional][u][medium] New test suite create_hdd_gnome+all_patternsRejected2017-12-22

Blocked by openQA Tests - action #75100: [functional][u] Remove post installation jobs from allpatterns scenariosResolved2020-10-22

History

#1 Updated by SLindoMansilla over 3 years ago

  • Status changed from Workable to Blocked

#2 Updated by SLindoMansilla over 3 years ago

  • Blocked by action #29730: [sle][functional][u][medium] New test suite create_hdd_gnome+all_patterns added

#3 Updated by SLindoMansilla over 3 years ago

  • Blocks action #23628: [sle][functional][medium] Add SLE15 test corresponding to former "sdk+allpatterns" test suite added

#4 Updated by okurz over 3 years ago

  • Due date set to 2018-01-30

#5 Updated by okurz over 3 years ago

  • Target version set to Milestone 13

#6 Updated by jorauch over 3 years ago

  • Subject changed from [sle][functional] Test suites that use "all patterns" boot from created qcow2 image to [sle][functional][medium] Test suites that use "all patterns" boot from created qcow2 image
  • Assignee set to jorauch

Apply these settings to the test suites:

START_AFTER_TEST=create_hdd_gnome+all_patterns
HDD_1=SLES-%VERSION%-%ARCH%-Build%BUILD%@%MACHINE%-gnome-all-patterns.qcow2
BOOT_HDD_IMAGE=1

#7 Updated by jorauch over 3 years ago

  • Status changed from Blocked to In Progress

not blocked anymore

#8 Updated by jorauch over 3 years ago

https://bugzilla.suse.com/show_bug.cgi?id=1071939
Might become a problem, will fix select_console first

#9 Updated by jorauch over 3 years ago

Allpatterns SL15:
pinky.arch.suse.de/tests/167
Allpatterns Sle12/4:
http://pinky.arch.suse.de/tests/171

#10 Updated by jorauch over 3 years ago

ADDONS=sdk
ADDONS=we
would need to be installed afterwards

#11 Updated by riafarov over 3 years ago

  • Due date changed from 2018-01-30 to 2018-02-13
  • Target version changed from Milestone 13 to Milestone 14

#12 Updated by okurz over 3 years ago

  • Category set to Enhancement to existing tests
  • Status changed from In Progress to Feedback

I would like to discuss this ticket with you in person when you are in office again. Please delay work on it until then.

#13 Updated by JERiveraMoya over 3 years ago

Please, consider increasing story complexity to [HARD], at least to reflect heavy testing with image creation or peer with someone else to get verification runs without increasing the complexity.

#14 Updated by okurz over 3 years ago

  • Blocks deleted (action #23628: [sle][functional][medium] Add SLE15 test corresponding to former "sdk+allpatterns" test suite)

#15 Updated by okurz over 3 years ago

  • Related to action #23628: [sle][functional][medium] Add SLE15 test corresponding to former "sdk+allpatterns" test suite added

#16 Updated by jorauch over 3 years ago

  • Due date deleted (2018-02-13)
  • Category changed from Enhancement to existing tests to New test
  • Status changed from Feedback to Workable
  • Assignee deleted (jorauch)
  • Target version changed from Milestone 14 to future

As discussed with okurz we do not have a current use case for these. Could make sense in the future whenever we need it, i.e. when we have any test that wants to test based on special patterns.

#17 Updated by jorauch over 3 years ago

  • Parent task deleted (#23454)

#18 Updated by okurz about 3 years ago

  • Subject changed from [sle][functional][medium] Test suites that use "all patterns" boot from created qcow2 image to [sle][functional][medium][u] Test suites that use "all patterns" boot from created qcow2 image

#19 Updated by okurz about 3 years ago

  • Target version changed from future to future

#20 Updated by okurz almost 3 years ago

  • Status changed from Workable to New

Bulk action to set status back to "New" for older tickets which are in "future". They would need to be revisited in time when we come up with a defined plan and assign to a milestone.

#21 Updated by okurz over 2 years ago

  • Priority changed from Normal to Low

#22 Updated by szarate over 1 year ago

  • Status changed from New to Workable
  • Priority changed from Low to High

We agreed to create_hdd_ENV+allpatterns => extratests_allpatterns_blah

#23 Updated by zluo about 1 year ago

  • Status changed from Workable to In Progress
  • Assignee set to zluo

take over

#24 Updated by SLindoMansilla about 1 year ago

  • Description updated (diff)

#25 Updated by zluo about 1 year ago

for current convention, they should be named:

  • extra_tests_allpatterns
  • extra_tests_allpatterns_sdk
  • extra_tests_allpatterns_we

And the one that generates the qcow2:

Then, we start migrating allpatterns into extra_tests_allpatterns and similar steps 1. 2. 3.

#26 Updated by zluo about 1 year ago

create_hdd_allpatterns created on osd.
https://openqa.suse.de/admin/job_templates/312 first draft

#27 Updated by szarate about 1 year ago

szarate wrote:

We agreed to create_hdd_ENV+allpatterns => extratests_allpatterns_blah

create_hdd_gnome+allpatterns => extra_tests_gnome_allpatterns

#28 Updated by SLindoMansilla about 1 year ago

  • Due date set to -4712-01-01
  • Start date set to 5000-01-01

due to changes in a related task: #29733

#29 Updated by SLindoMansilla about 1 year ago

  • Due date set to -4712-01-01

due to changes in a related task: #66541

#30 Updated by SLindoMansilla about 1 year ago

  • Subject changed from [sle][functional][medium][u] Test suites that use "all patterns" boot from created qcow2 image to [epic][functional][u] Test suites that use "all patterns" boot from created qcow2 image
  • Description updated (diff)
  • Status changed from In Progress to Workable
  • Assignee changed from zluo to SLindoMansilla

#31 Updated by SLindoMansilla about 1 year ago

  • Due date set to 5000-01-01
  • Start date changed from 5000-01-01 to 2020-05-06

due to changes in a related task: #66544

#32 Updated by SLindoMansilla about 1 year ago

  • Due date set to 5000-01-01

due to changes in a related task: #66547

#33 Updated by SLindoMansilla about 1 year ago

  • Due date set to 5000-01-01

due to changes in a related task: #66544

#34 Updated by SLindoMansilla about 1 year ago

  • Due date set to 5000-01-01

due to changes in a related task: #66547

#35 Updated by SLindoMansilla about 1 year ago

  • Due date set to 5000-01-01

due to changes in a related task: #66544

#36 Updated by SLindoMansilla about 1 year ago

  • Due date set to 5000-01-01

due to changes in a related task: #66544

#37 Updated by SLindoMansilla about 1 year ago

  • Due date set to 5000-01-01

due to changes in a related task: #66547

#38 Updated by szarate 10 months ago

  • Tracker changed from action to coordination
  • Status changed from Workable to New

#40 Updated by szarate 9 months ago

  • Blocked by action #75100: [functional][u] Remove post installation jobs from allpatterns scenarios added

#41 Updated by szarate 9 months ago

  • Assignee changed from SLindoMansilla to szarate

#42 Updated by szarate 9 months ago

  • Status changed from New to Rejected

Also available in: Atom PDF