Project

General

Profile

Actions

action #20830

closed

[tools][sles][functional]Get rid of version specific prefix in test suite names when the test suites also apply for other versions

Added by okurz over 7 years ago. Updated almost 7 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Enhancement to existing tests
Start date:
2017-06-11
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Difficulty:

Description

Currently we have test suites like "sles12_qa_acceptance_fs_stress". IMHO the prefix "sles12_qa_acceptance" does not provide any useful meaning. Obviously we are doing "QA" here, the test suite also applies for sle15 so "sles12" is misleading. And "acceptance" is not really helpful because all tests could provide a result which influences "acceptance" but could also show other problems. I suggest we just get rid of this prefix in test suites. Any objections?


Subtasks 1 (0 open1 closed)

action #19726: [sle]Make test suite names more generic and shorter, e.g. delete "sles12_qa_acceptance" prefixResolvedokurz2017-06-11

Actions

Related issues 4 (0 open4 closed)

Related to openQA Tests - coordination #20944: [sle][functional][epic] Get rid of architecture specific test suitesResolvedokurz2017-07-312017-11-08

Actions
Related to openQA Tests - action #23736: [sle][functional] Adjust autoinst profiles for sle 15Resolvedriafarov2017-08-28

Actions
Related to openQA Tests - coordination #17714: [sles][functional][medium][epic] various testsuite enhancements (names, descriptions, etc.)Resolvedokurz2018-03-132018-03-27

Actions
Copied from openQA Tests - action #18936: [tools][sles][functional] Enable 3 stress acceptance on s390xResolvedriafarov2017-05-042017-11-08

Actions
Actions #1

Updated by okurz over 7 years ago

  • Copied from action #18936: [tools][sles][functional] Enable 3 stress acceptance on s390x added
Actions #2

Updated by okurz over 7 years ago

Asked sero in #testing if he would mind

Actions #3

Updated by yosun over 7 years ago

Sorry, the hard disk of my laptop was broken. I just notice this ticket. I'm fine with the name change, it's reasonable to change the name in openQA platform, because they actually some stress test. I remember, as a user, Marita also said them as stress test, then I think they should be.
But we will still keep the old name under my team's test package, since we have different types of test against kernel. It's better to remind us that they are for acceptance test.

If you like I can change the name for you, or you can remove the prefix directly.

Actions #4

Updated by riafarov over 7 years ago

  • Related to coordination #20944: [sle][functional][epic] Get rid of architecture specific test suites added
Actions #5

Updated by okurz about 7 years ago

  • Status changed from Feedback to In Progress
  • Assignee changed from okurz to riafarov

Ok, so I renamed the three testsuites which are just called process_stress, fs_stress, sched_stress now.

I added the sle15 hdd image creation job accordingly to START_AFTER_TEST which should prevent some incompletes on current SLE15 builds.

I deleted the …_s390x variants as we have proper image creation jobs now relying only on the SDK repo and not ISO, therefore the downstream jobs do not need to be duplicated anymore, see #20944 for details.

@riafarov for continuing with "sles12_autoyast…" testsuites which are also triggered for SLE15.

Actions #6

Updated by riafarov about 7 years ago

  • Status changed from In Progress to Feedback

On hold as we will probably end up with different profiles for sle 15.

Actions #7

Updated by riafarov about 7 years ago

  • Related to action #23736: [sle][functional] Adjust autoinst profiles for sle 15 added
Actions #8

Updated by riafarov about 7 years ago

  • Status changed from Feedback to In Progress
  • Assignee deleted (riafarov)

I take care of autoyast profiles in #23736

Actions #9

Updated by sebchlad about 7 years ago

How is this in progress while there is no Assignee? :)

Actions #10

Updated by okurz about 7 years ago

Our ticket workflow is described on https://progress.opensuse.org/projects/openqav3/wiki/Wiki#ticket-workflow . "In Progress: Any state between New and Resolved. The ticket has been refined and is ready to be picked." In this case riafarov worked on the ticket, did one step and leaves the ticket for someone else to continue the work. But honestly I am also not so sure why @riafarov unassigned.

@riafarov: hint: Better mention tickets with # and not complete URLs so that redmine can provide a preview.

Actions #11

Updated by okurz about 7 years ago

  • Related to coordination #17714: [sles][functional][medium][epic] various testsuite enhancements (names, descriptions, etc.) added
Actions #12

Updated by riafarov about 7 years ago

The only remaining test suites with versions in the name are autoyast. Our proposal is to move it to separate job group. The only undecided part is if it should be separate one, or we keep same one we have in Development.

Actions #13

Updated by okurz about 7 years ago

discussed in M10 review, will move to M11, still applies for SLE15 setup tasks

Actions #14

Updated by okurz about 7 years ago

  • Target version changed from Milestone 10 to Milestone 11

-> see subtickets

Actions #15

Updated by okurz about 7 years ago

  • Status changed from In Progress to Feedback
  • Assignee set to okurz

blocked by #23736

Actions #16

Updated by okurz about 7 years ago

  • Target version changed from Milestone 11 to Milestone 12

We made some progress and have a good idea how to adjust the profiles for autoyast but as of now are not done yet, maybe in the next days, see #23736. But we have a confidence we should be able to close this within the next milestone so shifting.

Actions #17

Updated by okurz almost 7 years ago

  • Status changed from Feedback to Resolved

All seems good now for SLE15 as well as SLE 12 SP4

Actions

Also available in: Atom PDF