QA » openQA Project

there are already the flavors as defined by the media types to distinguish as visible in https://openqa.suse.de/tests/overview?distri=sle&version=12-SP5&build=0248&groupid=245 . What would you need the sub groups for? Or what about a new feature about folding of flavors to fold away blocks by clicking on the table header?

I mean realize the feature with sub groups in same job group with the same flavor, with different flavors in a job group cause we need maintenance different flavors in media types and can't set load sequence with 'start_after' if in different flavor.
For SLE15SP2, there is no migration path from SLE-N-1 to SLE-N such as SLE12SP5 to SLE15SP1, so all test suites can be in the same flavor. With the feature of define sub groups in same job group just a UI change for openQA user, while these test suites should still be in the same job group.

So are you looking for an alternative to the flavors then? Sorry that I still don't fully get it.

No, I hope we can use this feature to set sub group without using several flavors in a job group.

isn't this what I tried to say: You want an alternative or a replacement for multiple flavors instead?

This is only for display, right? So basically an annotated sort order within a job group?

I think so

@leli I guess it would be more clear if you could follow https://progress.opensuse.org/projects/openqav3/wiki#Feature-requests in the ticket description. That would be helpful. Thanks.

coolo wrote:

This is only for display, right? So basically an annotated sort order within a job group?

Yes.

okurz wrote:

I think so

@leli I guess it would be more clear if you could follow https://progress.opensuse.org/projects/openqav3/wiki#Feature-requests in the ticket description. That would be helpful. Thanks.

Ok, I will follow the doc to update the ticket to make it more clear. Thanks.

I discussed with Leli.
I understand his meaning is that: Now in 'Test result overview', the test suites are distinguished by flavor. such as

Flavor:Installer-DVD
testsuite_1 result
testsuite_2 result

He wants the test suites are distinguished by 'sub group' (not existed in OpenQA for now).
Such as:
Migration-from-SLE11-SPx
testsuite_1 result
testsuite_2 result

Migration-from-SLE12-SP5-to-SLE15-SPx
testsuite_1 result
testsuite_2 result
....

In my opinion, maybe the 'sub group' is just a name, a section of one job group. Users could add or modify 'sub group' when they create or modify job group. And a test suite has an attribute that which 'sub group' belong to.

For now, migration team uses flavors as the solution. The result is https://openqa.suse.de/tests/overview?distri=sle&version=12-SP5&build=0251&groupid=245

Leli thinks that it will take much time to create and maintain Flavors. If we provide sub group, they don't need to create many flavors.

Thanks Xiaojing help to clarify, in general I agree her description. I'd like to say the pain points of multi flavor in a job group is that we need to create and maintain much flavors and hard for us to control openQA job sequence if two test suites are not in same flavor(such as continuous migration test).
Besides, I file this ticket just hope it can make it easy for reviewers to review different sections of migration job group and do not use multi flavors any more. I think if it is so much effort to realize this feature then we can continue to use multi flavors, feel free to evaluate it. Thanks.

lemon

The new YAML based approach for job templates should allow to specify test settings on scenarios directly. This does not cover any UI feature requests though.

This is the proposal after gathering info from this ticket and other sources: https://progress.opensuse.org/issues/72283

See for the reason of tracker change: http://mailman.suse.de/mailman/private/qa-sle/2020-October/002722.html