action #57266
closedForbid test suite name changes if used in job groups
Description
When is test suite renamed or deleted, changes are not propagated to job group configuration in YAML.
It is behavior change when comparing to old style of job group definition.
Reproduction scenario:
- Rename or delete test suite
- Check job group definition in YAML, test suite is still present or has old name
Note: Sorry, if I made duplicate case(didn't find).
Updated by coolo about 5 years ago
I assume this is about test suites that are only used in one job group? We want to eliminate those anyway
Updated by pcervinka about 5 years ago
Could be related, but it is behavior change and unaware(used to old things) user can be surprised.
For example I was adding new test suite to YAML schedule and editor complained about other not existing test suite.
It was easy to fix(just removed it), but it means that users don't expect it (to manually go over all job group definitions and delete/rename test suite).
Updated by coolo about 5 years ago
The yaml config file is user input and we won't touch it. But what we can do is forbid deleting/renaming test suites if they are used.
Updated by coolo about 5 years ago
- Subject changed from [YAML][tools] Test suite changes are not propagated to YAML to Forbid test suite changes if used in job groups
- Category set to Feature requests
- Target version set to Ready
- Difficulty set to medium
Updated by livdywan about 5 years ago
coolo wrote:
The yaml config file is user input and we won't touch it. But what we can do is forbid deleting/renaming test suites if they are used.
We can point out the job group(s) the respective test suite is being used in. And as a side effect users will be more aware of where a test suite is being used rather than silently changing all affected job groups.
Updated by coolo about 5 years ago
- Subject changed from Forbid test suite changes if used in job groups to Forbid test suite name changes if used in job groups
We're talking about the name of the test suite only - I clarified the title
Updated by pcervinka about 5 years ago
coolo wrote:
The yaml config file is user input and we won't touch it. But what we can do is forbid deleting/renaming test suites if they are used.
If I understand well, it means manually remove test suite from all YAML job groups, rename and add back again with new name.
Quite difference in action when you compare to non-yaml solution(almost one click action).
Updated by coolo about 5 years ago
As I mentioned: the trend is to eliminate the need for frequent test suite changes
Updated by pvorel about 5 years ago
coolo wrote:
As I mentioned: the trend is to eliminate the need for frequent test suite changes
Despite the trend, sometimes changes are needed (sometimes even complex changes).
I should have checked the code & doc for this feature better before. If I had known this feature, I wouldn't have voluntarily changed it to yaml.
Is this incompatibility change documented somewhere?
Updated by livdywan about 5 years ago
pvorel wrote:
Is this incompatibility change documented somewhere?
This actually needs to be documented explicitly. The Job group editor section only mentions configuring a group in YAML, but it doesn't mention how this affects test suites. I would indeed suggest to cover this in this ticket as well.
Updated by livdywan about 5 years ago
- Status changed from New to In Progress
- Assignee set to livdywan
Updated by livdywan about 5 years ago
Additions to the docs here https://github.com/os-autoinst/openQA/pull/2372
Updated by livdywan about 5 years ago
- Status changed from In Progress to Feedback
Updated by livdywan about 5 years ago
- Status changed from Feedback to Resolved
- Target version changed from Ready to Current Sprint
Updated by mkittler about 5 years ago
- Target version changed from Current Sprint to Done