action #126950
closed
coordination #58184: [saga][epic][use case] full version control awareness within openQA
coordination #48641: [epic] Trigger openQA tests in pull requests of any product github pull request
[openQA-in-openQA] openQA tests in pull requests to github.com/os-autoinst/os-autoinst-distri-openQA/ size:M
Added by okurz over 1 year ago.
Updated over 1 year ago.
Category:
Feature requests
Description
Motivation¶
As http://open.qa/docs/#_running_openqa_jobs_as_ci_checks now explains how openQA jobs can be used as part of CI workflows we should use that within github.com/os-autoinst/os-autoinst-distri-openQA/ so that whenever we create changes to the distribution we benefit and also consume our own dogfood.
Acceptance criteria¶
- AC1: New pull requests in github.com/os-autoinst/os-autoinst-distri-openQA/ provide feedback to the pull request creator and reviewers from all openQA-in-openQA tests executed for the pull request before merge
Suggestions¶
- Subject changed from [openQA-in-openQA] openQA tests in pull requests to github.com/os-autoinst/os-autoinst-distri-openQA/ to [openQA-in-openQA] openQA tests in pull requests to github.com/os-autoinst/os-autoinst-distri-openQA/ size:M
- Description updated (diff)
- Status changed from New to Workable
- Status changed from Workable to In Progress
- Assignee set to jbaier_cz
I will take this as a learning experience.
- Due date set to 2023-05-02
Setting due date based on mean cycle time of SUSE QE Tools
- Status changed from In Progress to Feedback
After some tinkering I was able to find out the proper setting. I learn a fer key aspects:
- You do not need scenario definitions, unless you need to override group id (scenarios defined in the job group)
- Keys/values in scenario definitions (i.e. job templates) are slightly different than in job groups
version: "*" does not work as expecteddistri: openqa has to be in lowercase or it does not match (on the other hand, one can use DISTRI=openQA in the call and it will still work)
- Due date changed from 2023-05-02 to 2023-05-12
A sporadic failure occurred in one of the test runs (https://openqa.opensuse.org/tests/3238356#step/start_test/9). The CI behaves as expected but we should have a ticket about the issue before resolving this.
The mentioned learnings above would also be good to add to existing docs, or file tickets if these are considered bugs. At least to avoid users running into these.
- Due date changed from 2023-05-12 to 2023-05-05
All test issues solved, the request is ready to be merged.
- Blocked by action #128360: Supporting fork based development model size:M added
- Due date deleted (
2023-05-05)
- Status changed from Feedback to Blocked
As explained it the PR, the webhook approach might not work in this case.
- Status changed from Blocked to Workable
#128360 was resolved so one way or another this should now continue :)
- Status changed from Workable to Feedback
PR with action merged, the action should be triggered on pull_request_target which should in theory work well with fork-based development
- Status changed from Feedback to Resolved
- Copied to action #150992: [timeboxed][spike solution:20h] openQA tests in pull requests to github.com/os-autoinst/os-autoinst-distri-opensuse/ size:M added
Also available in: Atom
PDF