action #119176
closedopenQA Project (public) - coordination #102915: [saga][epic] Automated classification of failures
coordination #119338: [epic] SLO Automation for openqatests SLOs
Automated alerts and reminders about SLO's for openqatests size:M
0%
Description
Motivation¶
Some tickets don't see regular updates, even with automated reminders in some cases. See https://progress.opensuse.org/projects/openqatests/wiki#SLOs-service-level-objectives for the documented workflows/goals. We assume processes are followed better if there is automation that reminds people about missed targets and makes it easier to understand what updates are missing.
Acceptance criteria¶
- AC1: DONE SLOs are reflected in automated reminders
- AC2: DONE The first reminder is implemented based on the documented workflow
- AC3: The second reminder is known to update the priority automatically
Suggestions¶
- DONE: Wait for #116545
- DONE: Same as in queries for QA tools we likely should only look at the update time of tickets with no subtasks, e.g. see the definition of https://progress.opensuse.org/issues?query_id=542, to prevent cases like https://progress.opensuse.org/issues/113749#note-13 ff which is Urgent but hasn't been updated for a long time.
- DONE: Only write the same comment once -> #116545
- Research what has been done in #113797
- Review and understand https://github.com/openSUSE/openqa-tests-backlog as well as https://github.com/openSUSE/backlogger and https://opensuse.github.io/openqa-tests-backlog/
- As the queries in https://github.com/openSUSE/openqa-tests-backlog/blob/main/queries.yaml#L5 are not named queries but defined in place we could just define a "grace period" for each query and only act automatically if not done already by users, e.g. don't remind on urgent tickets after 7 days but only 7+2 days
- Follow the SLO about the suggestion of the "second reminder"
Updated by okurz about 2 years ago
- Copied from action #116545: Automated alerts and reminders about SLO's for openqatests (only one reminder) size:M added
Updated by okurz about 2 years ago
- Due date set to 2022-11-25
- Status changed from Blocked to Feedback
- Priority changed from High to Low
After #116545 done I would like to gather feedback by waiting and seeing how the automation behaves before thinking to continue
Updated by okurz about 2 years ago
- Due date deleted (
2022-11-25) - Status changed from Feedback to New
- Target version changed from Ready to future
Discussed in the weekly QE Tools estimation call. We decided we can not estimate in the current state but need to rethink or rediscuss in another scope. I am putting the ticket into "future" but plan to bring it up in some chat channels for discussion.
Updated by okurz about 1 year ago
- Target version changed from future to Tools - Next
jstehlik brought this issue up right now and I want to help to move this further because I think we can help the departement to be more strict with SLOs
Updated by okurz about 1 year ago
- Target version changed from Tools - Next to Ready
Updated by livdywan about 1 year ago
- Subject changed from Automated alerts and reminders about SLO's for openqatests - further tasks to Automated alerts and reminders about SLO's for openqatests size:M
- Description updated (diff)
- Status changed from New to Workable
Updated by okurz about 1 year ago
- Target version changed from Ready to Tools - Next
Updated by okurz about 1 year ago
- Target version changed from Tools - Next to Ready
Updated by livdywan 9 months ago
- Copied to action #157522: No ticket reminder comments about SLO's for openqatests size:M added
Updated by livdywan 9 months ago
- Related to action #157858: Repeated reminder comments about SLO's for openqatests size:S added
Updated by ybonatakis 8 months ago
- Status changed from Workable to In Progress
- Assignee set to ybonatakis
Updated by ybonatakis 8 months ago
Note for me https://progress.opensuse.org/issues/159072
Updated by ybonatakis 8 months ago
Updated by ybonatakis 8 months ago
Most of the comments addressed but i have to take another look tomorrow. Particular i left out the feedback for the global variables and a comment about texting
Updated by okurz 7 months ago
- Status changed from Feedback to Workable
https://progress.opensuse.org/issues/134807#change-797133 show the automatic ticket updates but they don't include an explanation or reference to the wiki page like the first reminder though should do so
Updated by ybonatakis 7 months ago
okurz wrote in #note-23:
https://progress.opensuse.org/issues/134807#change-797133 show the automatic ticket updates but they don't include an explanation or reference to the wiki page like the first reminder though should do so
Updated by okurz 7 months ago
livdywan wrote in #note-26:
ybonatakis wrote in #note-24:
Merged. That should fulfill AC3?
If we have verification, yes.
@ybonatakis put it in "Feedback"?
Updated by ybonatakis 7 months ago
- Status changed from In Progress to Feedback
https://github.com/openSUSE/backlogger/pull/53 last fix on the comment
Updated by okurz 7 months ago
- Due date deleted (
2024-05-20) - Status changed from Feedback to Resolved
Tina fixed it with
https://github.com/openSUSE/backlogger/pull/54
I have seen multiple ticket updates in production now