Project

General

Custom queries

Profile

Actions

action #102374

closed

QA (public) - coordination #91646: [saga][epic] SUSE Maintenance QA workflows with fully automated testing, approval and release

coordination #89062: [epic] Simplify review for SUSE QAM

Support use of force_result via ticket title in auto-review size:M

Added by okurz over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Feature requests
Target version:
Start date:
2021-11-14
Due date:
% Done:

0%

Estimated time:

Description

Motivation

We have the new "force_result" openQA feature (see #95479) and there is auto-review which allows to automatically comment on jobs. As an alternative to retriggering on sporadic issues we can use auto-review to change the result of jobs showing known acceptable failures. This allows to mark failures that should be ignored for an auto-approval process, e.g. as used by qa-maintenance/bot-ng, while ensuring that there is an according open ticket to properly fix the failures. Additionally this allows to search easily for jobs related to tickets.

Acceptance criteria

  • AC1: tickets with a special command in the subject line can change the job result of openQA jobs
  • AC2: The "retry" command of auto-review still works
  • AC3: jobs with changed results still have a reference to the according tickets

Suggestions

#1

Updated by okurz over 3 years ago

  • Tracker changed from coordination to action
#2

Updated by okurz over 3 years ago

  • Description updated (diff)
#3

Updated by livdywan over 3 years ago

  • Subject changed from Combine "force_result" with auto-review to Support use of "force_result" via ticket title in auto-review size:M
  • Description updated (diff)
  • Status changed from New to Workable
#4

Updated by tinita over 3 years ago

  • Status changed from Workable to In Progress
  • Assignee set to tinita
#5

Updated by openqa_review over 3 years ago

  • Due date set to 2021-12-09
#6

Updated by tinita over 3 years ago

  • Status changed from In Progress to Feedback
#7

Updated by tinita over 3 years ago

  • Status changed from Feedback to In Progress
#8

Updated by tinita over 3 years ago

  • Due date changed from 2021-12-09 to 2021-12-10
  • Status changed from In Progress to Feedback
#9

Updated by tinita over 3 years ago

  • Due date changed from 2021-12-10 to 2021-12-13
#11

Updated by tinita over 3 years ago

  • Subject changed from Support use of "force_result" via ticket title in auto-review size:M to Support use of "force_result" via ticket title in auto-review size:M auto_review:"systemctl start docker' failed at .*/openqa_webui.pm":force_result:softfailed
#12

Updated by tinita over 3 years ago

  • Due date changed from 2021-12-13 to 2021-12-15
#14

Updated by tinita over 3 years ago

  • Subject changed from Support use of "force_result" via ticket title in auto-review size:M auto_review:"systemctl start docker' failed at .*/openqa_webui.pm":force_result:softfailed to Support use of "force_result" via ticket title in auto-review size:M auto_review:"Test died: fail on purpose at .*/openqa_webui.pm":force_result:softfailed
#15

Updated by tinita over 3 years ago

  • Subject changed from Support use of "force_result" via ticket title in auto-review size:M auto_review:"Test died: fail on purpose at .*/openqa_webui.pm":force_result:softfailed to Support use of force_result via ticket title in auto-review size:M auto_review:"Test died: fail on purpose at .*/openqa_webui.pm":force_result:softfailed
#16

Updated by tinita over 3 years ago

  • Subject changed from Support use of force_result via ticket title in auto-review size:M auto_review:"Test died: fail on purpose at .*/openqa_webui.pm":force_result:softfailed to Support use of force_result via ticket title in auto-review size:M
  • Status changed from Feedback to Resolved
#17

Updated by okurz over 3 years ago

  • Due date deleted (2021-12-15)
Actions

Also available in: Atom PDF