Project

General

Profile

Actions
Copy link

coordination #99303

open

[saga][epic] Future improvements for SUSE Maintenance QA workflows with fully automated testing, approval and release

Added by okurz about 3 years ago. Updated 24 days ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
future
Start date:
2016-02-09
Due date:
% Done:

46%

Estimated time:
(Total: 8.00 h)

Description

Motivation

Scale up the business while ensuring highest quality with automated testing, approval and release of package updates for SLE and openSUSE

Subtasks 75 (43 open — 32 closed)

openQA Tests (public) - action #95161: [qe-core][epic] Implement automated checks to help code reviewers know when the test case summary should be updatedNewszarate2021-08-09

Actions
openQA Project (public) - action #113614: [timeboxed:20h] [spike] Add openQA API for computing diff of executed test modulesNew2022-07-14

Actions
openQA Project (public) - action #94838: Make qem-dashboard a proper public open source project size:MResolvedkraih2021-06-29

Actions
action #97118: enhance bot automatic approval: check multiple daysResolvedmgrifalconi2021-08-18

Actions
action #97274: qam dashboard improvement ideasNew2021-06-29

Actions
openQA Project (public) - action #102206: Make bot-ng a proper public open source project size:MResolvedokurz2021-06-29

Actions
action #98820: Various requirements for qem-dashboard (was: Design document for openQA CI dashboard)New2021-09-16

Actions
openQA Infrastructure (public) - action #102269: openQABot pipeline failed with HTTP 403Resolvedosukup2021-11-11

Actions
openQA Infrastructure (public) - action #102284: openQABot pipeline failed with simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0) Resolvedosukup2021-11-11

Actions
action #104209: [qem] dashboard.qam.suse.de checkpoints for aggregatesRejectedokurz2021-12-21

Actions
action #110200: qem-dashboard - add link to gitlab CI pipelines on incident dashboard pagesNew

Actions
action #122308: Handle invalid openQA job references in qem-dashboard size:MResolvedjbaier_cz2022-12-21

Actions
action #122311: Use live openQA test results instead of inconsistent qem-dashboard database in qem-bot approverFeedbackmgrifalconi2022-12-21

Actions
coordination #97121: [epic] enable qem-bot comments on IBS (was: enable qa-maintenance/openQABot comments on smelt again)New2021-09-14

Actions
action #98637: [timeboxed:20h] try to enable comments on IBS (and smelt) again from SUSE QA maintenance openQA test results size:MResolvedjbaier_cz2021-09-14

Actions
action #109701: enable qem-bot comments on IBS again after subscriptions can be personally configuredResolvedjbaier_cz

Actions
action #114415: [timeboxed:10h][spike solution] qem-bot comments on IBS size:SResolvedtinita2022-07-20

Actions
action #121228: qem-bot comments on IBSNew

Actions
action #153107: Proper code coverage for at least commenter.py in qem-bot size:MWorkable

Actions
action #154498: [spike][timeboxed:20h][integration] Approve/reject SLE maintenance release requests on IBS synchronously listening to AMQP events when testing for one release request as "openQA product build" is finished size:MResolvedjbaier_cz

Actions
action #154762: Refactor qem-bot to use https://github.com/openSUSE/openSUSE-release-tools/blob/master/osclib/comments.py directly instead of bad copy-pasteNew2024-02-01

Actions
action #157741: Approve/reject SLE maintenance release requests on IBS synchronously listening to AMQP events when testing for one release request as "openQA product build" is finished size:MFeedbackokurz2024-03-22

Actions
openQA Project (public) - coordination #99306: [epic] Future improvements: Make reviewing openQA results per squad easierNew2016-02-09

Actions
openQA Project (public) - action #17252: notifications to maintainer on failed modulesNew2016-02-09

Actions
openQA Project (public) - action #92533: Module-centric test result overviewNew2021-05-11

Actions
openQA Tests (public) - action #92921: [tools][spike] Can we change or display job group structure for maintenance job groups to have one job group per team like for product validation and maybe specific products and versions below size:MResolvedmgrifalconi2021-05-21

Actions
openQA Project (public) - action #92960: Add option to openqa-review to section by flavorWorkable2021-05-21

Actions
openQA Project (public) - action #95278: [easy][beginner] Making option to filter by job group(s) on /tests/overview more prominentNew

Actions
openQA Project (public) - action #95878: Add filter on /tests/overview for search term in test suite descriptionNew2021-07-22

Actions
openQA Project (public) - action #101457: Native per-module bug tagsNew2021-10-25

Actions
openQA Project (public) - action #110632: Capture stderr of job_done_hooks as wellNew2022-05-04

Actions
openQA Infrastructure (public) - action #110920: Emails from o3 are rejected by mx2.suse.de for certain sender/recipients size:SResolvedtinita

Actions
openQA Project (public) - action #111135: Enhance email notification message content for about failed and unreviewed jobs New2022-05-16

Actions
openQA Project (public) - action #111215: Various improvements for email notification about unreviewed jobs size:MResolvedtinita

Actions
openQA Project (public) - action #131279: [timeboxed:6h][spike solution] a single command line or openQA webUI search view to show all tests blocking an incident by squad size:SResolvedybonatakis

Actions
openQA Project (public) - action #156547: A single API route to show all not-ok tests blocking a SLE maintenance incident size:MWorkable

Actions
openQA Project (public) - action #156553: [timeboxed:10h][spike solution] openQA webUI search view to show all tests blocking an incident by squad - take 2Blockedokurz

Actions
openQA Project (public) - action #157660: A single webUI search view to show all not-ok tests blocking a SLE maintenance incident size:MNew2024-03-21

Actions
openQA Project (public) - action #162479: Carryover force_result softfailed not applied logicallyNew

Actions
openQA Tests (public) - action #115007: [qem][qe-core] split "qam-minimal+base" into 2 parts, one is for installation, one is for later testsResolvedrfan12022-08-04

Actions
openQA Tests (public) - action #116842: [qem][qe-core] mau-webserver test uses published qcow2 image Resolvedpdostal2022-08-04

Actions
coordination #109644: [epic] Future improvements for qem-botNew2022-03-24

Actions
action #109491: Flow diagram for Maintenance jobs scheduling New2022-03-24

Actions
openQA Project (public) - action #109974: qem-bot/dashboard - mixed old and new incidents - potential future ideasNew

Actions
action #156175: Support development of https://github.com/openSUSE/qem-bot/pull/154 size:MResolvedmkittler2024-02-27

Actions
action #160092: Consider using https://docs.gitlab.com/ee/ci/jobs/job_artifacts.html to have static links to always most recent job runsNew2024-05-08

Actions
openQA Project (public) - coordination #109647: [epic] Future improvements: Simpler investigation of openQA test failuresNew2021-04-26

Actions
openQA Project (public) - action #91770: Optional job investigation information in "investigation" tab rather than commentsNew2021-04-26

Actions
openQA Project (public) - action #109650: [tools][spike] Can we change or display job group structure for maintenance job groups to have one job group per team like for product validation and maybe specific products and versions below size:MResolvedmgrifalconi2021-05-21

Actions
openQA Project (public) - action #109653: Add filter on /tests/overview for search term in test suite descriptionRejected2021-07-22

Actions
coordination #110016: [epic][teregen] teregen (maintenance test report template generator) improvementsNew2021-01-14

Actions
action #87755: [teregen] Replace productdefs by API call size:MResolvedjbaier_cz2021-01-14

Actions
action #90914: [teregen] Add overview for stored coverage dataNew2021-04-09

Actions
action #90917: [teregen] Add notification about errors in template generatingNew2021-04-09

Actions
action #93799: teregen: Improvement of usability of disabled testcases notification size:MResolvedjbaier_cz2021-06-10

Actions
action #112268: [teregen] Integrate productdefs generator inside template generatorNew

Actions
openQA Project (public) - action #110794: Applying carry-over retroactivelyNew

Actions
coordination #110836: [epic] future qem-bot improvementsRejectedokurz

Actions
openQA Project (public) - coordination #111072: [epic] Extend filtering on /tests and /tests/overviewNew2022-05-13

Actions
action #124473: [tools] Automatic regression tests export from openQANew2023-02-14

Actions
coordination #153928: [epic] Ideas from SUSE QE Tools workshop 2024-01-19 Filter openQA todo-jobs on /tests belonging to groups, review teams, etcNew2022-11-08

Actions
openQA Project (public) - action #120118: Provide job settings filter optionsNew2022-11-08

Actions
openQA Project (public) - action #154261: [spike][timeboxed:20h] batch commenting on all openQA jobs, e.g. involving a specified SLE maintenance incident in webUI size:MResolvedmkittler

Actions
coordination #154756: [epic] Decommission qa-maintenance/openQABotResolvedokurz2024-02-01

Actions
action #154759: Decommission qa-maintenance/openQABot size:SResolvedokurz2024-02-01

Actions
coordination #155671: [epic] Better handling of SLE maintenance test reviewBlockedokurz2024-02-19

Actions
action #155629: [spike][timeboxed:6h][qem-dashboard] Order blocked incidents by priority to allow reviewers to focus on higher prio incidents first size:SResolvedmkittler2024-02-19

Actions
action #157135: http://dashboard.qam.suse.de/blocked should update job status by AMQP events, but seemingly doesn't or only after some minutes size:MResolvedjbaier_cz2024-03-13

Actions
action #157204: Sync openQA job removal events to qem-dashboard listening to AMQP events size:MResolvedjbaier_cz2024-03-14

Actions
action #157237: dependabot PRs for the dashboard are not getting approved and merged automatically size:SResolvedtinita2024-03-11

Actions
action #161267: Represent the effect of "@review:acceptable_for" labels on qem-dashboard pages size:MWorkable2024-05-30

Actions
action #163991: [qem-bot] similar to "acceptable_for" handle a "reject" openQA comment to actually reject a RRNewokurz2024-07-15

Actions
action #164733: qem-dashboard (and hence qem-bot) see a job as failed even though it's marked as softfailed since > 30 days in openQA size:MResolvedjbaier_cz2024-07-31

Actions
action #167836: qem-bot "acceptable_for" comment had no effect 2024-09-27 size:SResolvedrobert.richardson2024-10-07

Actions
openQA Project (public) - coordination #156631: [epic] Generic, retroactive tagsNew

Actions

Related issues 5 (2 open — 3 closed)

Related to QA (public) - coordination #123088: [saga][epic] Re-combined Maintenance QA tooling covering both SLE+openSUSENew2024-09-19

Actions
Copied from QA (public) - coordination #91646: [saga][epic] SUSE Maintenance QA workflows with fully automated testing, approval and releaseResolvedokurz2021-04-21

Actions
Copied to QA (public) - coordination #111347: [saga][epic] Properly maintained Maintenance QA toolingResolvedokurz2021-08-04

Actions
Copied to QA (public) - coordination #163589: [saga][epic] Enforce work silos and make QE engineers irreplaceable with more sophisticated manual test result review featuresRejected2024-07-10

Actions
Copied to openQA Project (public) - coordination #173872: [saga][epic] Full traceability "paper trail" and test reproducability of openQA testsNew2024-12-06

Actions
Actions
Copy link
 #1

Updated by okurz about 3 years ago

  • Copied from coordination #91646: [saga][epic] SUSE Maintenance QA workflows with fully automated testing, approval and release added
Actions
Copy link
 #2

Updated by okurz over 2 years ago

Actions
Copy link
 #3

Updated by okurz 11 months ago

  • Subtask #153928 added
Actions
Copy link
 #4

Updated by okurz 11 months ago

  • Related to coordination #123088: [saga][epic] Re-combined Maintenance QA tooling covering both SLE+openSUSE added
Actions
Copy link
 #5

Updated by okurz 11 months ago

  • Subtask #154756 added
Actions
Copy link
 #6

Updated by okurz 10 months ago

  • Subtask #155671 added
Actions
Copy link
 #7

Updated by okurz 10 months ago

  • Subtask #156631 added
Actions
Copy link
 #8

Updated by okurz 5 months ago

  • Copied to coordination #163589: [saga][epic] Enforce work silos and make QE engineers irreplaceable with more sophisticated manual test result review features added
Actions
Copy link
 #9

Updated by okurz 15 days ago

  • Copied to coordination #173872: [saga][epic] Full traceability "paper trail" and test reproducability of openQA tests added
Actions
Copy link

Also available in: Atom PDF