Project

General

Profile

Roadmap

SUSE QA - Milestone 31

about 19 months late (2020-02-21)

81%

68 issues   (49 closed — 19 open)

Related issues
action #47441: [functional][u] test code feedback - integrate bots to test distribution on github

openQA Project - Ready

Next tasks to be picked up by the QE tools team

91%

901 issues   (805 closed — 96 open)

Related issues
action #52655: [epic] Move openqa-review from cron-jobs on lord.arch to a more sustainable long-term solution
action #69322: Automatic check for SUSE QA tools WIP-Limit based on tickets
action #73468: SUSE QA tools team ticket process helpers: Set due date on tickets in redmine based on SLOs
action #77944: Run "auto-review" more often but alarm less
action #78187: Import and enable Testreport data into SMELT
action #80414: [proof-of-concept] Extend "auto-review" for failed jobs as well, start with o3
action #80418: [learning] Fix parse errors in "openqa-investigate" "parse error: Invalid numeric literal at line 1, column 10"
action #80690: [qem] Testing of packages in different codestreams but in one incident
action #80806: Extend "auto-review" for failed jobs as well - Generalize openqa-monitor-investigation-candidates to look at more than just one job group
action #80808: Extend "auto-review" for failed jobs as well - enable same as on o3 but on osd
action #81106: test out chat service notifications, e.g. matrix, from github actions size:M
action #88127: [tools][qem] Test coverage DB for maintenance updates
action #88183: [spike][timeboxed:20h] rancher: Create a simple selenium test for the UI as proof of concept
action #88485: [teregen] Fetch and store coverage info for each incident
action #89080: Flatpak OBS builds fail on tumbleweed
action #89491: Add flatpak build test to obs-build CI
action #90047: Improve dependency detection in cpanspec
action #90401: [teregen] Integrate coverage information in a presentable way into test template
action #90404: [teregen] Update TeReGen for deployment on qam2
action #90428: proposal: Plan to demo features in weekly meetings depending on due-date
action #90441: Only set due date on tickets in progress
action #90443: Reset due date on tickets when it doesn't apply / only apply due-date when assignee actually works on tickets
action #90764: auto-merge github feature can be enabled for os-autoinst-distri-opensuse
action #91356: Save openqa-review reports as gitlab CI artifacts
action #91665: Add projects that we maintain to "SUSE Projects" list
action #91674: SUSE QE Tools process proposal: Go further on regression fixing
action #92007: proposal: Move SUSE QE Tools workshop to 0700 UTC after multiple conflicts
action #92125: Move "MR" on submission tests into a separate job group
action #92149: crosscheck status/goal/maintainership of a machine "qam2"
action #92221: support for SLE-Module-NVIDIA-Compute_15
action #92287: Document access to raw openqa database
action #92341: fix potential leak of tempfiles of openqa-label-known-issues
action #92755: Investigate problems with post-commit hook for testreports
action #92851: Workshop series proposal "How SUSE QE teams review openQA test results"
action #93522: [tools][qem] auto-approval of kgrafts and live-patches
action #93710: Reference individual openqa-review reports in gitlab CI artifacts, e.g. using gitlab pages
action #93916: idea from SUSE QE Tools retro 2021-06-11: Ask stakeholders for their list of priorities regarding our tasks
action #93931: [tools][qem] MTUI support multiple versions of package in incident
action #93934: [tools][qem] template generator - multiple package version in incident
action #93943: openqa-review pipeline fails accessing OSD test overview pages sometimes, more retries?
action #93988: build openqa-review container within OBS with ca-certificates-suse package
action #94246: Collect data on update/packages and maintenance workload for 2020/2021
action #94486: Complete and deploy testreport db and page on smelt
action #94661: [teregen] template generator - make sure to skip SUSE:Updates:openSUSE-* release targets for test report generation
action #95000: Remove SUSE-internal links to line teams in our team roster which should not be needed size:XS
action #95033: openqa-review fails upon trying to access openqa with no-urlencoded addresses
action #95221: Provide more people with administrative access to services on qam2.suse.de, at least qa-maintenance/openQABot, i.e. increase bus factor size:M
action #95254: [teregen] Out of memory exception during template generation
action #95335: openqa-review: Only send the openqa_suse_de_status to openqa-suse-status@suse.de, ignore all others size:S
action #95503: qam.suse.de api returns 500(Internal Server Error) for requests with valid logs
action #95742: In openqa-investigate jobs add URL to original job as setting
action #95746: Identify likely "sporadic" openQA tests with "openqa-investigate" size:M
action #95765: Provide more people with administrative access to services on qam2.suse.de, adding ssh keys for existing tools team members
action #95854: Grafana doesn't show information during some minutes, but also we got alerts on the CPU after the recovery
action #95989: openqa-review gitlab CI pipeline jobs fail with "AttributeError: 'NoneType' object has no attribute 'group'"
action #96016: [oscqam] Traceback on running ibs qam assigned -G qam-manager
action #96362: Improve openqa-review generation: Passthrough all vars and use git managed file for config
action #96560: openqa-review gitlab CI pipeline failed to access remote repo
action #96752: 'openSUSE-SLE' product schedule jobs to OSD
action #96792: openqa-review index page doesn't fail when a report is missing
action #96827: gitlab CI pipeline failed with Job failed: pod status is Failed size:S
action #96899: jenkins.qa.suse.de is unavailable, error from /var/log/jenkins/jenkins.log "java.io.IOException: NSS initialization failed" size:M
action #96968: qem-dashboard jobs api extension
action #96998: Increase bus factor for bot-ng size:M
action #97091: teach SUSE QE Tools team about "Extreme Programming" and Kanban size:M
action #97403: openqa-review: Polish job group section titles in todo-only mode size:S
action #97481: qam dashboard including development job group
action #97661: find a better time for "estimation" meeting which is APAC friendly size:S
action #97733: Bot fails on Failed to query latest publiccloud tools image using {settings['PUBLICCLOUD_TOOLS_IMAGE_QUERY']} and no aggregates are scheduled
action #97847: Feature request: Ability for bot-ng to schedule test runs on custom openQA instance
action #98198: [bot-ng] Fix auto-approve on updates without Incidents size:M
action #98262: MTUI fails to export version of the package prior installation of the update
action #98394: Fix MicroOS scheduling to have incidents
action #98457: Handle openqa-review reminder comments on very old jobs better
action #98475: links in https://progress.opensuse.org/projects/qa/wiki#Definition-of-DONE are dead size:S
action #98637: [timeboxed:20h] try to enable comments on IBS (and smelt) again from SUSE QA maintenance openQA test results size:M
action #98667: Unhandled [Alerting] Queue: State (SUSE) alert for > 4h size:M
action #98673: [retro] Unhandled alert about job queue for nearly a day, users brought it up in chat, should have been picked up sooner size:S
action #98916: Improve alert handling - weekly alert duty
action #98919: Improve alert handling - slack notifications
action #98997: [tools] [smelt] [python3.6] Replace all older text formatting with f-strings

future

a "virtual" milestone that is never reached. Everything that is currently out of scope can go here. Place for new feature ideas, wishes, proposed improvements and changes which we could work on in the future but are not currently planned for.

46%

1225 issues   (533 closed — 692 open)

Related issues
action #27621: [sle][functional][u] Test "motif" libraries are usable within SLE because customers use this "legacy" framework
action #29993: [tools][hard] Better handling of custom tags/labels/fields (was: Find a way to support logical combinations of search keywords in progress.o.o queries to e.g. list all "functional SLE15 fate issues")
action #34657: [functional][u][timeboxed:4h] Setup retrospective server based on https://github.com/funretro/distributed
action #43580: The RT product can be tested by release managers or developers before full SLE validation
action #44393: [sle][desktop][sles4sap][hpc] staging project for a second SLE product besides SLES, e.g. SLE RT in SLE15
action #44774: [functional][u] create a new test module valgrind for openQA
action #49502: Automatic validation test on github PRs
action #87755: [teregen] Replace productdefs by API call
action #88536: Find out differences in openQA test coverage with metabase
action #90914: [teregen] Add overview for stored coverage data
action #90917: [teregen] Add notification about errors in template generating
action #92119: Improve license detection in cpanspec
action #92122: Improve dependency detection via MYMETA.json in cpanspec
action #93799: teregen: Improvement of usability of disabled testcases notification
action #93838: Use new OBS SCM integration to trigger OBS checks on pull/merge requests for our projects
action #93937: [tools][qem] qamapi - incidents can have multiple versions packages
action #94024: MTUI unable to recover from failure to connect to the refhost
action #94027: MTUI - traceback when connecting unavailable refhost
action #94048: MTUI - reload_products doesn't work
action #94588: [qem] dashboard.qam.suse.de to be included in approval qam-openqa
action #94600: [tools][mtui] Communicate reduced visibility of openQA incident related coverage in log
action #95287: [tools][retrospective] CircleCI seems very slow recently
action #95822: qa-maintenance/openQABot failed to trigger aggregate tests with "urllib.error.HTTPError: HTTP Error 500: Internal Server Error"
action #96314: [mtui] Update MTUI to use new format for Testplatform
action #96350: Improve openqa-review generation: Add date to index
action #96353: Improve openqa-review generation: If individual reports can not be generated, mention that as well with an explicit message
action #96356: Improve openqa-review generation: Try to preserve old reports if individual new ones can not be generated
action #96359: Improve openqa-review generation: Learn Gitlab CI pipelines
action #96539: Conclude migration of qam.suse.de
action #97118: enhance bot automatic approval: check multiple days
action #97274: qam dashboard improvement ideas
action #97367: Update CI image QA:Maintenance/openSUSE-Leap-Container to Leap 15.3
action #97505: [qem][tools] embed important IBS comments in the testreports
action #97535: cpanspec: Fix package (dependency and missing script)
action #97955: [openqabot] Possible TypeError during execution
action #97994: bot-ng - sometimes doesn't update smelt data in dashboard
action #98820: Various requirements for qem-dashboard (was: Design document for openQA CI dashboard)