Project

General

Profile

Roadmap

openQA Project - Ready

Next tasks to be picked up by the QE tools team

95%

1768 issues   (1670 closed — 98 open)

Related issues
action #52655: [epic] Move openqa-review from cron-jobs on lord.arch to a more sustainable long-term solution
action #69322: Automatic check for SUSE QA tools WIP-Limit based on tickets
action #73468: SUSE QA tools team ticket process helpers: Set due date on tickets in redmine based on SLOs
action #77944: Run "auto-review" more often but alarm less
action #78187: Import and enable Testreport data into SMELT
action #80414: [proof-of-concept] Extend "auto-review" for failed jobs as well, start with o3
action #80418: [learning] Fix parse errors in "openqa-investigate" "parse error: Invalid numeric literal at line 1, column 10"
action #80690: [qem] Testing of packages in different codestreams but in one incident
action #80806: Extend "auto-review" for failed jobs as well - Generalize openqa-monitor-investigation-candidates to look at more than just one job group
action #80808: Extend "auto-review" for failed jobs as well - enable same as on o3 but on osd
action #87755: [teregen] Replace productdefs by API call size:M
action #88127: [tools][qem] Test coverage DB for maintenance updates
action #88183: [spike][timeboxed:20h] rancher: Create a simple selenium test for the UI as proof of concept
action #88485: [teregen] Fetch and store coverage info for each incident
action #89080: Flatpak OBS builds fail on tumbleweed
action #89491: Add flatpak build test to obs-build CI
action #90047: Improve dependency detection in cpanspec
action #90401: [teregen] Integrate coverage information in a presentable way into test template
action #90404: [teregen] Update TeReGen for deployment on qam2
action #90428: proposal: Plan to demo features in weekly meetings depending on due-date
action #90441: Only set due date on tickets in progress
action #90443: Reset due date on tickets when it doesn't apply / only apply due-date when assignee actually works on tickets
action #90764: auto-merge github feature can be enabled for os-autoinst-distri-opensuse
action #91356: Save openqa-review reports as gitlab CI artifacts
action #91665: Add projects that we maintain to "SUSE Projects" list
action #91674: SUSE QE Tools process proposal: Go further on regression fixing
action #92007: proposal: Move SUSE QE Tools workshop to 0700 UTC after multiple conflicts
action #92122: Improve dependency detection via MYMETA.json in cpanspec
action #92125: Move "MR" on submission tests into a separate job group
action #92149: crosscheck status/goal/maintainership of a machine "qam2"
action #92221: support for SLE-Module-NVIDIA-Compute_15
action #92287: Document access to raw openqa database
action #92341: fix potential leak of tempfiles of openqa-label-known-issues
action #92755: Investigate problems with post-commit hook for testreports
action #92851: Workshop series proposal "How SUSE QE teams review openQA test results"
action #93522: [tools][qem] auto-approval of kgrafts and live-patches
action #93710: Reference individual openqa-review reports in gitlab CI artifacts, e.g. using gitlab pages
action #93799: teregen: Improvement of usability of disabled testcases notification size:M
action #93916: idea from SUSE QE Tools retro 2021-06-11: Ask stakeholders for their list of priorities regarding our tasks
action #93931: [tools][qem] MTUI support multiple versions of package in incident
action #93934: [tools][qem] template generator - multiple package version in incident
action #93943: openqa-review pipeline fails accessing OSD test overview pages sometimes, more retries?
action #93988: build openqa-review container within OBS with ca-certificates-suse package
action #94246: Collect data on update/packages and maintenance workload for 2020/2021
action #94486: Complete and deploy testreport db and page on smelt
action #94661: [teregen] template generator - make sure to skip SUSE:Updates:openSUSE-* release targets for test report generation
action #95000: Remove SUSE-internal links to line teams in our team roster which should not be needed size:XS
action #95033: openqa-review fails upon trying to access openqa with no-urlencoded addresses
action #95221: Provide more people with administrative access to services on qam2.suse.de, at least qa-maintenance/openQABot, i.e. increase bus factor size:M
action #95254: [teregen] Out of memory exception during template generation
action #95335: openqa-review: Only send the openqa_suse_de_status to openqa-suse-status@suse.de, ignore all others size:S
action #95503: qam.suse.de api returns 500(Internal Server Error) for requests with valid logs
action #95742: In openqa-investigate jobs add URL to original job as setting
action #95746: Identify likely "sporadic" openQA tests with "openqa-investigate" size:M
action #95765: Provide more people with administrative access to services on qam2.suse.de, adding ssh keys for existing tools team members
action #95854: Grafana doesn't show information during some minutes, but also we got alerts on the CPU after the recovery
action #95989: openqa-review gitlab CI pipeline jobs fail with "AttributeError: 'NoneType' object has no attribute 'group'"
action #96016: [oscqam] Traceback on running ibs qam assigned -G qam-manager
action #96350: Improve openqa-review generation: Add date to index size:S
action #96353: Improve openqa-review generation: If individual reports can not be generated, mention that as well with an explicit message
action #96356: Improve openqa-review generation: Try to preserve old reports if individual new ones can not be generated
action #96362: Improve openqa-review generation: Passthrough all vars and use git managed file for config
action #96539: Conclude migration of qam.suse.de
action #96560: openqa-review gitlab CI pipeline failed to access remote repo
action #96752: 'openSUSE-SLE' product schedule jobs to OSD
action #96792: openqa-review index page doesn't fail when a report is missing
action #96827: gitlab CI pipeline failed with Job failed: pod status is Failed size:S
action #96899: jenkins.qa.suse.de is unavailable, error from /var/log/jenkins/jenkins.log "java.io.IOException: NSS initialization failed" size:M
action #96968: qem-dashboard jobs api extension
action #96998: Increase bus factor for bot-ng size:M
action #97091: teach SUSE QE Tools team about "Extreme Programming" and Kanban size:M
action #97367: Update CI image QA:Maintenance/openSUSE-Leap-Container to Leap 15.3
action #97403: openqa-review: Polish job group section titles in todo-only mode size:S
action #97481: qam dashboard including development job group
action #97535: cpanspec: Fix package (dependency and missing script)
action #97661: [retro] find a better time for "estimation" meeting which is APAC friendly size:S
action #97733: Bot fails on Failed to query latest publiccloud tools image using {settings['PUBLICCLOUD_TOOLS_IMAGE_QUERY']} and no aggregates are scheduled
action #97847: Feature request: Ability for bot-ng to schedule test runs on custom openQA instance
action #97955: [openqabot] Possible TypeError during execution "'NoneType' object is not subscriptable"
action #98198: [bot-ng] Fix auto-approve on updates without Incidents size:M
action #98262: MTUI fails to export version of the package prior installation of the update
action #98394: Fix MicroOS scheduling to have incidents
action #98475: links in https://progress.opensuse.org/projects/qa/wiki#Definition-of-DONE are dead size:S
action #98637: [timeboxed:20h] try to enable comments on IBS (and smelt) again from SUSE QA maintenance openQA test results size:M
action #98667: Unhandled [Alerting] Queue: State (SUSE) alert for > 4h size:M
action #98673: [retro] Unhandled alert about job queue for nearly a day, users brought it up in chat, should have been picked up sooner size:S
action #98916: Improve alert handling - weekly alert duty
action #98997: [tools] [smelt] [python3.6] Replace all older text formatting with f-strings
action #99339: Find out with SUSE-IT what is the best way to collaborate based on tickets
action #99411: openqa-review report openqa_suse_de_status.html missing from https://openqa.io.suse.de/openqa-review/openqa_suse_de_status.html, page is 404
action #99534: qa-maintenance / openQABot fails trying to access download.suse.de, we should provide certificates already in the container image size:S
action #100982: openqa-review: Do not post reminder comment if comment would be exactly the same as the last size:M
action #101045: presenter needed for SUSE QE Tools roadmap workshop 2021-11 on 2021-11-05
action #101073: Smoke test of basic rust/cargo functionality size:S
action #101722: openqa-review: Do not post reminder comment in progress.opensuse.org if comment would be exactly the same as the last size:M
action #102059: Integrate the Slack feed notifications feature for progress queries
action #102200: openqa-review pipeline failed: 'NoneType' object is not subscriptable, or failed with `assert self.issue_type == "bugzilla"` size:M
action #102335: qa-tools-backlog-assistant: Automated runs of the workflow are making pull requests impossible to accept
action #102350: Move openqa-review CI to Github Actions
action #103197: qem-dashboard: Failed deployment pipeline
action #103762: gitlab CI pipeline failed with Error cleaning up pod: Delete ... connect: connection refused Job failed (system failure): prepare environment: waiting for pod running ... i/o timeout. Check ... for more information
action #103999: Include Mojo-IOLoop-ReadWriteProcess in our team wiki for usual processes size:S
action #104004: Subscribe to Mojo-IOLoop-ReadWriteProcess github issues + pull requests size:S
action #104025: Grafana: grenache-1: partitions usage (%) alert
action #104031: bot-ng: Provide manual openQA trigger commands for retrying/retriggering/triggering special tests
action #104781: Getting familiar with oscqam plugin size:M
action #105244: retrospective outcome: Come up with best practices for creating pull requests that depend on each other
action #105250: process: daily updates: Improve our feedback time on what we do aka. "Make dailys great again"
action #105612: [tools] Make yaml-ng default for repose
action #105891: retro: Our definition of non-estimated tickets is ambiguous
action #106179: No aggregate maintenance runs scheduled today on osd - dashboard.qem.suse.de down size:S
action #106368: openqa-review: Configurable no-reminder message pattern size:M
action #106907: Exponential backoff for reminders based on previous reminders size:M
action #106909: [openqa-review] reminder comments point to specific openQA test details steps or openQA comments size:M
action #107014: trigger openqa-trigger-bisect-jobs from our automatic investigations whenever the cause is not already known size:M
action #107173: s.qa.suse.de needs to be upgraded to a current OS
action #107227: bot-ng schedule aborted with "ERROR: something wrong with /etc/openqabot/singlearch.yml" size:M
action #107578: Upgrade backup.qa to Leap 15.3
action #107671: No aggregate maintenance runs scheduled today on osd size:M
action #107923: qem-bot: Ignore not-ok openQA jobs for specific incident based on openQA job comment size:M
action #108569: [tools] There are groups in Slack, we could have one for tools team, e.g. to be pinged in #eng-testing
action #108869: Missing (re-)schedules of SLE maintenance tests size:M
action #108944: 5 whys follow-up to Missing (re-)schedules of SLE maintenance tests size:M
action #109488: qem-bot - better logging
action #109512: qem-bot - add vars with GitlabCI job link and qem-dashboard link
action #109623: Allow adding scheduling settings for informal purposes that are not added to openQA jobs
action #109701: enable qem-bot comments on IBS again after subscriptions can be personally configured
action #109779: Cannot approve incident due to test report parsing error
action #109878: bot-ng schedule/approve aborted
action #109977: qem-bot - approve pipeline failed with 403 forbidden size:M
action #110167: Tests for qem-bot
action #110176: [spike solution] [timeboxed:10h] Restart hook script in delayed minion job based on exit code size:M
action #110262: openqa_review: Github action failed with "tox4: command not found"
action #110409: qem-dashboard - remove old openQA jobs when rr_number changes size:M
action #110452: http://jenkins.qa.suse.de/ throws an error with "Faithfully yours, nginx." so the jenkins instance behind seems to be problematic
action #110614: Add SLO based queries to https://os-autoinst.github.io/qa-tools-backlog-assistant/ size:S
action #111075: Collect code coverage for qem-bot
action #111078: Simple automatic test exercising one of the existing happy path workflows of qem-bot size:M
action #111272: oscqam reports in smelt show text like "See Testreport: <bound method Template.fancy_url of <oscqam.models.Template object at 0x7f51e43264e0>>SUSE:Maintenance:24247:272218/log"
action #111338: Open source https://gitlab.suse.de/qa-maintenance/mtui size:M
action #111341: Open source https://gitlab.suse.de/qa-maintenance/qam-oscplugin/ size:M
action #111344: Ensure we know all relevant implications of open sourcing mtui+qam-oscplugin
action #111407: bot-ng "sync incidents" step fails in gitlab CI, reason unclear, log too big
action #111446: openQA-in-openQA tests fail due to corrupted downloaded rpm auto_review:"Test died: command '.*zypper -n in os-autoinst-distri-opensuse-deps' failed at openqa//tests/install/test_distribution.pm line 1.*":retry
action #111506: qa-tools: qem-bot - Development results leaked to dashboard size:M
action #111710: [qa-tools] [tools] remove usage of *_TEST_TEMPLATE vars in qem-bot and openQA media definition if favor of *_TEST_REPOS size:M
action #111998: Make our SLE related tooling work with upcoming changes to build.suse.de (2FA and ssh key based authentication) size:M
action #112232: [tools] Multiple recurring failures due to zypper failing to download packages temporarily
action #112367: [tools] python-paramiko on Leap/SLE throws exception with ed25519 key size:M
action #112430: [qa-tools] [qem-bot] Incident schedule fails in preparation Incident instance
action #112898: Minion workers alert triggering on and off size:M
action #113087: [qa-tools][qem-bot] malformed data in smelt incident causes smelt sync fail
action #113345: qem-bot does not ignore Development/Leap job groups as it should size:M
action #113797: Automated alerts and reminders about SLO's for openqatests size:M
action #114415: [timeboxed:10h][spike solution] qem-bot comments on IBS size:S
action #114694: Incident seems to have missing aggregate test results in qem-dashboard but openQA jobs exists size:M
action #114872: [tools] qam plugin throws exception in query for open requests in other groups
action #115103: [tools] osc-plugin-qam reads Incident Priority from IBS but that was replaced by SMELT size:M
action #115469: QA::Maintenance{,::Test} projects on IBS maintained by indivdual persons size:S
action #115544: [tools][osc-qam] osc qam my or osc qam list ends with KeyError: 'ReviewRequestID'
action #115565: Setup OBS integration for openSUSE/mtui and openSUSE/osc-plugin-qam size:M
action #116539: jenkins.qa.suse.de not reachable and not triggering tests like krypton anymore
action #116545: Automated alerts and reminders about SLO's for openqatests (only one reminder) size:M
action #116605: False SLO update comment for a Low ticket size:M
action #116959: Unreliable/unusable audio connections using Jitsi instance on meet.opensuse.org from Android clients size:S
action #117619: Bot approved update request with failing tests size:M
action #117790: osc-plugin-qam: TypeError in qam my subcommand during incident priority fetch size:M
action #118186: Prevent SLO alerts for tickets with open subtasks as they inherit priority and can not be changed directly size:M
action #119281: [alert] baremetal-support: Memory usage alert size:M
action #120327: monitoring data for jenkins.qa.suse.de is empty size:S
action #120468: [sporadic] Failed: os-autoinst/openqa-trigger-from-obs on master / test (7ea68e0) on CircleCI size:M
action #120525: Ensure our usual bugzilla integrated tooling works with the upgraded test instance size:M
action #121225: bot-ng - synchronize pipeline fails on GitLab size:S
action #121228: qem-bot comments on IBS size:M
action #121582: [tools][metrics] Calculate cycle + lead times for SUSE QE Tools continuously

future

a "virtual" milestone that is never reached. Everything that is currently out of scope can go here. Place for new feature ideas, wishes, proposed improvements and changes which we could work on in the future but are not currently planned for.

45%

1515 issues   (623 closed — 892 open)

Related issues
action #27621: [sle][functional][u] Test "motif" libraries are usable within SLE because customers use this "legacy" framework
action #29993: [tools][hard] Better handling of custom tags/labels/fields (was: Find a way to support logical combinations of search keywords in progress.o.o queries to e.g. list all "functional SLE15 fate issues")
action #34657: [functional][u][timeboxed:4h] Setup retrospective server based on https://github.com/funretro/distributed
action #43580: The RT product can be tested by release managers or developers before full SLE validation
action #44393: [sle][desktop][sles4sap][hpc] staging project for a second SLE product besides SLES, e.g. SLE RT in SLE15
action #44774: [functional][u] create a new test module valgrind for openQA
action #49502: Automatic validation test on github PRs
action #68758: [functional][qe-core] create grafana instance for mean cycle and lead times
action #81106: test out chat service notifications, e.g. matrix, from github actions size:M
action #88536: Find out differences in openQA test coverage with metabase
action #90914: [teregen] Add overview for stored coverage data
action #90917: [teregen] Add notification about errors in template generating
action #92119: Improve license detection in cpanspec
action #93838: Use new OBS SCM integration to trigger OBS checks on pull/merge requests for our projects
action #93937: [tools][qem] qamapi - incidents can have multiple versions packages
action #94024: MTUI unable to recover from failure to connect to the refhost
action #94027: MTUI - traceback when connecting unavailable refhost
action #94048: MTUI - reload_products doesn't work
action #94588: [qem] dashboard.qam.suse.de to be included in approval qam-openqa
action #94600: [tools][mtui] Communicate reduced visibility of openQA incident related coverage in log
action #95287: [tools][retrospective] CircleCI seems very slow recently
action #95822: qa-maintenance/openQABot failed to trigger aggregate tests with "urllib.error.HTTPError: HTTP Error 500: Internal Server Error"
action #96314: [mtui] Update MTUI to use new format for Testplatform
action #96359: Improve openqa-review generation: Learn Gitlab CI pipelines
action #97118: enhance bot automatic approval: check multiple days
action #97274: qam dashboard improvement ideas
action #97505: [qem][tools] embed important IBS comments in the testreports
action #97994: bot-ng - sometimes doesn't update smelt data in dashboard
action #98820: Various requirements for qem-dashboard (was: Design document for openQA CI dashboard)
action #98919: Improve alert handling - slack notifications
action #99489: qa-maintenance/openQABot CI job fails on `TypeError: 'NoneType' object is not subscriptable`
action #100871: Consider CI Dashboard integration to SMELT
action #103464: qa-tools-backlog-assistant: Extract code into a GitHub Action for easier reusing
action #103701: Resubmited incident (ID) with new release request (RR) inherits incident test results from previous RR
action #103998: continuous integration and releasing for Mojo-IOLoop-ReadWriteProcess
action #104209: [qem] dashboard.qam.suse.de checkpoints for aggregates
action #104848: Evaluate https://commitizen-tools.github.io/commitizen/ for our projects
action #105028: https://progress.opensuse.org/projects/qa/wiki/Wiki is getting big, split out tools team to separate page?
action #106547: Setup database for dashboard.qam.suse.de
action #106549: Deployment host for dashboard.qam.suse.de
action #106552: Document deployment process for dashboard.qam.suse.de
action #107731: Salt all SUSE QA machines, at least passwords and ssh keys and automatic upgrading
action #108120: rpm and cpanspec: Support vx.y versions in perl modules
action #108731: Ensure our products are fit for "RFC: deprecate plaintext", e.g. rsync in obs-rsync
action #109491: Flow diagram for Maintenance jobs scheduling
action #109509: qem-dashboard - show better info about time of actualization of data
action #110200: qem-dashboard - add link to gitlab CI pipelines on incident dashboard pages
action #111584: upload_logs issue uploading files with space in the filename
action #112268: [teregen] Integrate productdefs generator inside template generator
action #112871: obs_rsync_run Minion tasks fail with no error message
action #115613: [tools] dashboard.qam.suse.de/blocked to show updates by the priority in SMELT
action #119161: Approval step of qem-bot says incident has failed job in incidents but it looks empty on the dashboard size:M
action #119176: Automated alerts and reminders about SLO's for openqatests - further tasks
action #120540: [timeboxed:10h][research] Find inefficient test implementations and backend use by a "tests per hardware machine ratio"
action #121588: Jobs shown on qem-dashboard are missing in OSD