# future

a "virtual" milestone that is never reached. Everything that is currently out of scope can go here. Place for new feature ideas, wishes, proposed improvements and changes which we could work on in the future but are not currently planned for.

* action #261: Add context to tests
* action #536: extend qemu qmp interface
* action #912: openqa: implement some smart prio distribution
* action #1272: Write some test cases for webUI
* action #1281: Dashboard to integrate external tests
* action #1282: implement screenshot in QMP
* action #1306: Online test creation
* action #1309: Create Perl sandbox for the tests (Safe module)
* action #1311: Improve debugging capabilities for the OS
* action #1313: Side effect in tests
* action #1315: Include an API to make asserts for graphical applications
* action #1316: A general manual configuration file
* action #1729: iChain integration
* action #1930: DISTRI is always lowercase
* action #1986: LWP::Useragent doesn't fallback to IPv4
* action #2218: idea: Merge /admin/workers view with the running table on /tests
* action #2248: Complete bootstrap/install process
* action #2524: [webui] better display of test suite variable settings
* action #2692: speed up needle matching
* action #4622: merge back changes done during QA workshop
* action #4654: deprecate workers.ini
* action #5922: Enable OpenQA preforking
* action #6096: Restrict workers to have full API access by random, individual tokens (was: change worker authentication)
* action #6160: os-autoinst <-> worker communication
* action #6192: [easy hack] Move auth plugin configuration parsing back to auth plugin
* action #6444: Network for multimachine - dynamic configuration
* action #6452: no coverage for running
* action #6466: handle large number of tests for one product
* coordination #6558: [epic] add/edit/remove users
* action #6602: move worker credentials to workers.ini
* action #6616: port needle overwrite confirmation to jQuery
* action #6660: [tools][tools][sprint 201709.1][easy hack] use mojo::log in the worker
* action #6786: [easy hack] log separate message if timestamp mismatch
* action #7028: [tools]implement openstack backend
* action #7296: Assets' VM snapshot support
* action #7962: os-autoinst: multiple networks
* action #7982: multi machine test that actually involves different machines
* action #8084: show source of imported modules
* action #8106: refactor job_module* out of JobModules.pm
* action #8540: Easier workflow to submit needles for casual contributors
* coordination #9966: [epic] Be more robust about spurious errors
* action #9968: Investigate http://blogs.igalia.com/berto/2015/12/17/improving-disk-io-performance-in-qemu-2-5-with-the-qcow2-l2-cache/
* action #10100: Get rid of dependency on apache2
* action #10144: Review support for needle changes
* action #10188: [tools][dashboard]Tracking open bugs based on product
* action #10192: Improve source code window
* action #10258: Re-add "needle diff"
* coordination #10316: [epic] Better command line options extending "client"
* action #10574: Make use of cool mojolicious plugins
* action #10624: Add test debug command "make snapshot"
* action #10680: Use Virgil to test 3d accelerated graphics in openQA
* action #10704: Make warnings in tests fatal
* action #10784: test framework for openQA test distributions
* action #10884: Save image on filesystem kernel bugs
* action #11160: improve debugging/ log-errror if variable posted to api aren't right. 
* action #11370: job group administrators
* action #11566: add linuxvnc based console
* action #12042: implement favorite job groups
* action #12130: [tools]'Proper Interactive Mode' - Making openQA gods gift to developers
* coordination #12134: [saga] better marketing for openQA
* action #12158: [tools]SLES on openstack
* action #12160: flexible use of cloud backend
* action #12180: [webui] Prevent tests to be triggered when required assets are not present (anymore)
* action #12266: keep tests with any comment around later
* action #12398: hide echoing to serial port in testapi calls from output in screenshots
* action #12802: [easy hack] github thinks openqa is 12% perl6
* action #12836: preserve disk image / virtual machine / keep them running in case of failures on demand
* action #12858: "ocr" was never properly tested and is not complete
* action #12950: sqlite database implementation does not support more than 5000 jobs in the database (was: on webui: startup: SQL error "prepare_cached failed")
* action #12972: extend self test for SLE: openQA fails to install on SLES12SP1: http://lord.arch/tests/2427#step/openqa_webui/11 nothing provides git-core
* action #13242: WDYT: For every job that does not have a label or bugref, retrigger some times to see if it's sporadic. Like rescheduling on incomplete but on failed
* action #13278: [process] Use redmine issue referencing to automatically reference or close issues with github changes
* action #13502: option to have no network/link down
* action #13646: Ensuring asset files integrity (was: "An error occurred during the installation" on images)
* action #13714: [process][redmine] backlink references in openqa comments to tickets inside the corresponding tickets, like github
* action #13760: removing job by DELETE route doesn't remove job related gru tasks
* action #13796: Add "Delete needle support" to webUI
* coordination #13812: [epic][dashboard] openQA Dashboard ideas
* action #13850: Show the exact source (file and line number) of a test API function call in test details
* coordination #13950: [epic][gsoc] Needle ENV tag assistant
* action #14100: Implement ClientCutText for VNC to speed up sending text
* action #14130: optimize webpage loading based on "google PageSpeed Insights"
* action #14316: Should we show builds which have only "skipped" jobs?
* action #14320: query status of bugs referenced as soft fails (asynchronously)
* action #14324: Show details of soft failures on tests overview page, e.g. buglinks
* coordination #14626: [epic] backend and console capabilities interface to increase extensibility and code reuse
* action #14714: readonly access to database entries for non-operator users
* action #15138: files generated by local tests are messing up the source directory
* action #15176: Reload /tests/overview with configurable timeout or based on events
* action #15466: Live view takes long time to load when there's more than two "viewers"
* action #15880: os-autoinst: Loading snapshots during development does not work when using simulated usb thumbdrive as install medium
* action #15898: Not give job state labeled when quantity of issues not equal quantity of failed modules
* action #16166: Log per test
* action #16180: Better log viewer
* action #16184: Better UI log viewer
* action #16188: Easier way to clone jobs for test development
* action #16274: email notifications about new review comments available
* action #16506: [easy hack] Use of uninitialized value with isotovideo --help
* action #16534: more fun reviewing tests and therefore improving the quality of the tested products with gamification
* action #16538: [easy hack] improve isotovideo command line handling and help
* action #17182: clone_job.pl doesn't work without http(s):// in the hostname
* action #17252: notifications to maintainer on failed modules
* coordination #17728: [epic] Support causing openvswitch failures to test failure conditions
* action #17730: Investigate/implement twopence backend
* action #17734: "autoneedler" mode
* action #17960: JavaScript errors shouldn't be silently ignored
* action #18000: [dashboard] Better integration of status from external jobs and testing systems
* action #18402: job dependency highlighting on /admin/workers/[id]
* action #18404: Parent group is not working as expected for Maintenance groups
* action #18484: Needle editor confused by identically-named needles in different folders
* action #18620: Add verification of keyboard events sent through vnc
* action #19222: [discussion] Improve automatic carryover to be more strict - when bugs relate to individual steps within test details
* action #19390: [tools][sprint 201711.2] qemu "migrate" within testapi::save_memory_dump command never finishes within 2h
* action #19702: Share directory is not created upon openQA-worker package install and worker does not start even if caching is enabled
* action #19836: [tools]test fails in yast2_snapper - failed to assert serial output - ppc64 and aarch64
* action #20162: Create a group `openqa` during installation
* action #20246: [gsoc] Investigate/implement container-based backend
* action #20604: refactor current libvirt backend, e.g. better support xen backend (was: investigate xen backend)
* action #20788: upload fails on job with HDD_1 equals PUBLISH_HDD_1
* action #21032: Feature to start new jobs from web interface
* action #21848: error when using multiple parent jobs in START_AFTER_TEST parameters
* action #23944: Use Mojo::Log in isotovideo to improve logging. 
* action #24702: Link test assets to their origin.
* action #25276: Support of higher resolution (>1024*768) in WebUI
* action #25296: [tools] Bookmarking of worker log: Have the worker log show what job was it working in the logs.
* action #25958: [tools][sprint 201710.2][sprint 201711.1][easy hack] Harmonizing logging setup across openQA
* action #27808: Allow usage of CACHELIMIT from workers.ini
* action #27841: Improve documentation and usage examples of AMQP plugin
* action #27844: backlink from openQA bug tracking to bugzilla
* action #27868: Refactor openQA::Setup Configuration and logging initialization
* action #28385: "worker status timer calculation" sometimes fails, not sure why
* action #28441: Nested virtualization for openqa instance fails
* coordination #28630: [qe-core] setup for LPAR installation (manual + automatic)
* coordination #28869: [sle][functional][virtualization][s390-kvm][s390x][epic] Automated installation on LPAR & integration to openQA
* action #29289: Improve handling of needle deprecation and deletion
* action #29481: [openqa-monitoring] DBI Exception: DBD::Pg::st execute failed: ERROR:  invalid input syntax for integer: "127),"
* action #29925: Searching for "not last (time period)" in needle admin interface does not find needles last use/match was "never"
* action #30121: combine bugzilla back links and bsc#xxx tagging
* action #31417: Add support for SSH from Host to VM
* action #32293: [tools] Implement sub-reaper support in isotovideo
* action #33226: [sle][functional][virtualization][s390-kvm][s390x][medium] Add a simple testsuite which uses the "new" LPAR backend
* action #33232: [sle][functional][virtualization][s390-kvm][s390x] Execute useful LPAR installation testcases in the SLE Functional job group
* action #33697: [tools][hard][pvm] Enable the powerVM backend to conduct multimachine tests
* action #33715: Autoinst-log does not show the url for rsync when caching is enabled
* action #33745: Improve handling external Git repositories (for needles)
* action #33805: Make worker registration resilient when multiple webuis are not reachable (was: Worker websocket registration blocks the worker loop)
* action #33916: [sle][virtualization][s390x][hard] Implement simple backend which uses snipl/qnipl for automated LPAR installation
* action #34345: use streams in ogg format to embed more information in the video
* coordination #34357: [epic] Improve openQA performance
* action #34591: Corrupt iso download by cache
* action #34978: Make log output of isotovideo fancier on manual calls, e.g. bring back colored output
* action #35014: Provide direct links to uploaded logs from the corresponding upload_logs step within the test details thumbnails
* action #35017: Show more test failure details with the "test failed" text thumbnail popups
* action #36601: Display the command to spawn a VM for virtualization backends
* action #37303: better ttm comment in openqa
* action #37525: Expose logs from OSD
* action #37610: Flaky ui test: 'new needle image shown' at t/ui/12-needle-edit.t
* action #37628: Flaky scheduler test: 'Simulation of heavy unstable load' at t/05-scheduler-full.t
* action #37638: Flaky fullstack test: 'Test 3 is scheduled' at t/full-stack.t
* action #37853: Consider support for Intel AMT backend
* action #38168: Worker configuration to get assets from a different server than the webui
* action #38276: Flaky 'test candidate list' at t/ui/18-tests-details.t
* action #38486: [functional][u] add capability flags to os-autoinst backends (or tests)
* action #38807: API call that allows to search for test settings  was -  Make sure all used assets are accounted for in tests on osd (#38804) 
* action #39116: Add assert_still_screen functionality
* action #39251: Ensure videos are seekable for timed out jobs
* action #39335: drag and drop support in testapi
* action #39566: Snapshot rollback for tests that timed out asserting screen - UI defined rollback
* action #40007: [openqa-monitoring] [warn] A message received from unknown worker connection
* action #40013: [functional][u] Failed to upload test logs
* action #40034: [tools] logline including qemu parameters is split over two entries
* coordination #40058: [EPIC] Store VM state when reusing published image
* coordination #40199: [EPIC] Better rollback capabilities of (worker) deployments
* action #40211: Allow changing keyboard layout at runtime
* action #40220: Scheduler died due to Mojo::Log failing to write to log
* action #40382: Make "ignored" issues more prominent (was: create new state "ignored")
* action #40460: Improve reporting about apparmor compatibility with remote backends (was:Test run died because of unexpected console quit (select_console failed))
* action #40478: support multiple job groups for ttm
* action #40520: SKIPTO fails to load snapshots
* action #40538: Reset/Clear guest RAM when it reboots in QEMU to reduce RAM snapshot size
* coordination #41057: [epic] Make reviewing results easier
* action #41222: A lot of occurences of 'websocket connection closed'
* action #41600: fallback mechanism for apache, e.g. on osd 
* action #41780: [ppc64] Settings in Qemu 3.0 seem to be troublesome
* action #42452: openQA-in-openQA test fails in openqa_webui trying to access a TW snapshot repo on o3 that is already deleted and the test does not track the repo
* coordination #43706: [epic] Generate "download&use" docker image of openQA for SUSE QA
* action #43793: Add all os-autoinst documentation to http://open.qa/documentation
* coordination #43934: [epic] Manage o3 infrastructure with salt again
* coordination #44360: [epic] Parameterize test suites within job groups
* action #44399: [easy][beginner] Fix assert_script_sudo and script_sudo being called as root
* action #44441: test fails in dashboard of openQA-in-openQA test, timeout looking for desktop runner is too short, do we have old x11_start_program code in os-autoinst-distri-openQA?
* action #44465: Webui shows one test module but worker starts a different one
* action #45011: Allow detection of known failures at the autoinst-log.txt
* coordination #45302: [epic] smarter fetchneedles (was: fetchneedles should ensure we are always on a branch (and try to self-repair))
* action #45410: Allow adding clarification messages for all assertions/checks
* action #45413: Support markdown in the test suites description
* action #45671: Improve "developer mode" connection hint for non-qemu remote machines
* action #46349: [s390x] Add qemu backend support
* action #47222: Support named needle match areas
* action #47987: Identify unused media, testsuites, machines, etc.
* action #48578: openQA feature _SKIP_POST_FAIL_HOOKS also skips die()
* action #48644: Dynamic scheduling of small script snippets to execute, e.g. scripts as downloadable assets
* action #48752: [easy][beginner] Add proper unit-test for `assert_screen_change`
* action #48998: Include failed tests with closed issues assigned in the TODO test overview
* action #49370: Get rid of tests in "test development" that no one cares about (was: Ensure all tests in "test development" have a open ticket reference)
* action #49394: [s390x][svirt] Print content of kernel log and serial console into "Serial output" field
* action #49400: [ux][ui][easy][entry level] Unable to set priority of a job without further explanation of the reason when not logged in
* action #49547: [virtualization][svirt] Refactor how svirt handles credentials for SSH
* action #49883: OpenQA web ui choose wrong port for websocket if running on non-default port
* action #50675: Commit changes to scheduling YAML to Git repository
* action #51716: No scheduling error generated for faulty PARALLEL_WITH config
* action #51935: Better logging from scheduler+working why jobs are *not* picked up
* action #52004: Enable SUSE partners to test SLE using openQA in the open easily
* action #52205: Mojo::Reactor::Poll: Timer failed: Can't read from file "/tmp/KsT0o3Ie7U/": Is a directory at /usr/share/openqa/script/../lib/OpenQA/WebAPI/Controller/Running.pm line 218.from logfile on o3: 
* action #52673: os-autoinst: Do not save "lastgood" snapshot on last module unless img is preserved with snapshot (e.g. --no-cleanup)
* action #52736: Make it obvious why we call cpanm with an invalid mirror URL (was: error in package build about wrong use of cpanm)
* action #53168: make "show only failures" change the URL to make that view shareable
* action #53222: [ux][ui][easy][beginner] On jobs with empty details, e.g. "cancelled", show "#dependencies" by default, not (empty) "#details"
* action #53402: [beginner] Not possible to search for test suites (again?) using regex, e.g. `^gnome$`
* action #53405: [logwarn] o3: "gnome:Laptop_64 has no child, check its machine placed or dependency setting typos"
* action #53435: [logwarn] o3: DBI Exception: number of parameters must be between 0 and 65535 in lib/OpenQA/WebAPI/Controller/API/V1/Job.pm line 133
* action #53474: [easy][beginner][monitoring] "mkdir /var/lib/openqa/images/0bf/862/.thumbs: File exists at /usr/share/openqa/script/../lib/OpenQA/Schema/Result/Jobs.pm line 1227."
* action #53546: Easier dependencies handling for packages, e.g. reduce duplication of build requirements in spec, documentation, Dockerfile
* action #53606: PRODUCTDIR invalid when main.pm in casedir (not product-subdir) and cloning from caching worker to caching worker
* action #53912: Use available space for caching on each worker for increased performance
* action #53999: openqa-worker (isotovideo) dumps core / segfaults quite often on several workers and distributions for cancelled jobs
* action #54179: Re-use YAML betweens different groups
* coordination #54806: [epic] Better user control over job group overview
* action #55187: Replace live viewer with noVNC
* action #55232: Explore the use of consoles calling ssh in tests rather than ssh-based backend terminals can improve stability and reviewability
* action #55238: jobs with high amount of log files, thumbnails, test results are incompleted but the job continues with upload attempts
* action #55262: Install Pgpool-II or PgBouncer before PostgreSQL for openQA instances, e.g. to be used on OSD
* action #55415: restart "recent incompletes" or "incompletes of today" easier then over web UI
* action #55904: /status updates are too heavy with external results
* action #56594: Why would a worker host need to upload images to another machine when afterwards the image is only used on the same worker host?
* action #56789: New needles from git repository not working with openqa-clone-custom-git-refspec
* action #56822: Greyscaling of needle matches can produce false positives
* coordination #56999: [epic] Run post-fail hook when cancelling cluster jobs?
* action #57035: Worker keeps running on errors while waiting for cache service
* action #57170: [ui][beginner] Ability to delete Job Group, e.g. over UI
* action #57335: [ui][ux][easy][beginner] Allow builds to be sorted by "build creation time" (was: Build order list on "Sort by time job most recently created" not properly sorted)
* action #58100: HashKeyQuotes: force no quotes for names containing "_"
* action #59085: Make the YAML editor in Job group more user friendly
* action #59109: use ballooning to improve snapshot performance
* action #59397: Make openQA less "iso" centric
* action #59879: module status "running" seems to report in very late or not at all
* action #59926: test incompletes in middle of execution with auto_review:"Unexpected end of data 0":retry, system journal shows 'kernel: traps: /usr/bin/isotov[2300] general protection ip:7fd5ef11771e sp:7ffe066f2200 error:0 in libc-2.26.so[7fd5ef094000+1b1000]'
* action #59969: Display job dependency tab not only for latest jobs 
* action #60059: logs of virtio_console1 and later not visible in web UI live view or assets tab
* action #60173: Improve the openQA documentation
* action #60209: flaky/unstable test in OBS t/17-labels_carry_over.t  
* action #60272: Make fetching custom git repos (e.g. needles) more efficient
* action #60758: better feedback for Xvnc disconnecting clients, integration tests covering Xvnc in travis CI as well or OBS
* action #62441: openqa-worker systemd service can timeout when stopping
* coordination #62456: [epic] test incompletes after failing in GRU download task on "Inactivity timeout" with no logs
* action #62504: document test variables _START_AFTER_JOBS and similar
* action #62549: openqa-bootstrap fails if fetchneedles has already been called and git is up-to-date
* action #62600: Improve error output when calling openqa-clone-custom-git-refspec with wrong args, not just exit code
* action #62606: GENERAL_HW_POWEROFF_CMD broken with scripts if started from openQA
* action #62819: 2nd select_console() call failed with pvm_hmc backend 
* action #62861: Validate input in WebUI (testsuite names etc.)
* action #63065: [gsoc] dynamic detection of error conditions from test results
* action #63427: tests incomplete with reason "api failure: 503 response: Service Unavailable" due to the webui host rebooting, expected: longer retry or retrigger
* action #63802: Further improve consistency of job states/results
* action #63919: Improve handling of additional UEFI settings
* action #64078: [openqa-in-openqa] Tests covering bootstrap method
* action #64129: Set `$0` for upload process to something more explicit (was: Duplicate worker instances competing)
* action #64174: [ui][ux][help] /admin/obs_rsync could benefit from help popovers
* action #64201: Make queued assigned jobs more distinguishable
* action #64290: Docker container "openqa_webui" throws an exception when trying to run.
* coordination #64322: [epic] Improve feedback on multi-machine API errors
* action #64412: Get rid of eval in OpenQA::WebAPI::Plugin::HashedParams
* action #64667: START_DIRECTLY_AFTER_TEST - Child cancellation cancels other childs
* action #64830: [ux][ui][easy][beginner] limit "keep_logs_in_days" to "keep_results_in_days" in webUI
* coordination #64881: [epic] Reconsider triggering cleanup jobs
* action #64935: Provide test results of "related results" on job details
* action #64961: test fails in installation - cannot find autoinst.xml. server returned code 404
* action #65076: [process] rethink our project management tool decisions
* action #65082: flaky/sporadic unstable failure in t/43-scheduling-and-worker-scalability.t
* action #65196: Use the correct tagline in the docs overview
* action #65205: [ux][ui][easy][beginner] Result filter on "All tests" page affects running and scheduled job tables
* coordination #65271: [epic] Various feature requests
* action #65432: [functional][y] test if schedules and test data files in the job group do exist in the os-autoinst/os-autoinst-distri-opensuse repo
* action #65450: workers on o3 power did not restart after upgrade as NFS mount point was stale "Ignoring host 'http://openqa1-opensuse': Working directory does not exist"
* action #65657: all tests passed but still got Result: timeout_exceeded
* action #65837: [easy] rpmlint warnings to fix
* action #65933: Add --help to all our scripts
* action #66167: Provide a debugging option for openqa-validate-yaml
* action #66619: OpenQA jobs roll back to the wrong snapshot on hard test failure
* action #66658: Fail to use openqa-clone-custom-git-refspec to trigger a job which is also triggered by this script
* action #66865: Support !inherit tag in YAML job templates
* action #67087: Allow to configure retention period for the video individually
* action #67417: Remote backend capability
* action #67420: Persistent console console capability
* action #67423: Persistent console backend capability
* action #67426: Raw text backend capability
* action #67429: Raw text console capability
* action #67468: Add the possibility to apply rootfs overlays on qcow2/raw images
* action #67558: testapi::wait_serial: can not get correct msg with pvm_hmc backend
* action #67855: [tests][ci] circleci often abort in "cache" unable to read container image from registry.opensuse.org
* action #67891: Show web-UI-determined result within logs
* action #68008: Implement a retrigger command in openqa-cli
* action #68011: Implement a clone command in openqa-cli
* action #68014: Implement monitoring via openqa-cli
* action #68026: Implement SKIPTO option when cloning
* action #68029: Implement convenience wrappers around API routes
* action #68143: [y] Implement navigation to the schedule from the job
* action #68146: Implement colored and interactive logs
* action #68413: De-duplicate definitions of needle soft-fail markers (was: screenshot shows soft-fail border for a needle with bug reference but the module turns out to be "passed", expected "softfailed")
* action #68567: Automatic submission of os-autoinst to openSUSE:Factory build job logs full of warnings and errors from osc and grep
* action #68585: [ui][ux][beginner] links to comments should ensure the comment is shown after the page is loaded, e.g. select correct paginated object
* action #68702: Add UI support for removing users
* action #68705: Add webAPI support for removing users
* action #68836: t/api/14-plugin_obs_rsync_async.t fails sporadically in OBS
* action #68839: [ui][ux][beginner] Show job group properties and template for non-admins
* action #69205: Implement mocks for javascript in unit tests
* action #69274: Directly chained jobs are accidently skipped
* action #69319: Surface relevant versions used by job worker
* action #69337: maintain both openSUSE and Fedora spec files upstream together?
* action #69448: test incompletes with auto_review:"(?s)was downloaded by.*details.*unavailable here.*Failed to download":retry , not helpful details
* coordination #69451: [epic] test incompletes with "(?s)Download.*successful.*Failed to download":retry, not helpful details
* action #69487: Handle temporary javascript cache download errors "Unable to download https://use.fontawesome.com/.*.ttf: Premature connection close"
* action #69691: Improve incomplete output for qemu related problems, e.g. auto_review:"Failed to allocate KVM HPT.*Cannot allocate memory":retry instead of "can't open qmp"
* action #69700: Predefined QEMU hardware profiles in os-autoinst
* action #69712: [qem] Add option to skip certain guests
* action #69715: improve error feedback from lockapi to not just have "# Test died: mydie at /usr/lib/os-autoinst/lockapi.pm line 41."
* action #69871: Improve error handling when restarting jobs
* action #70204: Expose dedicated API docs to replace "not found" page
* action #70333: providing a git branch for NEEDLES_DIR does not appear to work on o3
* action #70612: better error handling in testapi function script_output (was: script_output() ignores parse errors)
* action #70615: Calling select_serial_terminal() twice on s390x svirt backend results in error
* action #70618: Automatically avoid restarting the directly chained parent if possible to save time
* action #70633: Add option to keep unchanged jobs when rescheduling a product
* action #70774: save_needle Minion tasks fail frequently
* action #70795: Link to tests overview triggered by specific trigger event
* action #70798: dry-run for "isos post"
* coordination #70840: [epic] further features for the "search" feature
* action #70876: Job incompletes with auto_review:"(?s)qemu version detected.*Driver backend collected unknown process.*failed to start VM":retry and no further detail
* action #70906: Make openqa_restart event useful
* action #70915: Bugref comments carried over even if status changed failed -> incomplete
* action #70927: Testing Outbound Amail
* action #71188: job incomplete with auto_review:"backend died: QEMU exited unexpectedly, see log for details" and no other obvious information in the logfile what went wrong
* action #71227: [ux] job incompletes with auto_review:"backend died: 'current_console' is not set at /usr/lib/os-autoinst/backend/baseclass.pm line 932."
* action #71422: extend "search" feature to find job template by "test suite names"
* action #71605: Cleanup task `limit_results_and_logs` fails with database error
* action #71809: Enable multi-machine jobs trigger without  "isos post"
* action #71863: [os-autoinst] Include tests in code coverage analysis
* action #71899: some module paths in the autoinst-log.txt are invalid
* coordination #71926: [epic] t/14-grutasks.t takes multiple minutes within circleCI, only 6s locally (but errors but still succeeds?), and no log output visible in circleCI
* action #71977: Include currently running jobs in jobs overview API call
* action #72085: flaky/unstable t/05-scheduler-full.t, Failed test 'Allocated maximum number of jobs that could have been allocated'
* action #72130: [easy][beginner] check and/or reduce runtime of t/api/04-jobs.t
* action #72142: Avoid problematic symlinking in download assets tasks of the web UI
* action #72199: check and reduce runtime of t/44-scripts.t
* action #72229: Support openQA worker on SLE15-SP2 (aarch64): perl(Minion::Backend::SQLite) >= 5.0.1 missing for openQA-worker for SLE15-SP2
* action #73084: javascript code coverage analysis
* action #73114: openQA WebUI - Missing duration info for failed test
* action #73129: t/14-grutasks.t takes multiple minutes within circleCI, only 6s locally
* action #73273: job incompletes with auto_review:"setup failure: Cache service status error from API.* file is not a database .*":retry
* action #73282: auto_review:"setup failure: Cache service status error from API: Minion job.*Worker went away":retry
* action #73288: auto_review:"setup failure: Cache service status error from API: Minion job.*Job terminated unexpectedly":retry
* action #73294: auto_review:"isotovideo died: needles_dir not found" should be 'tests died' or something similar obvious to test maintainers that they need to act
* action #73309: every time a direct dependency is updated in Factory our CI jobs fail until the package is updated
* action #73354: idea and RFC: Use Test2::Aggregate 
* action #73369: Job incompletes with auto_review:"(?s)backend died: runcmd .*qemu-img create -f qcow2 .* failed with exit code 1: 'Formatting .*" on o3
* action #73375: Job incompletes with reason auto_review:"(?m)api failure$" (and no further details)
* action #73525: Job incompletes with auto_review:"backend died: unexpected end of data at /usr/lib/os-autoinst/consoles/VNC.pm.*":retry
* action #75019: s390 job via ppc64le worker incompletes on failure to connect to VNC due to "Use of uninitialized value $_[2] in substr at /usr/lib/perl5/5.26.1/ppc64le-linux-thread-multi/IO/Handle.pm"
* action #75091: incomplete jobs with one of the isotovideo sub-processes receiving a signal and just terminating, no clue why or who/what triggered the termination
* action #75388: Explicit error feedback to test reviewers on wrong test API usage
* action #76738: [workflow] Automatically rebase openQA PRs
* action #76747: Define exclude areas relative to match areas (not absolute position) (was: Needle masks do not handle matches with offsets)
* action #76765: job is incomplete with reason just being "api failure" and no logs can be uploaded due to OOM condition on worker, improve reason to point to potential causes
* action #76813: [tools] Test using svirt backend fails with auto_review:"Error connecting to VNC server.*: IO::Socket::INET: connect: Connection refused"
* coordination #76984: [epic] Automatically remove assets+results based on available free space
* action #77014: openQA webui entry "Assigned worker" shows ip instead of names as formerly
* action #77314: Test incompletes with "(Bizarre copy of (HASH|ARRAY) in list assignment|attempt to copy freed scalar)", improve error feedback
* coordination #77698: [epic] synchronous qemu based system level test in pull request CI runs, e.g. standalone isotovideo or openQA tests
* action #77704: Phase out Gru tables and other no longer needed Gru abstractions
* action #77728: Test incompletes with auto_review:"(?s)Error in .*isotovideo: backen.* corrupted size vs. prev_size":retry
* action #78046: Prevent tests polluting openQA working copy source directory
* action #78055: job incomplete exiting prematurely before reaching needle check timeout auto_review:"(?s)called testapi::assert_screen.*no match: [^-0]+\.[0-9]s,[^\n]*\n[^\n]*backend process exited: 0.*\[autotest\] process exited: 1":retry
* action #78240: prevent circular dependencies in bmwqemu.pm and autotest.pm to be able to use "strictures"
* coordination #80142: [saga][epic] Scale out: Redundant/load-balancing deployments of openQA, easy containers, containers on kubernetes
* action #80226: job incomplete with autoinst-log.txt ending just in the middle
* action #80356: incompletes with auto_review:"Cache service.*error: Connection refused":retry
* action #80382: Provide installation recipes for automatic installations of openQA worker machines
* action #80466: docker: Base the webUI and worker Dockerfiles in Tumbleweed
* action #80506: post/put on test_suites always denied with "Missing parameter: name"
* action #80516: Docker image for webui and workers on docker hub reflect current state
* action #80520: Automatic tests for our openQA containers - webUI only
* action #80548: job incomplete with auto_review:"isotovideo died: Can.t mkdir.*testresults.*Structure needs cleaning at.*bmwqemu.pm":retry
* action #80550: Allow retry on test module level based on module flag or test parameter listing test modules
* action #80678: Make sure that certain amount of workers of some unique class is running 
* action #80772: [jeos] auto_review:"(?s)GENERAL_HW_FLASH_CMD.*No space left on device":retry incomplete in flash script
* action #80774: [jeos] auto_review:"(?s)GENERAL_HW_FLASH_CMD.*No route to host":retry incomplete in flash script
* action #80778: job incompletes with "Virtio terminal and svirt serial terminal do not support send_key", we should change the reason message to be ignored by auto-review, but be clear for the test maintainer
* action #80988: openqa can find multiple match areas in the same place
* action #80994: Needle editor is very unreliable when the worker is run without cleanups
* action #80996: Implement generic serial terminal over SSH
* action #81002: Test incompletes with auto_review:"(?s)openqa.suse.de.*Encoder not accepting data.*Uploading video":retry but video is there
* action #81004: jobs incomplete with auto_review:"(?s)sol deactivate: Info: SOL payload already de-activated":retry
* action #81008: job incomplete with auto_review:"fcntl.*on closed filehandle.*at /usr/lib/os-autoinst/OpenQA/Qemu/Proc.pm":retry
* action #81010: job incompletes with auto_review:"cache failure: Cache service.*DBD::SQLite::db do failed: database is locked":retry
* action #81022: auto_review:"cache failure: Failed to download.*Asset was pruned immediately after download.*poo#71827":retry
* coordination #81060: [epic] openQA web UI in kubernetes
* action #81142: VNC console corruption
* action #81374: openqa-dump-templates dumps all result  (product, machine ..) when users specify --test
* action #81493: openqa-cli --help aborts instead of showing usage
* action #86063: [epic] Add possibility to trigger openQA API calls, e.g. single "jobs", without the need of the client / over the webUI / with curl
* action #87647: openqa-cli api ignores extra arguments
* action #87725: MULTIPATH backend variable doesn't set HDDMODEL for aarch64
* action #88053: Improve logging in scripts (was: openQA in openQA test fails with cryptic error enumerating jobs)
* action #88061: Fix premature cancel of a job when strange character is encountered
* action #88119: Changes in dependencies.yaml should cover .circleci/ci-packages.txt
* action #88185: OBS Package Build shouldn't appear as failed by default
* action #88193: [qe-core] virtio-terminal is missing for non root users
* action #88223: [openqa-in-openqa] Remove special-case on load_osautoinst_tests with OPENQA_FROM_GIT
* coordination #88229: [epic] Prevent unintended test coverage decrease
* action #88315: Complete the worker container test obtaining the key/secret to complete the connection with the web UI
* action #88389: qemu unexpected result: Could not set up host forwarding rule - auto_review:"Could not set up host forwarding rule":retry
* action #88507: Create a reports page in SMELT to display not accepted requests
* action #88514: [virtualization][ipmi] Test incomplete sometimes due to de-activate a already "deactivate" status SUT.
* action #88521: Provide an easy way to clone multi machine jobs
* coordination #88561: [epic] Extend needle version control handling
* action #88801: feedback from SUSE QE Tools workshop - QAM openQA review processes - 2021-02-19
* action #88837: Separate out style checks into a dedicated environment
* action #88840: Provide git hooks for style checks
* action #88933: Add sum of configured quotas excluding "Untracked" on https://openqa.opensuse.org/admin/assets
* coordination #89020: [epic] Support for multiple authentication providers
* action #89023: Migrate from OpenID to OpenID Connect for authentication
* action #89092: Provide openQA or a subpart or os-autoinst over flatpak
* coordination #89095: [epic] Provide openqa-investigate information on job details
* action #89116: Enable openQA cloud IDE workflow out of the box
* coordination #89278: [epic] Concurrent unnecessary uploads from investigation jobs corrupt qcow images
* action #89536: Use openqa-review consistently from only package or only git, not mixed
* action #89560: Add alert for blocked gitlab account when users are unable to save/commit needles
* action #89614: openqa workers on `ip-172-25-5-39` fails with no clue on failure
* action #89749: containers: Allow to the user to choose the source of images in the docker-compose
* action #89755: container: Fix missing shared directories and its permissions
* coordination #89842: [epic] Scalable and streamlined docker-compose based openQA setup
* action #89920: Extend existing openQA-in-openQA tests as a learning exercise to know where our instructions or beginner situation can be improved
* action #89929: containers: Fix nginx configuration to independence the WS and livehandler backend urls of the docker-compose parent directory
* action #89972: List of openQA plugins, helpers, tools
* action #90167: Setup initial salt infrastructure for remote management within o3
* action #90314: unhandled error output in t/4-worker-jobs.t
* action #90332: have a reasonable timeout in lock API calls
* action #90341: [easy][beginner] section numbering on http://open.qa/docs/
* action #90344: kubevirt backend for openQA and/or os-autoinst
* action #90347: Support for downloading snapshots
* coordination #90359: [epic] Customizable worker engine
* action #90365: unstable test t/ui/13-admin.t
* action #90483: Ensure openQA packages in Leap are updated
* action #90545: Add additional option for build sorting within a jobgroup
* action #90788: openQA jobs with arbitrary parameters can be triggered over the webUI for authenticated users with right permissions (operator+)
* action #90989: containers: Configurable workdir location in docker-compose
* action #90995: containers: Reduce the testing time for "webui-docker-compose"
* action #91004: Treat '--apibase /' argument for openqa-client as error
* action #91332: Allow to contribute to salt-states-openqa over github
* action #91359: openqa-clone-job creates a huge output on stderr when cloning remote jobs
* action #91494: [epic] work on #90152 caused deployment problem and no monitoring alert
* action #91509: Easy way to check and compare coverage in multiple openQA instances
* action #91584: containers: ensure the failure of the web UI container when Apache fails
* action #91602: Inform users about keyboard shortcuts in openQA
* action #91631: [easy][beginner][doc] document suggestions how to include test distributions in docker-compose based setup
* action #91656: [qe-core] os-autoinst-distri-opensuse YAML schedule file comparison
* action #91770: Optional job investigation information in "investigation" tab rather than comments
* action #91791: [CI]worker1.qa1.suse.asia our of memory issue
* action #91800: 5-year old job not cleaned up, why?
* action #91815: containers: Expand the docker-compose CI test to check healthy of containers
* action #91818: containers: Add logs when docker-compose up fails in the CI
* action #91878: Improve git log entries in failed test investigation
* action #91884: [spike][timeboxed:18h] Demonstrate how Playwright helps with tricky UI tests
* action #91905: webui fails to display needles when using a git repository as CASEDIR
* action #91965: Enable switching to the qemu serial0 line
* coordination #92037: [epic] Extensible openQA: Support for external openQA plugins
* action #92040: Support for external openQA plugins in home directory
* action #92046: os-autoinst file doc/backends.md references VIRSH_MAC which only applies to os-autoinst-distri-opensuse
* action #92092: containers: openQA test eventually fails because of timeouts
* action #92128: openQA-(common|devel) broken on Leap 15.2 (Cpanel::JSON::XS dependency)
* action #92146: Automatically validate indentation in shellscripts
* action #92296: Add "open all TODO in separate tabs" functionality
* coordination #92314: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideo - further cleanup
* coordination #92323: [saga][epic] Scale up: Fine-grained control over use and removal of results, assets, test data
* action #92533: Module-centric test result overview
* coordination #92575: [epic] feature switch capabilities
* action #92578: infrastructure-instance wide feature switches
* action #92731: clickable git log entries in investigation tab
* coordination #92854: [epic] limit overload of openQA webUI by heavy requests
* action #92913: incompletes due to outdated os-autoinst-distri-opensuse-deps
* action #92960: Add option to openqa-review to section by flavor
* action #93177: containers: webui doesn't has the credentials to connect to the scheduler
* action #93324: Exception in log parser leads to failed job with hard to guess root cause
* action #93336: unstable test in os-autoinst master - slow coverage analysis when forking in t/18-backend-qemu.t
* action #93342: Exception in log parser should Incomplete if the parser can't parse or throws an exception
* action #93393: backend died: Virtio terminal and svirt serial terminal do not support send_key
* action #93704: Automatic updating of packed assets or at least a hint in our automatic test?
* action #93892: [beginner][easy] Automatically validate code style for python code in openQA
* action #94030: Cleanup logging in autoinst-log.txt for download assets
* action #94084: POST /job_templates_scheduling fails silently when the template contains an undefined machine
* action #94186: Update to Bootstrap 5
* action #94255: containers: Improve the speed of the container test in CI
* action #94372: [qem][tools] Use GitLab Pages to expose MTUI documentation
* action #94510: os-autoinst OBS build errors in Leap 15.2 size:M
* action #94531: OpenQA worker randomly skips uploading artefacts for whole test modules
* action #94630: Handle minion job operations in obs rsync plugin fully asynchronously
* action #94705: Monitor number of SQL queries in grafana
* action #94717: Make creating needles with "lower-than-default" match ratio more prominent
* coordination #94750: [epic] Support needles from git-cloned or separate repo if casedir points to a git-repo
* action #94997: Downloading compressed disk images is broken on o3
* action #95030: [easy][beginner] Better, complete validation of parameters on /tests/overview
* action #95084: Create a data file with openQA API routes, parameters, docs
* action #95132: t/full-stack.t can take significantly longer than previously 90s, performance regression or environment specific slowness?
* action #95149: [easy][beginner] Contradicted timestamps are observed in the autoinst-log.txt.
* action #95263: [beginner] t/44-scripts.t times out in circleCI after 420s - skip coverage analysis in this test?
* action #95278: [easy][beginner] Making option to filter by job group(s) on /tests/overview more prominent
* action #95302: findings from SUSE QE Tools workshop 2021-07-09 "a glimpse into SUSE QE-Core review workflows"
* coordination #95371: Self Service/Self Paced Onboarding and training for openQA 
* action #95437: The "webui-docker-compose" CI check should fail if the package is impacted by the PR itself in a harmful way
* action #95533: [easy][beginner] try out code ref handling in python backend for production
* action #95536: Due dates on blocked tickets should be reset automatically
* action #95539: Schedule parameters in job templates
* action #95768: containers: the single_container_test shows this error "Permission denied" when tries to create the directory "/var/lib/openqa/share/factory/tmp"
* action #95821: Make qa-maintenance/openQABot a proper public open source project
* action #95878: Add filter on /tests/overview for search term in test suite description
* action #96095: Support filtering by modules if not build is specified
* action #96254: Tests timeout with MAX_SETUP_TIME - Add an alert if there is any non-restarted job exceeding max_setup_time
* coordination #96263: [epic] Exclude certain Minion tasks from "Too many Minion job failures alert" alert
* action #96404: [beginner] Better explain in docs the first step based on os-autoinst-distri-example
* action #96507: Job terminated prematurely during needle check auto_review:"isotovideo: backen.*: free.*: invalid pointer":retry
* action #96510: `job_groups/id` DELETE call can't really work
* action #96555: openQA does not match all areas in a needle as a whole and do not have mechanism to delay needle matching
* action #96635: Improve docs for OBS RSync plugin
* action #97028: openqa-clone-job: Pass id of cloned job as setting
* action #97037: [easy][beginner] Add User-Agent header to openqa-cli
* action #97109: openqa-review: Cache fetched urls
* action #97112: Support relative needle directories together with tests checked out from git
* action #97190: Limit size of initial requests everywhere, e.g. /, /tests, etc., over webUI and API
* action #97217: Report Product Bug from "Desktop" jobs always points to "Server" project
* action #97247: Monitoring alerts on errors in logs on openQA workers
* action #97454: Decide and implement predefined tags for the commit message checker
* action #97517: [virtualization][3rd party hypervisor][vmware] Executing command returns 'undef' value with assert_script_run after vm reboot
* action #97544: Monitoring alerts on errors in logs on osd
* coordination #98412: [epic] assets listing for job groups
* action #98562: Cancel jobs with invalid WORKER_CLASS after a timeout
* action #98628: [easy][beginner] $cmd_srv_port exceed 65535
* action #98631: Ensure all environment variables supported by openQA are documented
* action #98730: Check for pod2man
* action #99066: ci: Use a git commit message style checker in more repos
* action #99141: [easy][beginner] Provide ratio of tests by result in monitoring - by machine
* action #99258: openQA enables event-based cleanup out of the box
* coordination #99306: [epic] Future improvements: Make reviewing openQA results per squad easier
* action #99357: automatic retrigger when all four investigation jobs pass and the history shows only passed because no one will be able to reproduce such issues
* action #99378: openqa-clone-custom-git-refspec trigger a job with incorrect needles directory in remote worker.
* action #99393: Allow running asset cleanup without re-scan
* action #99399: openQA (or auto-review) can restart the parent job in case of certain incompletes
* action #99414: Ensure we eventually delete non-existing assets from the database
* action #99420: Asset cleanup takes very long to process 60k files in "other" - now for real!
* coordination #99549: [epic] Split production workload onto multiple hosts (focusing on OSD)
* coordination #99831: [epic] Better handle minion tasks failing with "Job terminated unexpectedly"
* action #99837: configurable exclusion rules for /influxdb/minion
* action #100599: Asset cleanup takes very long to process 60k files in "other" - too verbose logging, switch some debug to trace?
* coordination #100641: webhooks for OBS+openQA connection
* action #100676: obs-rsync failed to trigger tests after hitting "Bad gateway", manual retry helped
* action #100967: Use more perl signatures - openQA size:M
* coordination #101048: [epic] Investigate and fix higher instability of openqaworker-arm-4/5 vs. arm-1/2/3
* action #101274: openQABot pipeline failed with NewConnectionError
* action #101283: [easy][beginner] Retry if webUI times out connection yielding 408 response "Request timeout"
* action #101301: unhandled output in openQA test t/24-worker-jobs.t ""exceeded MAX_JOB_TIME" and "Found base_state.json but failed..."
* action #101376: Use cleanup triggers on finished jobs by default
* coordination #101382: [openqa][epic] update of assets in openQA 
* action #101385: [ux][ui][openqa] remove Bootstrap-tour or use another solution
* action #101457: Native per-module bug tags
* action #101463: Add ability to limit parallel/tap jobs to run on the same physical machine only
* action #101602: Research how to properly communicate these changes based on systemd files size:S
* action #101725: Improve text result preview font size in chromium based browsers
* action #102518: Document usual review workflows
* action #102521: Document how the KEEP_DB openQA development flag can be put as default into user sessions
* action #102524: Let openQA tests automatically spawn a test DB process if not already running
* action #102551: [easy][beginner] api/v1/jobs/overview returns wrong jobs, if a nonexisting job_group was given
* action #102590: openqa_review: pypi publishing based on every git commit in master, not just tags (was: Uploading to pypi stopped, also no git tags any more after 1.25.0)
* action #102671: Improve our user acquisition with https://github.com/readme/guides/user-acquisition
* action #102719: Consolidate build-bar link targets, e.g. for "failed" should show the same number as in the build bar
* coordination #102861: [saga][epic] Improved openQA for multi-user environments
* coordination #102864: [epic] Inform openQA webUI users about potential worker class mismatch or long delays
* coordination #102906: [saga][epic] Increased stability of tests with less "known failures", known incompletes handled automatically within openQA
* coordination #102909: [epic] Prevent more incompletes already within os-autoinst or openQA
* coordination #102912: [epic] Simplify investigation of job failures - 2nd
* coordination #102915: [saga][epic] Automated classification of failures
* action #103011: openQA "investigation" shows "fatal: Invalid revision range" when called on custom git repos
* action #103035: Present changes between packages on openQA worker machines in "investigation" - enable in production on o3
* coordination #103122: [epic] Test distribution template for openQA tests to use, e.g. for automatic PR tests in os-autoinst-distri-openQA
* action #103125: compile tests in os-autoinst-distri-openQA defined in template project size:S
* action #103203: openqa.opensuse.org consistently fails to boot from vmdk disk images
* action #103317: No time visible in scheduled jobs
* action #103455: Automatic bisecting of aggregate update test failures
* action #103557: Aggregate different versions into the same build openqa in group_overview pages
* action #103715: Add pause on command failure in developer mode
* action #103768: Auto restart job of incomplete job is invisible in AMQP events
* action #103771: Retry on rsync errors like "exit code 5" instead of failing the job (which then retriggers)
* coordination #103938: [saga][epic] Scale up: Efficient handling of large storage on o3
* coordination #103941: [saga][epic] Scale up: Efficient, event-based handling of storage on new, clean instances
* coordination #103944: [saga][epic] Scale up: More robust handling of diverse infrastructure with varying performance
* coordination #103950: [saga][epic] Scale up: Efficient handling of large storage for multiple independant projects and products
* action #104013: [easy][beginner] Have consistent labels and numbers on /admin/workers
* action #104241: Retrigger the original/initial job chain after parts have been retriggered
* action #104520: Move svirt extract_asset code from os-autoinst-distri-opensuse to os-autoinst/backend/svirt.pm size:M auto_review:"unable to extract assets: Can't call method.+name.+on an undefined value":retry
* action #104610: admin/needles usability issues
* action #104622: Provide copy-able text output for failures in openqa_from_containers tests 
* action #104631: [easy][beginner] WebUI: No error message when putting invalid characters in machines/testsuites settings
* action #104778: Expand ticket references in label description strings to URLs
* action #105118: Combine builds for multiple versions depending on configuration
* coordination #105142: [epic] More statistics in job results
* action #105408: dashboard.qam.suse.de - add list for failures of test modules
* action #105515: Optionally keep pool dir content for debugging os-autoinst + openQA full stack tests
* coordination #105624: [saga][epic] Reconsider how openQA handles secrets
* action #105771: During Live view sometimes no results of a finished module are shown
* action #105819: Renew personal github token for os-autoinst-obs-workflow
* action #105855: [easy][beginner] openqa-worker@.service should handle NTP unavailability gracefully
* action #105900: o3 logreports - Unable to wakeup scheduler: Request timeout
* action #105903: o3 logreports - Publishing opensuse.openqa.job.restart failed: Connect timeout (9 attempts left)
* action #105915: o3 logreports - Needle file <filename>.json not found within /var/.../opensuse/needles
* action #105918: o3 logreports - fatal: Invalid revision range sha1..sha2
* action #105921: o3 logreports - Cannot read symbolic link (/opt/openqa-trigger-from-obs/.../.run_last): No such file or directory
* action #105930: o3 logreports - empty warnings/errors
* action #106056: [virtualization][tools] Improve retry behaviour and connection error handling in backend::ipmi (was: "Fail to connect openqaipmi5-sp.qa.suse.de on our osd environment") size:M
* action #106613: o3 logreports DBIx::Class::Row::update(): Can't update OpenQA::Schema::Result::JobLocks row not found
* action #106663: https://openqa.suse.de/parent_group_overview/15#grouped_by_build shows wild mixture of version-prefixed and not-prefixed builds
* action #106685: Test using svirt backend incomplete with auto_review:"Error connecting to VNC server.*: IO::Socket::INET: connect: Connection timed out":retry
* action #106762: Prevent proxy timeout errors on `isos post` requests that take too long
* action #106957: [tools][tw][aarch64][QEMUTPM][tpm2.0] on some O3 arm workers, swtpm 2.0 device can't be created [or created failed] 
* action #106966: [easy][beginner] Consistent key labels in investigation tab + coloring diff
* action #107155: [tools][tw][sle][QEMUTPM][tpm2.0] swtpm devices need to be clear once test done
* action #107239: It's possible to delete force_result comments
* action #107719: o3 logreports - Could not render a response
* action #108001: [doc][ux][ui] Make it more obvious what "important jobs" are and how one can make jobs important (was: Important tags don't seem to have any effect)
* action #108052: Consistently handle results between retry runs
* coordination #108209: [epic] Reduce load on OSD
* action #108503: Collect and prominently display warnings from autoinst.log
* action #108515: [qe-tools] Incorrect vncviewer hostname shown in developer mode prompt
* coordination #108527: [epic] os-autoinst wheels for scalable code reuse of helper functions and segmented test distributions
* action #108554: [ux][ui] Wrong formatting on some links in single quotes includes trailing quotes to the link
* action #108575: [sporadic] os-autoinst: t/18-qemu-options.t fails with "Fatal error in command `/usr/bin/chattr.*No such file or directory "
* action #108980: Better handle minion tasks failing with "Job terminated unexpectedly" - OpenQA::Task::Asset::Download
* action #108983: Better handle minion tasks failing with "Job terminated unexpectedly" - OpenQA::Task::Iso::Schedule
* action #108989: Better handle minion tasks failing with "Job terminated unexpectedly" - OpenQA::Task::Needle
* action #109190: Invalid reusage of VLAN-Tag in multi-machine scenario, when using job posts
* action #109560: Add openqa-cli sub-command for async scheduling and keeping track of the result
* coordination #109647: [epic] Future improvements: Simpler investigation of openQA test failures
* action #109650: [tools][spike] Can we change or display job group structure for maintenance job groups to have one job group per team like for product validation and maybe specific products and versions below size:M
* action #109653: Add filter on /tests/overview for search term in test suite description
* coordination #109659: [epic] More remote workers
* action #109929: Snapshot rollback after SUT reboot breaks console switching
* coordination #109968: [epic] fully containerized openQA on SLE microOS
* action #109974: qem-bot/dashboard - mixed old and new incidents - potential future ideas
* action #110077: misleading error when entering wrong product into job group settings 
* action #110085: Always copy test data to temporary directories during tests to avoid having to cleanup manually
* action #110227: Stop showing ipmi passwords in autoinst.txt from a ipmi backend job in O3
* action #110229: [tools][qemu] Managing device boot order with bootindex
* coordination #110458: [epic] Improve `RETRY=…`-behavior for jobs with dependencies
* action #110632: Capture stderr of job_done_hooks as well
* action #110725: Unexpected behavior for cache service under k3s when the CACHE_MIN_FREE_PERCENTAGE is set size:M
* action #110794: Applying carry-over retroactively
* action #110824: The live view does not work for directly chained jobs 
* coordination #110833: [saga][epic] Scale up: openQA can handle a schedule of 100k jobs with 1k worker instances
* action #111060: Comment events in audit log do not have links
* coordination #111072: [epic] Extend filtering on /tests and /tests/overview
* action #111135: Enhance email notification message content for about failed and unreviewed jobs 
* action #111234: Add version to job group display
* action #111314: _SECRET_ variables are exposed in vars.json when the job is not completed
* action #111377: Continuous deployment of osd workers - similar as on o3 size:M
* action #111908: Multimachine failures between multiple physical workers
* coordination #111929: [epic] Stable multi-machine tests covering multiple physical workers
* action #112001: [timeboxed:20h][spike solution] Pin multi-machine cluster jobs to same openQA worker host based on configuration
* action #112226: [sporadic] swtpm socket not found anymore after loading from snapshot size:M
* action #112256: Some children of parent job not cancelled (or later, restarted) when parent `parallel_failed` due to another child's parallel job failing
* action #112319: Better and earlier checks of test code against "wrong API usage"
* action #112322: Scheduled product should work for cloned jobs
* action #112325: Original job group should be visible in cloned jobs
* action #112337: [ui/ux][easy] OpenQA admin UI: Link to last match of a needle points to invalid URL size:M
* action #112349: Provide an option to always clone the latest version of the scenario run by the job
* action #112742: [tools] aarch64 - qemu-img: /var/lib/openqa/pool/14/raid/hd0-overlay0: Image is not in qcow2 format
* action #112748: Jobs are started despite their chained parent job ran into a timeout
* coordination #112862: [saga][epic] Future ideas for easy multi-machine handling: MM-tests as first-class citizens
* action #112868: Helpful instructions to prevent incomplete cluster restarts
* action #112874: Jobs stuck in assigned, worker reports to be "currently stopping" for > 21h
* action #112903: carried over bugref+label comment undeleteable
* action #112949: Exercise to switch off non-critical features and conduct emergency drills
* coordination #112961: [epic] Followup to "openqa.suse.de is not reachable anymore, response times > 30s, multiple alerts over the weekend"
* action #113078: no investigation job triggered for one case, not even "retry" job?
* action #113240: openqa-worker@.service returns 0 even when it fails to start
* action #113402: Handle error messages in existing helm chart CI test logs
* action #113408: bot-ng trigger test two times for incidents 
* action #113432: Changing filters on /tests/overview queries having multiple flavors selected looses all flavors but one
* action #113441: Try to mitigate "VNC typing issues" with disabled key repeat in linux tty's of qemu tests
* action #113468: hotkeys for jumping over thumbnails in the openQA "left" and "right" seem to be invoked twice when job page was open since the job was in "scheduled" or "running"
* action #113495: [ui/ux] Priority display improvement suggestion
* action #113614: [timeboxed:20h] [spike] Add openQA API for computing diff of executed test modules
* action #113710: https://build.opensuse.org/package/show/devel:openQA/os-autoinst_dev and other packages should be triggered whenever git updates
* action #113758: Jobs restarted with `RETRY` are not shown as 'clones', so it is hard or impossible find the original job
* action #113761: jobs restarted with `RETRY` have a comment, so the build gets the grey "commented" 'badge' if all failed jobs were retried
* action #114454: Improve error message when HDD_1 is empty
* action #114466: [qe-core] test fails in postgresql_server - serial console is unstable under certain conditions
* action #114529: RabbitMQ: Wrong id type for restart events
* action #114643: Add support for virtio keyboard and mouse on aarch64 QEMU
* action #114769: Have jobs fail if screen checks take too long, e.g. if there are "two many needles" after warning about it
* action #114826: tests/overview page overview may display outdated builds in certain cases
* action #114899: pyyaml update
* action #115001: Add documentation how to use/develop wheels visible on open.qa/docs
* action #115004: Use github.com/os-autoinst/os-autoinst-wheel-launcher in os-autoinst-distri-opensuse as well
* action #115013: os-autoinst-plugin as a wheel helper tool
* action #115016: Conduct a workshop to introduce wheels and discuss how to go forward
* action #115019: os-autoinst/wheel-boot which can be used to test os-autoinst/wheel-launcher size:M
* action #115283: Handle a NEEDLES_DIR that contain a trailing / correctly
* action #116251: Missing traceback in when no needle matches
* action #116608: Support no_wait in send_key_until_needlematch as well
* action #116971: Migrate from OpenID to OpenID Connect for authentication
* coordination #117097: Evaluate GitHub template repositories for wheels
* action #117256: Run a command in the serial terminal producing a clear output
* action #117355: the description of "--skip-deps" from openqa-clone-job command is not exact
* action #117550: developer mode over ssh bridge "thinks" we are in a "developer setup" needing second port forwarded
* coordination #117673: [epic][tools] sporadic "Unable to clone Git repository" for wheels
* action #118183: Allow openSUSE.QA.Maint pipeline to look for "build present"
* action #118660: Basic terraform recipe to replace OSD w/ workers (in the cloud) size:M
* action #118882: Make available wheels more discoverable and share knowledge size:S
* action #118894: API Key expiration date has a weird lower bound
* action #118903: Repositories for wheels should be cached
* action #119200: openQA barfs on very long POST requests (>8190 chars)
* action #119356: openqa.opensuse.org login was again redirecting to wrong page due to our javascript code conducting DoS attacks
* action #119371: [darkmode] Search results are bright white
* action #119374: [darkmode] Various tables have broken borders
* action #119425: Support multi-machine testing with NetworkManager
* action #119428: Ensure users can get all the data for limited queries, e.g. with pagination
* action #119431: Inform users e.g. in the webUI if not all results are returned size:M
* action #119563: [darkmode] Update obs_rsync
* action #119770: Show test progress/status during initialization in web UI
* action #120118: Provide job settings filter options
* action #120336: Improve scalability of assets listing (API route) size:M
* action #120741: Another try at an openQA wikipedia page
* action #120793: Improve restarting behavior when (dependend) jobs have already been restarted
* action #120843: [sporadic] Codecov upload errors for branches other than master - github <--> codecov api 404
* action #121099: Add pagination for GET /api/v1/jobs/<job_id:num>/comments
* action #121111: Add pagination for GET /api/v1/job_templates
* action #121114: Add pagination for GET /api/v1/job_settings/jobs
* action #121117: Add pagination for GET /experimental/search
* action #121354: Implement purely text based needles
* action #121378: load_templates sometimes fails with "unknown error code", then works after a while
* action #121573: Asset/HDD goes missing while job is running
* action #121579: Logs of openqa-worker-cacheservice-minion are incomplete and inconsistent
* coordination #121723: [saga][epic] Scale out: Future uses of on-premise cloud or public cloud
* action #121774: LTP cgroup test appears to crash OpenQA worker instance
* action #121897: Some log files not shown on assets page
* action #122296: Fix openqa-trigger-bisect-jobs to actually remove incidents from bisection tests again
* action #122299: openQA worker should fail with explicit error message if multi-machine test is triggered but requirements are not fulfilled
* action #122524: Request for job started RabbitMQ message
* coordination #122665: [epic] Improved PowerVM testing
* action #122749: Censor RabbitMQ credentials in log messages
* action #122791: New PostgreSQL query deadlock on assets table
* action #122959: Add pagination for /api/v1/jobs with latest=1 feature active
* action #123175: o3 fails to download images resulting in zero sized disk images/isos
* action #123625: No event emitted for jobs restarted via `RETRY`, jobs cancelled via `_job_stop_cluster`, and other cases
* action #123664: os-autoinst does not flush serial console buffer on snapshot reload
* action #123972: s390x tests fail to log into VNC console on worker2 due to already present VM with same mac address, check within backend
* action #124161: [vmware][esxi] Frequent websocket connection establishing will cause sending key no response
* coordination #124394: [epic] openqa-clone-job should check for missing assets when explicitly selected by option or by default on "--within-instance"
* action #124487: [openqa_logwarn] Can't call method "BUILD" on an undefined value at /usr/share/openqa/script/../lib/OpenQA/WebAPI/Plugin/AMQP.pm
* action #125102: Support multi machine when triggering job use 'isos post'
* action #125138: Pick color-blindness friendly colors for the needle editor
* action #125300: Support creating demo videos with pauses and mouse moving
* coordination #125708: [epic] Future ideas for more stable non-qemu backends
* action #125990: Allow client-side validation of YAML files posted via `openqa-cli`
* action #126062: Implement gradual mouse motions as an option
* action #126065: Provide an easy way to slow down test interaction around needle matches
* action #126800: Add keyboard shortcuts on the openqa job page
* action #126935: Promote /experimental/jobs/.../status as non-experimental API
* action #126938: [spike] Simple load-balancing proxy for select API routes
* action #127016: Duplicate auto_review comments
* coordination #127040: [epic] Scale out: Easier and automated disaster recovery deployments of openQA
* action #127046: t: os-autoinst - qemu keeps running when test runs into timelimit size:M
* action #127238: It's not possible to remove own force_result comments, and they are carried over
* action #127265: Add timestamp to influxdb openqa_download_rate size:M
* action #127331: Extend os-autoinst autotest::loadtest doc string to cover python
* action #127538: Provide version less container paths as default for openQA containers
* action #127568: Openqa log can not show detail syntax error
* action #127739: ASSET_1 gets outdated value when using openqa-clone-custom-git-refspec
* action #127868: [qaaas] openQA test results should be archived and not tampered size:M
* coordination #128156: [epic] Support filtering/grouping/searching of settings by domain
* coordination #128366: [epic] further improvement after we did ensure all our database tables accomodate enough data
* action #128423: [gsoc] Container-based backend for openQA
* coordination #128426: [epic] openQA test harness to execute playwright tests
* coordination #128429: [saga][epic] Accessibility improvements in openQA
* coordination #128435: [epic] openQA darkmode
* action #128936: API endpoint /api/v1/jobs/:jobid/set_done can be very slow
* action #129172: PXEBOOT doesnt set bootindex on aarch64
* action #129307: Prominently present the presence of failed minion jobs to openQA admins
* coordination #129313: [epic] openQA on ALP
* action #129406: Add dry-run for space aware cleanup
* action #129409: space aware cleanup: Configuration switch to enable/disable cleanup of important results
* action #129481: Try to *reduce* number of apache workers to limit concurrent requests causing high CPU usage
* action #129673: Change the default of the video encoder options in os-autoinst
* coordination #130129: [qe-core] Document qe-core onboarding and training path
* action #130381: tracker for https://github.com/os-autoinst/openQA/issues/5180 "Stop displaying the latest image in 'Live View' after qemu has stopped" size:M
* coordination #130414: [epic] Improved code coverage in os-autoinst
* action #130417: Improved code coverage in os-autoinst - consoles
* action #130420: Improved code coverage in os-autoinst - testapi
* action #130423: Improved code coverage in os-autoinst - all the rest
* coordination #130655: [epic] Notifications for users with ntfy.sh
* coordination #130694: Easily add jobs or builds to the Activity View
* action #131450: [openQA-in-openQA] test fails in openqa_webui due to missing characters in typing size:M
* action #131471: Leftover worker temporary directories in /tmp on OSD and O3 size:M
* action #131516: Consider creating a separate tmp dir filesystem, e.g. tmpfs?
* action #132161: Improve performance of openQA's workers table
* action #132395:  Current openQA+os-autoinst+dependencies are updated automatically in SLE+packagehub
* action #132455: No notification for failed minion hook scripts
* action #132458: Fix documentation ambiguity about openQA-worker installation on SLE
* action #132899: API parameter `page` does nothing
* action #132938: Allow inheritance in python test modules
* action #132941: Minion hook script can't delete job comments
* action #133112: Switch unit tests to Test2-Suite
* action #133238: Cannot add columns to the jobs table due to 92->93 migration logic
* action #133319: Backend dies when passing russian letters to the 'type_string' function
* action #133472: Pentesting of o3
* action #133613: Support for passing non-US-keyboard letters to the 'type_string' function size:M
* action #133901: [ o3 logreport] DBD::Pg::st execute failed: ERROR:  invalid input syntax for type bigint: "1'"
* action #134255: hook scripts called twice for incomplete jobs
* action #134840: Show that an openQA job is busy in the early state of running instead of empty live view and log
* action #134897: The "Scheduled product settings" windows is too small to show the detailed info.
* action #134924: Websocket server overloaded, affected worker slots shown as "broken" with graceful disconnect in workers table
* action #135089: Persistent setup of huge pages for aarch64 openQA workers
* action #135353: openqa-investigate on demand
* action #135356: openqa-trigger-bisect-jobs skips bisecting tests with only one incident
* action #135644: Long job age and jobs not executed for long - malbec not working on jobs since 2023-09-13 - scheduler reserving slots for multi-machine clusters which never come
* action #135782: auto-review+force-result ticket does not seem to have an effect when issue tracker changed after the initial comment when carry-over is effective
* action #135824: Add 'open raw' and 'clipboard copy' to openqa text screenshots
* action #135929: Misleading UI when looking at a parent/child job that have been cancelled
* action #136127: Implement record warning feature similar to record softfail
* action #136226: os-autoinst IPMI backend incorrectly handle empty return value
* action #136232: os-autoinst IPMI backend need dell_sleep whenever ipmitool command successfully or not 
* action #136961: Lower timeouts for HTTP requests from scheduler to websocket
* action #137132: Link from scheduled job settings to possible workers
* action #137240: Extend "search" feature by looking up test results aka finished jobs
* action #137243: Allow "search" feature to include or exclude types of results like code or job groups
* action #137441: Timestamps to the screenshots in openQA result list to relate to log files
* action #137840: Implement automation to ensure templates are used
* action #138263: Strip unneeded code from os-autoinst-setup-multi-machine
* action #138653: Ensure our handling of "secrets", i.e. _SECRET variables, is documented
* coordination #139010: [epic] Long OSD ppc64le job queue
* action #150944: Consider showing the investigation tab for "parallel_failed" as well
* action #151249: Cover changed code in PRs on github.com/os-autoinst/os-autoinst-distri-opensuse with openQA test runs
* coordination #151513: [epic] Provide more flexible openQA worker + general hypervisor setup
* action #152278: [qe-core] Create a benchmark for workers to understand how a worker's performance
* action #152737: Support for triggering parallel (multi-machine-)tests within a configured zone or location
* action #152849: RISC-V testing on openqa.o.o
* action #152851: Notify about reproducible *infrastructure* issues using openqa-investigate
* action #153013: [openQA][repo][error] openQA instance keeps reporting "dubious ownership" error when test run starts
* action #153111: [openQA][console][ipmi][sol] xterm process quits and ipmi sol console crashes
* action #153304: The wait_serial in script_run on a serial console fails for very long commands
* action #153460: schedule boot_to_desktop and the test module(s) changed if the change is on tests/ in os-autoinst-distri-opensuse
* action #153574: [epic] UML and doxygen-like design documentation for os-autoinst
* action #153610: [sporadic] Unstable OBS checks in devel:openQA/os-autoinst on aarch64
* action #153922: Adding filter options like "Include job groups" in multi-job-group-id filtered view removes all job groups by one
* action #154027: [UI][UX] Allow to search for tests by comment on the UI in /tests
* action #154036: Allow to search for comments or tests by comment in the UI "search" bar
* action #154063: [tools] Provide a template for tickets that includes commonly required details
* action #154381: Support selecting and copying text from webui popups
* action #154639: Need to find a way to early failure of tests which will anyway due to some infra issues
* coordination #154768: [saga][ux] State-of-art user experience for openQA
* coordination #154771: [epic] Improved test developer user experience
* coordination #154777: [saga][epic] Shareable os-autoinst and test distribution plugins
* action #154798: Batch update for jobs
* action #155065: Unify GitHub Actions for QA Projects - use as many common static checks within all os-autoinst repos as possible
* action #155086: Install and enable Redmine Issue Templates on Progress
* action #155188: Unify GitHub Actions for QA Projects - perltidy&perlcritic in openQA
* action #155191: Unify GitHub Actions for QA Projects - perlcritic in os-autoinst
* coordination #155215: [epic] Fan-in openQA test results to trigger IBS comments and other events
* action #155398: Be able to filter out groupless jobs from API (and UI) queries
* action #155473: Avoid the need for API keys within the same container/client
* coordination #155485: [saga][epic] Efficient openQA worker pool resource handling in datacenters
* coordination #155488: [epic] openQA can dynamically power off/on available machines based on scheduler needs
* action #155557: Implement visitor analytics for openQA
* coordination #155608: [epic] Gnome openQA Wishlist
* action #155731: [brainstorm] Be more robust about spurious errors
* action #155767: Job groups managed in git should not be editable via the web UI
* action #155770: What or who cloned a job should be visible in the web UI
* action #156247: [openqa-in-openqa] VM in "install/prepare" only shows black screen
* action #156547: A single API route to show all not-ok tests blocking a SLE maintenance incident size:M
* action #156553: [timeboxed:10h][spike solution] openQA webUI search view to show all tests blocking an incident by squad - take 2
* coordination #156631: [epic] Generic, retroactive tags
* action #156697: Make test variables traceable
* action #156859: Improve most used testapi functions
* action #156862: Consider removing/reworking least used testapi functions
* coordination #157144: [epic] Groups of worker classes: Regions, locations, etc.
* action #157171: Track version in last match/seen needle statistics
* action #157231: Show version of candidate needles the test ran on in the "diff view" on the test details page - all the rest
* action #157282: [tools] openQA seems show wrong VNC access infromation in developer mode for NON-QEMU backend setups
* coordination #157345: [epic] Improved test reviewer user experience
* coordination #157510: [epic] Up-to-date JavaScript stack
* action #157660: A single webUI search view to show all not-ok tests blocking a SLE maintenance incident size:M
* coordination #157669: websockets+scheduler improvements
* action #157675: Optimize openqa-scheduler database queries, e.g. "SELECT value FROM worker_properties..."
* action #157681: Profiling using NYTProf for openqa-websockets and openqa-scheduler
* action #157684: cycle execution health check in openqa-scheduler
* action #157690: Simple global limit of registered/online workers
* action #157870: this is just a test - please ignore
* coordination #158110: [epic] Prevent worker overload
* action #158143: Make workers unassign/reject/incomplete jobs when across-host multimachine setup is requested but not available
* coordination #158167: [epic] Increase worker capacity
* action #158511: Try to optimize the startup time of isotovideo more
* action #158811: Add an automated way to install testsuite dependencies on the worker
* coordination #158847: [epic] Automated handling of test requirements, e.g. packages
* action #158859: SyntaxError: Unexpected token '<', " when searching for "- {}" in the web UI
* coordination #159294: [epic] AI chat prompt in openQA to query for test result
* action #159297: openQA test result queries based on human language requests
* coordination #159300: [saga] AI integration with openQA
* coordination #159564: [epic] Efficient use of currently available hardware ressources
* coordination #159570: [epic] Better integration with other tooling
* action #159621: Make tests work with native openQA worker s390x qemu size:M
* action #159642: Be explicit about asset name collission or precedence
* action #159783: Changes to queries.yaml in backlog status PRs are not reflected in the preview
* action #8402: performance run does automated reboots we need to catch
* action #9490: Make the Sikuli test cases possible running inside openQA
* action #9502: [opensuse][sle][functional][u][hard]Salt multi-machine test
* coordination #9576: [epic][opensuse][sle][functional][y] VNC+SSH Installations
* action #9670: [opensuse][sle][functional]udev testing
* action #9900: [sle][functional][hard][opensuse][y] nis+autofs
* action #10092: When Creating Disk Image, write some metadata before uploading
* action #10132: [functional][u] "wait_screen_change" return value should not be silently ignored
* action #10308: windows 10 secure boot
* action #11518: [sle] Mark used SLE SCC Codes
* action #12204: [functional][u] Test RDP connection including password change
* action #12670: [functional][u] Call more external tools in openQA context (e.g. susetest, avocado, …)
* action #12804: [qe-core][functional][sles][opensuse][installation] Do more easy to debug tests by using chroot installations … or containers :)
* coordination #13040: [functional][epic][u]more flexible console test selection by addons, testsuite variable, etc. (was: Run zypper lifecycle more selectively)
* action #13166: [opensuse]xdg-utils tests to verify application launching
* action #13170: [qam] Mysql/Mariadb odbc integration tests
* action #13246: [opensuse]Add tests for Live-DVD Installer
* action #13304: [sle][functional][u][opensuse][medium] Check plymouth splash screen is not interrupted by ugly console output if 'quiet'
* action #13914: [qe-core][functional][ipmi] wait_serial does not get expected output because ipmi console connection is closed 
* coordination #15132: [saga][epic] Better structure of test plans in main.pm
* action #15136: [functional][hard][yast][y] network installations over SMB
* action #15700: [LTP][OpenQA] ima,tpm: need TPM
* action #19398: [functional][y] Handle console messages covering ncurses dialogs (was: Remove "console=tty" boot option for installed system)
* action #19568: [functional][aarch64][u] kdump_and_crash on aarch64
* action #19872: [sle][functional][y] Create function/method for type_string and wait_still_screen or sleep
* coordination #20136: [sle][packagehub][opensuse][epic] packagehub testing
* action #23564: [sle][functional][smt][y][medium] smt test for SLE15 does not do anything with SMT (was: fails in addon_products_sle - need to adapt workflow for SMT scenario)
* coordination #23798: [qe-core][sles][functional][epic] Add systemd test suite execution to openQA
* action #23802: [functional][u] Include zypper logs when a test module involves calling zypper (or pkgcon, etc.)
* action #25210: [sle][functional] Add test suite patched_systemd
* coordination #25244: [epic][functional][u]systemd testsuite executed on development time for systemd department
* action #25546: openQA does not work very well with blue screen by 64bit-ipmi Backend
* action #26092: [functional][tw][u][medium]new test for npapi plugins using epiphany (was: firefox_java no longer applicable on Tumbleweed)
* coordination #26382: [sle][functional][y][epic] add test to install from repomd
* action #26984: [sle][functional][y] New test scenario: minimal+proxy_SCC-postreg_yast_scc
* action #27004: [opensuse][sle][functional][yast][y][hard] yast2 gui modules fail to start in the defined time frame
* action #27826: [functional][opensuse][u] Prepare simple ON/OFF test for Bluetooth in Tumbleweed
* action #28982: [containers] Run system container tests
* coordination #29042: [sle][functional][y][saga] offline installation
* action #29730: [sle][functional][u][medium] New test suite create_hdd_gnome+all_patterns
* coordination #29733: [epic][functional][u] Test suites that use "all patterns" boot from created qcow2 image
* action #29945: [sle][functional][y][easy] Check releasenotes_origin on s390x
* action #30391: [functional][u][userspace] php7 testsuite need a update
* coordination #30580: [sle][functional][u][epic]Test for keyboard layout switching
* coordination #31426: [sle][functional][u][epic] extend tests for icewm regarding raspberry pi scenario (was: extend tests for icewm a bit)
* action #31882: [qac][wicked] Set up dynamic routes from legacy ifcfg files
* action #32068: [sle][functional][u]icewm - reboot and shutdown test
* action #32074: [sle][functional][icewm][raspi][easy][u] Check basic desktop behavior
* action #32080: [sle][functional][icewm][raspi][easy][u] Check basic widget behavior
* action #32086: [sle][functional][u][icewm][raspi][easy] Check that boot/start works as expected
* action #33184: [sle][functional][12sp4][u]test fails in docker - needs to add container module / how do we want to execute extra tests that rely on a registered image for SLE12?
* action #33274: [functional][y] Reproduce bsc#1017558 "Cannot view timestamp of read-only snapshots in GRUB as names truncated"
* coordination #33862: [sles][functional][epic][s390x][yast][y] Review and extend test coverage of YaST2 modules on s390x 
* action #34012: [kernel] too generic test failure in "execute_test_run" for stress tests, was previously something more specific like "acceptance_fs_stress"
* coordination #34102: [functional][y][epic] improve openqa/scripts
* coordination #34105: [sle][functional][y][epic] offline installation - SLE test with flaky network, e.g. registration fine, then network outages in between
* coordination #34138: [functional][u][epic][eternal] work on any issue from http://github.com/os-autoinst/openqa_review/issues/
* action #34336: [sle][functional][u] test fails in salt - Not enough memory on arm: 1GiB
* action #34339: [qe-core][sle][functional][medium] test fails in consoletest_setup - generic text login matching too early, causing mistyping -- was " login prompt not ready to type - missing keys while typing login"
* action #34699: [qe-core][functional][ipmi] access to serial log during installation
* coordination #34843: [qe-core][functional][tools][desktop][saga][ipmi] Notebook hardware testing
* coordination #34996: [qe-core][functional][opensuse][epic] test fails in systemd_testsuite - TEST-16-EXTEND-TIMEOUT works only when executed against systemd built in the same specfile
* coordination #35032: [functional][opensuse][epic][y] Make snapper tests easier to maintain
* action #35038: [qe-core][sle][functional][hyperv] extra tests on hyperv
* action #35401: [functional][sle][u] dns_srv: Improve test coverage by changing deprecated 'hostname' with 'dig'
* action #35524: [functional][u][sporadic][medium] test fails in snapper_cleanup because of "config is in use" - should we wait in subsequent snapper calls for the previous to finish?
* action #35574: [sle][functional][u][xen][hard] test fails in user_defined_snapshot - interact with grub2 in the serial console
* action #35595: [sle][functional][y] Inconsistency between job setting and vars.json
* action #35641: [sle][functional][u][sporadic][mistyping] test fails in svirt_upload_assets - unchanged PS1
* action #35877: [functional][u] Find out in post-fail-hook if system is I/O-busy
* coordination #36021: [functional][u][epic] add test to verify default packages
* action #36132: [functional][u] test fails in updates_packagekit_kde on trying to call krunner but ending up renaming icons "alt" from "alt-f2" was ignored
* action #36241: [qe-core][functional][medium] test fails in NM_wpa2_enterprise - shows certificate selection screen where only pull down menu is expected
* action #36259: [opensuse][functional][u][wayland][sporadic] stabilize scenario
* action #36280: [sle][functional][y][medium] test fails in snapper_undochange - console screen is not clear and it leads to problem with needle match
* action #36313: [qe-core][sle][opensuse][qem] enhance update_packagekit tests
* action #36541: [opensuse][aarch64] Leap 15.0 and Tumbleweed tests are not the same
* action #36562: [qe-core][functional] OBS package build environment test, e.g. using "osc co; osc build"
* action #36649: [sle][functional][u] test fails in consoletest_finish - exit doesn't work
* action #36739: [functional][y][smt] SMT server needs to be updated. Mirror for SLES15-Updates and SLES15-Pool is missing
* action #36754: [qe-core][functional][systemd][medium] test fails in systemd_testsuite - needs further investigation
* coordination #36778: [functional][u][y][epic] improve openqa triggering mechanisms, standardize OBS/IBS deliverables structure, trigger jobs using other means
* action #36844: [functional][sle][y] Schedule new filesystem test suites for SLE
* action #37084: [functional][u] test fails in reboot_gnome because it accepts empty user selections
* coordination #37315: [sle][functional][s390x][yast][y] Review and extend test coverage of YaST2 modules on s390x  - epic end tracker
* coordination #37339: [qe-core][functional][saga][ipmi] Stable testing on IPMI backend including x11 tests
* action #37366: [opensuse][functional][u] test fails in setup_zdup after reached target Multi-User System when booting
* action #37426: [functional][y] Support Media2/Media3 in scc-qa-proxy
* action #37429: [functional][y] Improve openqa_review to include skipped tests into the report
* action #37432: [functional][u] work on https://github.com/os-autoinst/openqa_review/projects/1 according to ordering
* action #37447: [functional][y][medium] improve openqa/scripts - Replace openqa/scripts by an open source solution (or open source itself)
* action #37507: [opensuse] extend gimp test module
* action #37558: [opensuse][functional][u] test fails in systemsettings5 - send_key issue for closing application
* action #37710: [functional][y][fast] test fails in yast2_tftp
* action #37728: [functional][sle][u] Make the patch 0001-test-catalog-fix-catalog-source-directory acceptable for openSUSE Factory
* action #37731: [functional][sle][u] Make the patch 0002-testsuite-fix-test-keymap-test acceptable for openSUSE Factory
* action #37734: [functional][sle][u] Make the patch 0003-udev-test-textual-group-id-has-group-disk-on-SUSE acceptable for openSUSE Factory
* action #37737: [functional][sle][u] Make the patch 0004-sysv-generator-test-multiple-LSB-macro-deps-add-Want acceptable for openSUSE Factory
* action #37740: [functional][sle][u] Make the patch 0005-TEST-07-fix-directories acceptable for openSUSE Factory
* action #37743: [functional][sle][u] Make the patch 0006-test-functions-adapt-for-QA-package acceptable for openSUSE Factory
* action #37746: [functional][sle][u] Make the patch 0007-test-watchdog-include-pre-timeout-in-timeout-setting acceptable for openSUSE Factory
* action #37749: [functional][sle][u] Make the patch 0008-TEST-08-set-rootfs-to-btrfs acceptable for openSUSE Factory
* action #37752: [functional][sle][u] Make the patch 0009-TEST_13-systemd-nspawn-needs-to-bind-lib64 acceptable for openSUSE Factory
* action #37755: [functional][sle][u] Make the patch 0010-TEST-13-fix-testcontainer-setup acceptable for openSUSE Factory
* action #37758: [functional][sle][u] Make the patch 0011-TEST-21-adapt-sysuser-to-SUSE-settings acceptable for openSUSE Factory
* action #37761: [functional][sle][u] Package systemd-qa-testsuite have to be built within systemd OBS package
* action #37782: [kernel][functional][u][medium] test fails in execute_test_run because it cannot handle broken pipes
* action #37785: [functional][s390x][u] test fails in start_install - maybe disable stall detection?
* action #37835: [functional][u] test fails in snapper_thin_lvm as vgcreate called but not available
* action #37904: [sle][functional][y] test fails in welcome - gui display issue and inst-welcome cannot be matched.
* action #37949: [functional][u] Validate /var/log consistency
* action #38198: [sle][functional][u] test fails in updates_packagekit_gpk - root console is not ready
* action #38270: [functional][y][sporadic][aarch64] test fails in yast2_i - missing keys while searching for a package name
* action #38288: [functional][u][sporadic][aarch64] - test fails in vim module - missing 'Enter' key on quitting vim
* action #38291: [functional][u][sporadic][aarch64] - Wrong timeout is set in 'disable_grub_timeout', that leads to fail in 'grub_test' module
* action #38294: [functional][y][sporadic][aarch64] - test fails in yast2_lan_restart_devices - missed 'alt-n' key
* action #38441: [functional][y][bsc#1000947] Perform media check for USB drives
* action #38588: [functional][sle][y] test fails in yast2_http - test FQDN hostname, localhost and ip
* action #38882: [functional][y] Implement yast2 hostname test using qt with YCP
* action #38888: [functional][sle][u][sporadic][ipmi] test fails in boot_from_pxe - SOL misbehave booting drivers on linuxrc (text shown repeatedly and in colors)
* action #38957: [functional] Refactor the openqa-review code to not use "Issue" object for the messages that does not have a valid bugref.
* action #39011: [functional] Low performance on openqa production server
* coordination #39041: [functional][sle][u][epic] test fails in systemd_testsuite - Adapt test suite 'suse_patches-systemd_testsuite' for SLE 12
* action #39044: [functional][sle][u] Create IBS repository for SLE12-SP4 of systemd-testsuite
* action #39047: [functional][u][sle] Adapt the test module 'systemd_testsuite' for SLE12-SP4
* action #39200: [functional][u] Change colour depth of product VNC from 16 to 24
* action #39317: [functional][y] Implement "solver"-testcase, e.g. in post_fail hook
* action #39359: [functional][y][sporadic] rsync.pl Can't locate object method "is_status_class" via package "Mojo::Message::Response" at /opt/openqa-scripts/rsync.pl line 1005.
* action #39809: [functional][u][s390x] ssh connection check shows red border misleading that something is wrong when there is not -> should be no red border
* action #40094: [functional][u] xscreensaver disabled in updates_packagekit_gpk.pm is back in x11 tests
* action #40172: [functional][opensuse][sporadic][u] automatic suspend affects several test modules
* action #40337: [functional][u] test failing to add systemd test repo - missing QA repo for Leap 15.1
* action #40385: [functional][y][opensuse] test fails in await_install on Live install
* coordination #40469: [functional][y][epic] Adjust RAID/LVM/partitioning tests to the new changes and extend testing coverage
* coordination #40475: [functional][y][saga] Establish YaST team split
* action #40490: [qe-core][functional] Implement test for screensaver and disable it in other scenarios
* action #40625: [sle][functional][u][hyperv] test fails in bootloader_hyperv - key stroke issue
* action #40679: [functional][y] whole disk as part of an MD RAID
* action #40715: [hyperv] Hyper-V 2012 R2 serial console unstable
* action #40943: [sle][functional][u] test fails in reboot_gnome - show text for password doesn't work
* action #41144: [functional][u][hyperv] test fails in bootloader_hyperv - The operation cannot be performed while the object is in use.
* action #41240: [sle][functional][u][s390x][kvm] test fails in reconnect_s390 - could not reach login prompt 
* action #41303: [sle][functional][u] sle-15-SP1-Installer-DVD-x86_64-Build43.1-remote_ssh_controller failed in remote_controller
* action #41321: [sle][functional][u][hyperv] test fails in reboot_after_installation - matching needle "any-console" skipped
* action #41465: [functional][u] test fails in openqa_webui reproducibly, coredump process or masked packagekit in background at fault?
* action #41666: [functional][sle][y] test fails in partitioning_raid - test failed to open expert partitioner
* action #41762: [functional][y][sle][ipmi][sporadic] test fails in partitioning_filesystem - Race condition: check_screen timeout and window get refreshed later
* action #41771: [functional][sle][u][ppc64le] test fails in boot_to_desktop - QEMU PPC tests are not able to boot from parent's generated qcow2
* action #42287: [functional][u] test fails in yast2_lan: console loglevel changed too late
* coordination #42401: [epic][functional][y] Refactor tests/installation/partitioning_raid.pm to use new approach to simplify maintenance between versions and distributions
* action #42446: [qe-core][functional] many opensuse tests fail in desktop_runner or gimp or other modules in what I think is boo#1105691 – can we detect this bug from the journal and track as soft-fail?
* action #42455: [opensuse][aarch64][functional][y] openSUSE Tumbleweed aarch64 oss repo seems to be deleted however we invest 41GB for the debuginfo repo
* coordination #42464: [qe-core][functional][saga] remote system management: salt, sles+suma, sles+storage (terraform, kubernetes, etc.)
* action #42536: [functional][u] test fails in force_scheduled_tasks - "select_console 'root-console'" failed because of btrfs info message on the screen which should not be there but this very module should prevent further messages and therefore handle this gracefully
* action #42740: [functional][u] test fails in NM_wpa2_enterprise - console switch fails because of messages on the console
* action #42857: [qe-core][functional][s390x] Change structure of s390x KVM hosts on production (o.s.d)
* action #43376: [functional][u] Adapt opensusebasetest to provide dmesg and journal log
* action #43466: [sle][desktop][functional][y] test fails in addon_products_sle, wrong sdk version 0361 (should be 0362) triggered
* action #43655: [qe-core][functional] Increase robustness of using bootloader parameter with info-file instead of long typing
* action #43784: [functional][y][sporadic] test fails in yast2_snapper now reproducibly not exiting the "show differences" screen
* action #43847: [functional][tools][u] test fails in zypper_lifecycle - Possible missing keys on Grenache
* action #43883: [functional][y][SLE-3804] snapper list: mark current and active snapshot and prevent deleting them
* coordination #44147: [functional][u][epic] openssh: extend tests
* action #44243: [functional][y] Extend autoyast/prepare_profile to also accept remote templates, e.g. supplied as downloaded assets over openQA to allow easy triggering of new profiles without needing to supply regcode/version/arch, etc.
* action #44300: [qe-core][functional][sporadic] test fails in svirt_upload_assets - Problems extracting the assets from the svirthost, connection seems to have died
* action #44339: [functional][u][mistyping] test fails in sshxterm - character missing in tput bold 2; tput setaf 1 making the test fail due to the needle not matching the expected prompt
* coordination #44843: [qe-core][functional][epic] Cleanup the use of serial-/virtio-/ssh-consoles in our tests (was: use $self->select_serial_terminal instead of checking IPMI in every module)
* action #44882: [functional][sle][userspace][u]test fails in execute_test_run - almost all php tests failed
* action #45158: [systemd] Implement systemd testsuite as openQA perl module
* action #45362: [functional][u][ipmi][sporadic] Key press doesn't reach the system
* action #45395: [sle][functional][u] keyboard layout switching - check for keyboard layout in gdm+gnome on SLE
* action #45407: [sle][functional][u] keyboard layout switching - check for keyboard layout in gdm+gnome for root
* action #46289: [qe-core][functional] Create qcow images within OBS instead of openQA tests?
* action #46316: [sle][functional][y] - adapt iscsi MM test according to hints from bsc#1115648
* action #47162: [sle][functional][rt][y] - run cyclictest & hackbench tests on bare metal for Milestone RC1
* coordination #47435: [epic][functional][y] Optimize sync of the SLE repos
* action #47843: [functional][u] Extend ssh tests to test that password based root ssh login does *not* work
* action #48005: [functional][u] Check license script in repo of os-autoinst-distri-opensuse
* action #48008: [functional][u] Get rid of "wait_grub" duplication
* action #48434: [functional][u] test Tumbleweed s390x again
* action #48602: [functional][y] Limit maximum file length with static code checks
* action #48632: [functional][y] Adjust tests for changes by patch for bsc#1123679
* action #49211: [functional][y] Test Suite for separate /home is running on sle12 s390x though it is impossible to make separate /home there
* action #49520: [functional][u] Add an extra unique worker class to each worker host
* action #49820: [functional][u] Make the svirt backend work with AppArmor enabled and under company policies
* action #50186: [functional][y] Include url to the skipped tests in openqa_review
* action #50399: [functional][y] Installer doesn't react to key press
* action #51341: [qam][blue] test fails in rrdtool_x11: "eog" command not found
* action #51374: [functional][y] Soft failure for "Console messages writes over any tty" seems irrelevant in this case.
* action #52316: [functional][y] cross-arch remote installation
* action #52439: [functional] i3wm window manager test
* action #52664: [functional][y] test times out as incomplete in await_install failing to download packages from download.o.o, should fail module and run post_fail_hook instead
* action #52679: [qe-core][qem][functional][network] Update Travis checker to limit usage of machines for the automatic tests to the automation infrastructure
* action #53399: [functional] o3: "[2019-06-21T03:39:04.0573 UTC] [warn] Unable to get filename from http://openqa.opensuse.org. Ignoring OPENQA_HOST_URL"
* action #54770: [functional][y] Rename test variable WORKAROUND_MODULES as is used in staging as normal behavior
* action #54794: [functional][y][timeboxed:8h] Identify packages used from source and debug repos and sync only them
* action #54839: [functional][y] Use new yaml structure for test suites to define different schedules for different env
* action #55985: [svirt][serial][xen] Enable svirt serial console for XEN
* action #56486: [functional][y] improve raid tests workflow by cloning partition table
* action #57536: [functional][y] implement autodeployment of the job group settings to osd
* action #58433: [opensuse][functional][y] test fails in yast2_apparmor: Doesn't wait until the shell accepts input
* action #59115: [y][functional][timeboxed: 16h] Investigate the best way to integrate CI messages on GitHub
* action #59139: [functional][y] Allow setting test data in test suite
* action #59202: [functional][y] Start using ASSET_ISO_SHA256 validate checksum
* action #61632: [functional][y] test fails in raid_gpt - Expert Partitioner shortcut changed to "alt-x"
* action #61901: [functional][y] Check if wicked is running for yast command line tests
* action #62693: [tools] Implement github action to check if staging is affected and notify the user
* action #63205: [functional][y] test fails in scc_registration - Downloading package window shown (Slow network)
* coordination #63280: [functional][y][epic] Reduce number of test suites used for YaST job group
* action #63388: [qe-core][functional] Ensure temporary TIMEOUT_SCALE values can be removed again in standard scenarios, e.g. "kde"
* action #64463: [functional][y] test fails in live_installation on Tumbleweed
* action #64688: [functional][y] Travis check detect_unused_modules is taking 4 minutes to be completed.
* action #64731: [functional][y] generate TW image with wicked and use it in yast2_cmdline and nis MM test suites
* action #65088: [functional][y]  Verify writing conflict from YaST in 70-yast.conf 
* action #65109: [qe-core] Dynamically adjust test waits based on load
* action #65352: [funcional][y] Examine soft-failures in nis mm tests
* action #65393: [functional][y] Develop script to figure out where test suite is scheduled
* action #65909: [functional][y] Test ENV_ACTIVATE_LUKS boot option
* action #65927: [functional][y] Identify list of the scenarios where we can remove test suites
* action #66052: [functional][y] Automated installation with encrypted partition on iscsi
* action #66964: [functional][y] Move test suites where we already have yaml schedule to the job group
* action #66967: [functional][y] Move more scenarios to job group from openQA database
* action #67657: [sle][functional][y] test fails in yast2_snapper - needle issue
* action #68335: [opensuse][functional][y] opensuse-Tumbleweed-DVD-s390x-RAID0_gpt@s390x never finishes due to wrong worker class
* action #68968: [functional][y] Make job group file generation part of CI
* coordination #69172: [y][epic] Extend yast clients coverage in first boot tests 
* action #69445: [functional][y] test fails in transactional_update ppc64le TW, missing utt-opensuse-ppc64le.tgz
* action #69586: [y] Refactor 'validate_addon_repos' and 'validate_mirror_repos' test modules
* action #70153: [y] system_state should upload collected data
* action #70564: [y] Add CI check to not allow characters of the kind ©
* action #70726: [y] Generate dud file dynamically instead of relying on urls
* action #71896: [y] Expert partitioning framework refactoring
* action #72184: [virtualization][y] Select_console fails sporadically for svirt-xen-hvm 
* action #73351: [qe-sap] some sapconf tests fail on sles4sap
* action #77956: [openQABot] openQA supports showing parent group name when getting a job details
* action #81256: [sle][security][sle15sp3][Feature][Automation]Implement "SWTPM" tests in openQA
* action #81711: [sle][security][sle15sp3][Feature][Automation]Enable CONFIG_FORTIFY_SOURCE config option in all kernel flavors
* action #81712: [sle][security][sle15sp4][Feature][Automation?] Complete Secure Boot support on aarch64
* action #81715: [sle][security][sle15sp3][Feature][Automation] Accelerate dm-crypt
* action #81721: [sle][security][sle15sp3][Feature][Automation]QA: /etc/grub.d/10_linux grub should support authorization
* action #81835: `/dev/sshserial` is broken on generalhw backend
* action #92921: [tools][spike] Can we change or display job group structure for maintenance job groups to have one job group per team like for product validation and maybe specific products and versions below size:M
* coordination #95377: [qe-core] Self Service openQA testing
* action #95458: [qe-sap][ha] SUT reboots unexpectedly, leading to tests failing in HA scenarios auto_review:"(?s)tests/ha.*(command.*timed out|Test died).*match=root-console timed out":retry
* action #95863: [qe-core] Improve conflict handling in update_install
* action #98823: [tools] Add openQA test for openSUSE jitsi size:M
* action #101701: [sle][security][TW][Automation] Complete Secure Boot support tests on aarch64 
* action #105564: [sle][security][CC][s390x] [backlog]re-connect root console may fail after reboot
* action #108548: [sle][security][backlog]automation: Integrate 'secure-boot' on Power into openQA
* action #116287: [qe-core][s390x] SSH serial terminal connection issues on s390x workers
* action #116812: [qe-core] Leap 15.5 uefi console switch fail size:M
* action #120193: [tools] Test schedule ordering: tests run before repo available "Test died: 'zypper -n ref' failed with code 4"
* action #120495: Add openqa-piworker.qa.suse.de to monitoring
* action #122539: test fails in curl log from openqa and connect with FQDN worker2.oqa.suse.de always fails by time out size:M
* coordination #129931: [qe-core]  Tumbleweed & Leap tests - meeting follow ups
* action #135881: [tools][ppc64le][qemu-backend]openqa fails to publish qcow2 image on ppc64le platform.
* action #137612:  [tools][qem] Incomplete test run in S390x with the error message: 'Reason: backend died: Error connecting to VNC server s390kvm097.oqa.prg2.suse.org:5901: IO::Socket::INET: connect: No route to host'
* action #137639: [yam] smb install source is unreachable
* action #150863: Enhance Open SCAP tests and add more profiles tests
* action #27621: [sle][functional][u] Test "motif" libraries are usable within SLE because customers use this "legacy" framework
* action #29993: [tools][hard] Better handling of custom tags/labels/fields (was: Find a way to support logical combinations of search keywords in progress.o.o queries to e.g. list all "functional SLE15 fate issues")
* coordination #32734: [functional][epic][u][new test] OOM handling
* action #34657: [functional][u][timeboxed:4h] Setup retrospective server based on https://github.com/funretro/distributed
* action #42647: Proper integration of kernel tests into openSUSE Tumbleweed release process, e.g. teach ttm to support multiple job groups
* action #43580: The RT product can be tested by release managers or developers before full SLE validation
* action #44393: [sle][desktop][sles4sap][hpc] staging project for a second SLE product besides SLES, e.g. SLE RT in SLE15
* action #44774: [functional][u] create a new test module valgrind for openQA
* coordination #49502: [qe-core] Automatic validation test on github PRs
* action #68758: [functional][qe-core] create grafana instance for mean cycle and lead times
* action #81106: test out chat service notifications, e.g. matrix, from github actions size:M
* action #88536: Find out differences in openQA test coverage with metabase
* action #90914: [teregen] Add overview for stored coverage data
* action #90917: [teregen] Add notification about errors in template generating
* action #92119: Improve license detection in cpanspec
* coordination #93871: [epic] support process improvement in maintenance requests:  packages from different code streams with identical fix sets/features in a single incident
* action #93937: [tools][qem] qamapi - incidents can have multiple versions packages
* action #94024: MTUI unable to recover from failure to connect to the refhost
* action #94027: MTUI - traceback when connecting unavailable refhost
* action #94048: MTUI - reload_products doesn't work
* coordination #94105: [epic] Use feedback from openqa-investigate to automatically inform on github pull requests, open tickets, weed out automatically failed tests
* action #94588: [qem] dashboard.qam.suse.de to be included in approval qam-openqa
* action #94600: [tools][mtui] Communicate reduced visibility of openQA incident related coverage in log
* action #95287: [tools][retrospective] CircleCI seems very slow recently
* coordination #95857: [epic] QAM incident tests: Fix "next & previous", latest results and label carry-over
* action #96314: [mtui] Update MTUI to use new format for Testplatform
* action #96359: Improve openqa-review generation: Learn Gitlab CI pipelines
* action #97118: enhance bot automatic approval: check multiple days
* coordination #97121: [epic] enable qem-bot comments on IBS (was: enable qa-maintenance/openQABot comments on smelt again)
* action #97274: qam dashboard improvement ideas
* action #97505: [qem][tools] embed important IBS comments in the testreports
* action #97994: bot-ng - sometimes doesn't update smelt data in dashboard
* action #98820: Various requirements for qem-dashboard (was: Design document for openQA CI dashboard)
* action #98919: Improve alert handling - slack notifications
* coordination #99303: [saga][epic] Future improvements for SUSE Maintenance QA workflows with fully automated testing, approval and release
* action #99489: qa-maintenance/openQABot CI job fails on `TypeError: 'NoneType' object is not subscriptable`
* action #100871: Consider CI Dashboard integration to SMELT
* action #103701: Resubmited incident (ID) with new release request (RR) inherits incident test results from previous RR
* coordination #103846: [epic] Idea from SUSE QE Tools Workshop 2021-12-10: Ask for more user feedback in important, upcoming features, e.g. in tickets as well as github pull requests
* coordination #103995: [epic] Make Mojo-IOLoop-ReadWriteProcess a reliable dependency for our tools
* action #103998: continuous integration and releasing for Mojo-IOLoop-ReadWriteProcess
* action #104209: [qem] dashboard.qam.suse.de checkpoints for aggregates
* action #104848: Evaluate https://commitizen-tools.github.io/commitizen/ for our projects
* action #108120: rpm and cpanspec: Support vx.y versions in perl modules
* action #108731: Ensure our products are fit for "RFC: deprecate plaintext", e.g. rsync in obs-rsync
* coordination #108878: [epic] Extending bot-ng for triggering virtualization incident jobs
* action #109491: Flow diagram for Maintenance jobs scheduling 
* action #109509: qem-dashboard - show better info about time of actualization of data
* coordination #109644: [epic] Future improvements for qem-bot
* coordination #110016: [epic][teregen] teregen (maintenance test report template generator) improvements
* action #110200: qem-dashboard - add link to gitlab CI pipelines on incident dashboard pages
* coordination #110836: [epic] future qem-bot improvements
* action #111584: upload_logs issue uploading  files with space in the filename 
* action #112268: [teregen] Integrate productdefs generator inside template generator
* action #115613: [tools] dashboard.qam.suse.de/blocked to show updates by the priority in SMELT
* coordination #119338: [epic] SLO Automation for openqatests SLOs
* action #121228: qem-bot comments on IBS
* action #121588: Jobs shown on qem-dashboard are missing in OSD
* coordination #121726: [epic] Get management access to o3/osd and other QE related VMs
* action #122311: Use live openQA test results instead of inconsistent qem-dashboard database in qem-bot approver
* coordination #123088: [saga][epic] Re-combined Maintenance QA tooling covering both SLE+openSUSE
* action #123700: [tools][teregen] Alert if systemd services fail on qam.suse.de, e.g. using our salt states in parallel with ansible
* action #123894: qem-bot+openqa-bot gitlab CI pipeline aborted with error after 1h of execution
* action #123963: [qem-bot] bot-ng should support the "!include" tag just like "https://github.com/os-autoinst/os-autoinst-distri-opensuse" dose
* action #124473: [tools] Automatic regression tests export from openQA
* action #124475: [tools] osc qam allows assigning approved Incident to reviewer
* action #124628: Ensure machines in NUE-FC-B-1 are configured to default to power-off over IPMI after power reconnect to save power when machines are not in use size:M
* action #125150: [qem-dashboard] Give suggestions how to handle if incident test results are empty
* action #126113: [tools][metrics] Only show queries in backlogger output that are relevant for the according output mode
* coordination #126167: [epic][qem-bot] Inconsistent job counts in qem-dashboard size:M
* action #126554: [qem-dashboard] Show more details about incident specific openQA jobs in dashboard ui
* action #126953: [tools] mtui hangs on disconnect if network is offline
* action #129118: [dashboard] SLEM results does not point to valid url
* action #132149: Coordinate with Eng-Infra to get simple management access to VMs (o3/osd/qa-jump.qe.nue2.suse.org) size:M
* action #133223: SUSE Hack Week 23 (Nov 6 2023) in the SUSE QE Tools team
* action #133556: [sporadic] bot-ng gitlab CI execution timeout or stuck in "sync aggregates"
* action #134417: Merge prague and prague-2 refhosts locations size:M
* action #134420: [tools] If no refhost found in chosen location, try different ones in MTUI
* action #134888: Ensure no job results are present in the file system for jobs that are no longer in the database
* action #136352: qem-bot does not approve incident because of stale record of failed test
* action #138035: [bot-ng] jobs in Maintenance: SLE over openSUSE are scheduled with no restrictions
* coordination #139094: [epic] Improve collaboration with Eng-Infra - take 2
* action #139106: Ensure a PRG2 based QE PowerPC HMC is reachable over proper FQDN and reverse PTR
* action #139109: Support move of non-openQA PowerPC machines to PRG2, i.e. haldir, legolas, whale, blackcurrant, cloudberry, huckleberry, soapberry, nessberry
* action #139274: [bot-ng] Update will be not approved if it's not part of defined packages
* action #152655: [research][timeboxed:10h] AI powered knowledge base
* action #153107: Proper code coverage for at least commenter.py in qem-bot size:M
* action #153352: Test refhost maintenance automation
* action #153421: [spike][timeboxed:10h] Replace scriptgen with executing rsync from python
* action #153478: [mtui] Prepare MTUI for ALP
* coordination #153655: [saga][epic] Future datacenter and network setup at SUSE
* coordination #153712: [epic] Future setup in NUE2 FC Basement
* action #153736: Move of LSG QE non-openQA PowerPC machine NUE1 to PRG2 - nessberry
* action #153739: Move of openqa.opensuse.org machine NUE1 to PRG2 - blackbauhinia
* action #153784: Move of selected LSG QE machines NUE1 to PRG2e - openqaworker19
* action #153886: SMELT incidents and Release Requests IDs are not unique and may interfere with update approval decision
* coordination #153928: [epic] Ideas from SUSE QE Tools workshop 2024-01-19 Filter openQA todo-jobs on /tests belonging to groups, review teams, etc
* action #154762: Refactor qem-bot to use https://github.com/openSUSE/openSUSE-release-tools/blob/master/osclib/comments.py directly instead of bad copy-paste
* action #155206: [qem-bot] re-release update can miss repo and thus not schedule updates
* action #155245: [mtui] Better openQA - MTUI cooperation
* coordination #155671: [epic] Better handling of SLE maintenance test review
* action #157777: Provide more consistent PowerPC openQA ressources by migrating all novalink instances to hmc size:M
* action #159060: Rollback/switch to officially installed velociraptor-client repo and server size:S
* coordination #159543: [epic] PowerPC Power10 setup for QE LSG
* coordination #159852: [epic] Future consolidated DHCP/DNS/PXE setup in SUSE datacenters
* action #160092: Consider using https://docs.gitlab.com/ee/ci/jobs/job_artifacts.html to have static links to always most recent job runs
* action #10516: [functional][u] Use jenkins as extension for openQA
* action #17816: [functional][u][ipmi] Error: Unable to establish IPMI v2 / RMCP+ session
* action #18608: [qe-core][tools][sle][functional][research][medium] Implement proper clean up for images on jump hosts, e.g. s390pb, hyperv host, svirt and a proper monitoring
* action #30595: [ppc64le] Deploy bcache on tmpfs workers
* action #38516: [tools] Disable memory autoballooning on openqaw5-xen
* action #39008: [tools][pvm] Redundant powerVM production workers
* action #41867: [devops][tools] Replace get-metrics script by telegraf
* action #41975: Evaluate graphite vs prometheus
* action #42233: Production-grade jenkins.qa.suse.de for QA SLE (EMEA)
* action #42467: http://jenkins.qa.suse.de/job/monitor-openQA_in_openQA-TW fails to write comments in OBS project, monitor-openqa_job expects package name for OBS api, not project
* action #44183: Add checks on transactional-update workers using "health-checker"
* action #54785: tap devices not in any zone, error reported by firewalld
* action #55316: monitoring alerts for too long running database queries
* action #57239: Add/fix openqa_logwarn for o3 and osd sending to o3-admins@suse.de and osd-admins@suse.de respectively
* action #58325: Update firmware of our powerKVM machines (QA-Power8-3, QA-Power8-4, QA-Power8-5)
* action #59621: osd: Sporadically high CPU and IO load (vdd), grafana alerts "Disk I/O time for /dev/vdd" and "CPU usage", also other disks
* action #60962: Enable multi-machine capability for all configured workers
* action #61221: osd: unable to save needles, minion fails with "fatal: Unable to create '/var/lib/openqa/.../needles/.git/index.lock'"
* action #62666: Move openqa.opensuse.org into opensuse private network
* action #63382: /usr/share/qemu/ovmf-x86_64-staging{,-code,-vars}.bin on workers is not installed by any package, e.g. missing on imagetester
* action #63874: ensure openqa worker instances are disabled and stopped when "numofworkers" is reduced in salt pillars, e.g. causing non-obvious multi-machine failures
* action #64123: Expose database revert as a manual trigger
* action #64541: Issues with DNS resolving in QEMU
* action #64580: Detect and recover from I/O blocked worker machines, e.g. openqaworker-arm-{1,2,3}.suse.de
* action #64803: harmonize IPMI username and password auto_review:"(sonic|tails)-sp.qa.suse.de .*Unable to establish IPMI"
* action #65019: ppc64 debuginfo repo is not stripped for Tumbleweed
* action #65555: [qe-core][functional][core] html5test.opensuse.org includes non-existing file
* action #66019: Configure downsampling and a retention policy for InfluxDB
* action #66610: Prevent misleading login failing over http on https-enabled instances, e.g. disable non-SSL in production openQA instances using OpenID (OSD, o3) at least for login attempts
* action #68633: alert if there is no worker active for any existant machine class
* action #69718: harmonize timezone used for our machines
* action #71590: [osd][alert] Implement proper monitoring of needed resources of workers
* action #72079: Upgrade o3 worker openqa-aarch64 to openSUSE Leap 15.2 (to use newer packages specifically needed for aarch64 and as precursor), also problem auto_review:"(?s)starting: /usr/bin/qemu-system-aarch64.*backend died: Migrate to file failed"
* action #73297: auto_review:"(?s)Running on openqa-aarch64:.*considering VNC stalled.*THERE IS NOTHING TO READ"
* action #73345: [u] Cleanup of old needles from os-autoinst-needles-opensuse and os-autoinst-needles-sle
* action #76768: HDD images are cleaned-up too early for aarch64 Tumbleweed
* action #76792: /var/lib/openqa in QA-Power8-5-kvm reports Structure needs cleaning (auto_review:"(?s)Running on QA-Power8-5-kvm.*cannot remove directory for testresults":retry)
* action #77011: openqaworker7 (o3) is stuck in "recovery mode" as visible over IPMI SoL
* action #77317: chat bot to conduct daily checks, alerts, reminders, etc.
* action #78061: [Alerting] openQA minion workers alert - alert turned "OK" again after 20 minutes and we don't know what was wrong
* action #78222: Persistent postgres setup and configuration in salt
* coordination #78226: [epic] Prevent or better handle OOM conditions on worker machines
* action #78232: [ipmi|PXE]OSD repo seems to be having mount issue
* action #78314: Order 2 VMs for the LinuxONE Community Cloud
* action #78348: osd: Some  job group obsolete definitions should be removed 
* action #80130: grenache salt is spilling errors about "Failed to load grains defined in grain file ppc_powervm.check_output"
* action #80482: qa-power8-5-kvm has been down for days, use more robust filesystem setup
* action #80540: idea: Conduct "power outage drills", e.g. once every half-year?
* action #80732: Monitoring on log alerts, also on grafana log alerts, maybe grafana-loki?
* action #80824: o3: Migrate from SuSEfirewall2 to firewalld
* action #80990: some jobs incomplete with auto_review:"(?s)Running on[^\n]*Linux 5.3.18.*Migrate to file failed, it has been running for more than 240 seconds":retry , seems to happen since upgrade to Leap 15.2
* action #81308: Show actual percentage in partitions usage (%) alert
* action #88195: Full test of salt states including DBus on CI
* action #88197: Workflow for staged deployments
* action #88299: [virtualization] Worker openqaw5-xen-1.qa.suse.de is not reachable (xen-hvm/xen-pv failing)
* action #89398: OSD deployment stopped prematurely due to "System management is locked by the application with pid 29165 (zypper)"
* action #90062: osd deployment fails in "record package versions pre-deploy" maybe because a kernel update is pending?
* action #91626: Deployment emails should cover rollback
* action #93119: [s390x] Update of s390x Test infrastructure after shutdown of Mainframe zEC12
* action #93138: openqa-reload-worker-auto-restart and openqa-worker-auto-restart fail if numofworkers is reduced
* action #94399: No alert when arm workers are offline, alert if telegraf throws errors size:M
* action #94495: Migrate to InfluxDB 2 when needed (at least when our current OS base has a package)
* action #94765: Bring openqaworker12 into production (w/o multi-machine test support) size:M
* action #94783: Bring openqaworker11 into production including multi-machine test support (same as w12) size:M
* action #96257: Tests timeout with MAX_SETUP_TIME on osd - Apply a higher MAX_SETUP_TIME applicable for the *complete* OSD infrastructure, e.g. add to every worker config entry
* action #96552: Persistent records of I/O usage by process size:M
* action #96683: Reducing the number of worker slots leads to failing systemd units
* action #97409: Re-use existing filesystems on workers after reboot if possible to prevent full worker asset cache re-syncing
* action #97412: Reduce I/O load on OSD by using more cache size on workers with using free disk space when available instead of hardcoded space
* action #97640: have a secondary backup openQA webUI instance in another location than OSD, e.g. PRG
* action #97745: [virtualization][hyperv] ensure_serialdev_permissions fails for hyperv
* action #97859: Improve network for OSD
* action #97976: [alert] OSD file systems - assets
* action #98661: Tweak worker numbers for openqaworker-arm-4 and arm-5
* action #98682: jobs run powerqaworker-qam-1 fail with auto_review:"(?s)powerqaworker-qam-1.*Can't write to file (.*): No space left on device at .*":retry size:M
* action #98835: arm jobs failing (again?) with auto_review:"backend died: Open vSwitch command 'set_vlan' with arguments .*was not provided by any .service files":retry
* action #99138: Provide ratio of tests by result in monitoring - by job group
* action #100841: Improve logging for libvirt hosts
* action #100976: specific alert about the size of our database, maybe even database tables?
* action #100979: configure better auto-vacuum for our database(s)
* action #100985: Come up with a way to regularly check job group configs for outliers and misconfiguration, e.g. overly long result retention periods
* action #100988: ask for OSD /srv to be enlarged (was: investigate how to optimize /srv data utilization on OSD) size:S
* action #102167: Disk monitoring for s390x z/VM backend
* action #102269: openQABot pipeline failed with HTTP 403
* action #103380: Configure retention/downsampling policy for specific monitoring data stored within InfluxDB
* action #104091: Try `aarch64_cpu_max` tests on `openqaworkerX`
* action #105013: backup o3 worker config files
* action #105867: OpenQA bot schedules jobs with incomplete INCIDENT_REPO
* action #106756: cmd returned 32768 repeatedly reported on o3
* action #106760: DBI Exception: DBD::Pg::st execute failed: number of parameters must be between 0 and 65535 repeatedly reported on o3
* action #106766: DBI Exception: DBD::Pg::st execute failed: ERROR:  invalid input syntax for type integer reported on o3
* action #106841: Try using tmpfs on openqaworker1 to use RAM more efficiently
* action #107023: cmd returned 31744 repeatedly reported on o3
* action #107794: openqa-logwarn is missing messages
* action #107980: openqa-aarch64 - kernel traces in dmesg "watchdog: BUG: soft lockup - CPU#.* stuck for .*s! [qemu-system-aar:.*]"
* action #108266: grenache: script_run() commands randomly time out since server room move
* action #108872: Outdated information on openqaw5-xen https://racktables.suse.de/index.php?page=object&tab=default&object_id=3468
* action #108974: Loan Fujitsu server for OpenQA FIPS testing needs
* action #109112: Improve os-autoinst sshXtermVt.pm connection error handling (was: "Test died: Error connecting to <root@redcurrant-4.qa.suse.de>: No route to host")  size:M
* action #109635: Check grafana monitoring host performance size:M
* action #110191: CI checks should ensure that apparmor changes are correct
* action #110467: Establish reliable tap setup on ow14
* action #110545: Investigate and fix higher instability of openqaworker-arm-4/5 vs. arm-1/2/3 - further things to try size:M
* action #112769: errors from telegraf on osd webUI "[inputs.procstat] Error in plugin: open /sys/fs/cgroup/systemd/system.slice/salt-master.service/cgroup.procs: no such file or directory", same for openqa-scheduler.service
* action #112787: Use different users for our database accesses so that we can debug where load comes from
* action #112850: Make pgstatstatements persistent on OSD (in salt)
* action #112943: Consider running explicitly triggered `vacuum ANALYZE` after every database migration
* action #113357: UEFI PXE or "network boot" support within .qa.suse.de size:M
* action #113701: [qe-core] Move workers back to grenache
* action #113800: Setup o3 to run rootless containers on worker hosts
* action #114400: [qe-core] Rebalance OpenQA worker distribution
* action #114523: Deal with QEMU and OVMF default resolution being 1280x800, affecting (at least) qxl, but on aarch64 size:M
* action #114622: Identification of unused/idle machines by alarming when there is no traffic on the corresponding switch ports for some time
* action #114866: Handle a trailing slash in NEEDLES_DIR correctly
* action #114992: Broken MM machines don't appear as available workers
* action #115763: Add new feature to create a dependency that could be derived automatically from asset settings
* action #115925: aarch64: Random QEMU failures while retrieving host CPU features
* action #116473: Add OSD PowerPC workers to automatic recovery we already have for ARM workers
* action #116716: Repurpose ix64ph1079, ix64ph1080, ix64ph1081, e.g. as openQA workers
* action #116968: separate email or mailing list address for os-autoinst related development, e.g. circleCI bot account
* action #118375: Do not alert about "packet loss" if hosts are down
* action #118891: Make alerts depend on each other
* action #119059: Use qa-power8 for ppc tests in o3 - network connected?
* action #119479: openqABot pipeline failed after runner getting stuck for 1h0m0s size:M
* action #119755: Use a PowerVM machine to serve both PowerVM LPARs for testing as well as one VM running qemu tests
* action #120064: SSD SAN storage (NetApp) for O3 would improve user experience (can not just buy drives on our own)
* action #120115: [qem-dashboard] Use new openQA job settings API to show more data
* action #120145: Where can we see which services are blocked ourselves in SUSE networks?
* action #120169: Make s390x kvm workers also use FQDN instead of IPv4 in salt pillars for VIRSH_GUEST
* action #120279: Proper maintainership for openqa_service VM size:M
* action #120651: [openQA][infra][ipmi][worker][api] The expected pattern CMD_FINISHED-xxxxx returned  but did not show up in serial log (wait_serial timed out) size:M
* action #121171: Consider using pngquant for speedup
* action #121306: [virtualization][hyperv] worker7-hyperv.oqa.suse.de  can not be reached
* action #121507: Iscsi issue on OSD worker 
* action #121597: Implement automated racktables sanity check
* action #121600: Add monitoring for connected machines inside "our" network which are not present in racktables
* action #121672: [virtualization] Connectivity issues on worker8-vmware.oqa.suse.de
* action #122776: containers_tw_image_on_ubuntu_host: error 403 (forbidden) downloading the ubuntu qcow2 file
* action #123226: Temperature monitoring in SUSE QE lab size:M
* action #123712: PowerVM HMC within o3, e.g. on VM
* action #123960: s390x tests fail to log into VNC console on worker2 due to already present VM with same mac address
* action #124562: Re-install at least one of the new OSD workers located in Prague
* action #125054: Review https://github.com/alexellis/awesome-baremetal
* action #125141: Salt pillars deployment pipeline failed on "tumblesle" due to invalid security sensor repo size:M
* action #125219: Use qa-power8 for ppc tests in o3 - try the other suggestions
* action #125744: [tools][alert][FIRING:1]  (Failed systemd services alert (except openqa.suse.de) QDG8aXAVz) due to openqa-piworker.qa.suse.de unable to reach openqa.suse.de
* action #126677: salt-states-openqa fails with 0 errors and result False messages buried in one of several places
* action #126941: [spike] Evaluate a move of the osd database to its own VM
* action #128222: [virtualization] The Xen specific host configuration on openqaw5-xen can be re-created from salt size:M
* action #128513: Apache Response Time monitoring dashboard is slow to render and should be made lighter
* action #128870: [alert] DatasourceError for "InfluxDB not reachable" size:M
* action #129032: ipmitool monitoring
* action #129121: performance: various tests fail receiving data at usable speed over the internet
* action #130378: Integration of extra salt repositories as salt formulas size:M
* action #130513: Add o3 to grafana
* action #130778: Treat some openqa-clone-job failures non-fatal in openqa-investigate hook
* action #131549: [spike][timeboxed:20h] Additional redundancy for OSD virtualization testing - Hyperv 2016 worker host size:M
* coordination #132275: [epic] Better o3 monitoring
* action #132293: Ensure cleaned up tenants in netbox
* action #132380: Multiple empty folders in grafana linked to alerts
* action #132440: Research productive workflows for reviews on GitHub
* coordination #132467: [epic] Prevent redundant salt state.apply actions that are executed in every call
* action #132647: Migration of o3 VM to PRG2 - bare-metal tests size:M
* action #132827: [tools][qe-core]test fails in rsync_client/salt-master, DNS resolve issue with workers "sapworker*" on multi-machine tests size:M
* action #132926: OSD cron -> (fetch_openqa_bugs)> /tmp/fetch_openqa_bugs_osd.log failed size:M
* action #132998: [alert] [FIRING:1] openqaworker-arm-3: Memory usage alert openQA (openqaworker-arm-3 memory_usage_alert_openqaworker-arm-3 worker) size:M
* action #133247: Additional redundancy for OSD virtualization testing - Hyperv 2019 and 2022 (or 2012r2) worker host size:M
* action #133388: Unavailable developer mode on ow18
* action #133475: Migration of o3 VM to PRG2 -  connection to rabbit.opensuse.org
* action #133700: Network bandwidth graphs per switch, like https://mrtg.suse.de/qanet13nue, for all current top-of-rack switches (TORs) that we are connected to size:M
* action #133907: Improve monitoring for http(s?) reachable on jenkins.qa.suse.de size:M
* action #133991: Cover same metric for different hosts with a single alert rule
* action #134048: openqa-piworker does not restart openQA worker processes after upgrades as it is not a salt minion in "worker" role
* action #134081: Setup new PRG2 openQA hardware https://racktables.suse.de/index.php?page=object&object_id=23373
* action #134135: openqa-monitor.qa.suse.de salt CI deploy telegraf check shows error about "could not find file: [/etc/dehydrated/certs/monitor.qe.nue2.suse.org/fullchain.pem]"
* action #134492: [tools] QA-Power8-2-8247-22L-SN1010D5A  is not working size:M
* action #134585: Display the job age per architecture
* action #134819: Errors in salt minion and master log on osd
* action #134846: Old NFS share mount is keeping processes stuck and openQA workers seem up but do not work on jobs
* action #134852: gitlab CI job fails in telegraf check with unsupported option since telegraf package on monitor.qa.suse.de was downgraded due to invalid repo metadata
* action #135005: Reduce duplication in salt-pillars-openqa openqa/workerconf.sls with advanced YAML/jinja features
* action #135008: Max job age graphs use mean aggregation when max would make more sense
* action #135056: MM Test fails in a connection to an address outside of the worker
* action #135662: Make the state of deployments (and rollbacks) more discoverable
* action #135944: Implement a constantly running monitoring/debugging VM for the multi-machine network
* action #136952: Consider lowering the threshold for job age and job queue alerts
* action #136958: Add Grafana panel for number of workers
* action #136967: Monitor number of uploading jobs in grafana
* action #137114: openQA workers fail to register after bootup due to unable to resolve openqa.suse.de but manage to do so immediately when restarting worker services
* action #137810: Add openqa_logwarn for osd sending to osd-admins@suse.de respectively
* action #138275: Ensure that there is proper ownership and maintainership for qanet.qa.suse.cz
* action #138374: Ensure all salt managed machines show grub and boot log and Getty on ipmi sol size:M
* action #138683: https://metrics.opensuse.org/d/osrt_openqa/osrt-openqa?orgId=1&from=now-7d&to=now should show current results … which apparently it doesn't
* action #138707: Re-enable worker32 for multi-machine tests in production
* action #139070: Re-enable worker34 for multi-machine tests in production
* action #139103: Long OSD ppc64le job queue - Decrease number of x86_64 worker slots on osd to give ppc64le jobs a better chance to be assigned jobs size:M
* action #139154: Re-enable worker33 for multi-machine tests in production
* action #139202: Consolidate the current use or make use of PRG2-J : Rack J11 - OpenQA Rack : H03-ch1 https://racktables.nue.suse.com/index.php?page=object&object_id=23373
* action #150986: [timeboxed:10h] Prevent cpu over-allocation in openQA worker service definitions
* action #150995: Fix MM setup on diesel so test scenarios like ha_ctdb_supportservertest-ppc-mm work
* action #151180: Automatic reboot on o3 openQA workers broken
* action #151307: [grafana] migrate deprecated angular plugins
* action #151570: [qe-core] Cleanup openQA jobgroups
* coordination #151582: [epic] Future improvements for QE infrastructure salt management
* action #151606: Ensure that the tap class is fully enabled on petrol
* action #152098: [research][timeboxed:10h] Learn more about openvswitch with experimenting together size:S
* action #154180: Proper kvm asset cleanup for s390x kvm backend (svirt) and tests
* action #155089: Automatically comment on tickets not using one of our templates
* action #155200: Periodically running simple ping-check multi-machine tests on ppc64le covering multiple physical hosts on OSD alerting tools team on failures size:M
* action #155482: [qe-sap] Update contact person for racktable entries with Lee Martin
* action #155764: Consider switching to safer filesystems than ext2 in osd+o3
* action #157606: Prevent missing gre tunnel connections in our salt states due to misconfiguration
* action #157636: remove NOVIDEO=1 from ppc64le workers
* action #157726: osd-deployment | Failed pipeline for master (worker3[6-9].oqa.prg2.suse.org)
* action #157738: Use rstp_enable=True on o3 as well
* coordination #158374: [epic] Prevention of inefficient hardware resource use
* action #158380: Detect and switch off from monitoring data which monitored machines show a too low CPU usage over time
* action #158386: Crosscheck which machines marked as "unused" in racktables still draw power according to ePDU data (as they should not be powered on and wasting significant power at all) - NUE2 size:M
* action #158709: typing issue on ppc64 worker - with automatic CPU load based limiting in place let's increase the instances on mania again
* action #159234: ignore this one
* action #159534: Make use of all 12 redcurrant LPARs
* action #159657: [alert] about "web UI: Too many 5xx HTTP responses alert" hidden behind grafana alert grouping
* action #159666: Lack of alerts about error messages related to InfluxDB and SSL expiration panel
* action #159963: salt-pillars-openqa deploy pipeline fails because file.manage complains about »name '__env__' is not defined«
* action #9474: Test accessibility
* coordination #9536: Test all DMs for working encrypted home support
* action #17680: Use sut-like select_console in remote_vnc_target_nfs and remote_ssh_target_ftp
* action #20206: [functional][y][yast][easy] Add yast2_ui_devel scenario (was: please remove yast2_cmdline from 42.3 test plan)
* action #20966: Extend yast2_software_management 
* action #26994: [sle][functional][yast][y] Test installation with low memory (512mb) and swap disabled
* action #28555: Create installation workflow which covers steps backward and changing system role
* action #28976: Add test releasenotes_origin properly for s390x zkvm
* coordination #29122: Extend autoyast tests coverage
* action #31585: Full installation with a different keyboard layout
* action #31726: [bsc#1078961] Add scenario where user selects desktop goes back and selects another desktop
* action #31915: Create ay integration test for given profile which has identified bug bsc#1037727
* action #32152: [autoyast] verify that filesystem is assigned when <filesystem> tag is not defined
* action #32848: Check for subvolumes present for home directory in case no separate partition
* action #33070: [bsc#1082535] add test to verify YaST dev packages in Dev Tools module
* action #33535: [sle][functional][y][yast] test that FBA DASD devices cannot be formatted 
* action #33556: [ipmi]New test scenario: textmode+kvm_server_role@ipmi
* coordination #34333: [functional][y][epic] More test scenarios covering installation on existing partition layouts
* action #34414: [autoyast] Add profile to test regression bsc#1088183
* action #35745: [sle][functional][y][bsc#1083487] -  Use static port configuration for NIS/NFS instead of disabling firewalld in MM nfs client/server test suites
* action #36090: Save snapshots by name
* coordination #36712: [saga] Use YaST specific framework for GUI testing
* action #37039: [sle][functional][y] Partition disk before installation to verify storage proposal
* action #37042: Implement feature to override beta flag for SLE modules in proxy SCC
* action #37045: [opensuse][functional][y] enable iscsi server/client scenario for openSUSE
* action #37814: Create workaround when Release Notes missing in Suggested Partitioning
* action #38060: Verify correct status information on services list is displayed
* action #38435: [qe-core][sle][functional][bsc#1099153] L3: UMASK for Home Directory in YaST
* coordination #38885: [functional][y][epic] Extend network related yast2 modules tests to be proper multimachine tests
* action #39671: [functional][y][regression][bsc#1099394] Verify YaST constructs wrong udev name for dm-uuid names
* coordination #40979: [sle][functional][y][epic] New test strategy for autoyast profiles from ay-tests repo
* action #40988: [sle][functional][y][timeboxed:16h] Establish pipeline for autoyast testing
* action #41546: [functional][y] Change architecture checks with functionality of the #33388 to detect VNC installation
* action #41948: [functional][y] New test for formatting/mounting/encrypting a whole disk
* action #42347: [functional][y] autoyast staging test?
* action #42356: [functional][y] Test pipeline using openQA for autoyast related changes before they hit the product
* coordination #42890: [functional][y][epic] Established workflow how system level test failures found in openQA of QA validation tests can be moved to earlier testing, e.g. staging, OBS devel projects, PR, commit
* coordination #43139: Assess and improve automation coverage for yast2-network 
* coordination #43886: autoyast tests for confirming base license, skipping proposal screen, first boot wizard
* action #44213: YaST2 tests for quarterly refreshed ISOs
* action #45053: Test installation over ssh as root on Tumbleweed with latest update forbidding root-password login
* action #46376: [functional][y] Yast (and some console programs) not correctly displaying (from [opensuse-factory]  mail)
* action #46562: [functional][y][snapper] Test regression bsc#1111414 for snapper comparison
* action #46784: y2uitest_ncurses tests enablement for QAM [TRACKER]
* action #48527: Include tests load_extra_tests_y2uitest_ncurses tom QAM jobs
* action #48542: [functional][y] Unify console/yast2_i and yast2_gui/yast2_software_management test module
* action #48707: Only parse logs in detect_yast2_failures instead of conducting full installation for online medium
* coordination #49157: [epic] Introduce yast2_clone to more scenarios
* action #49172: Implement migration test from same version to the same version (bsc#1128459)
* coordination #49244: YaST Command Line Options TRACKER
* action #49256: Regression test yast audit-laf 
* action #49259: Regression test yast dhcp-server
* action #49268: Regression test  yast firewall
* action #49280: Regression test yast kdump
* action #49289: Regression test yast mail
* action #49304: Regression test yast nis
* action #49310: Regression test yast proxy
* action #49328: Regression test yast sound
* action #49331: Regression test yast security
* coordination #49889: [functional][epic][y] Switch between installation/install shell in specific scenarios (hyperv, ssh,vnc)
* action #50366: y2uitest_ncurses tests enablement for QAM : yast2_ntpclient.pm
* action #50369: y2uitest_ncurses tests enablement for QAM : yast2_proxy.pm
* coordination #50672: [funtional][y][epic] Use libyui-rest-api for YaST modules testing
* coordination #51665: [functional][y][s390][epic] Create new test suite for s390 specific yast modules
* action #53243: [functional][y] Automate scenario for full disk as LVM PV
* coordination #56477: Implement notifications in case specific files were changed in PR
* action #57788: [functional][y] Introduce automated test with half-backed network installation
* action #58505: [functional][y][timboxed: 12h] Make console switching working for hyper-v backend in the installer
* action #59070: [functional][y] Get https://github.com/libyui/libyui-rest-api/pull/3 and related PRs merged
* action #62741: [functional][y] Check if renamed/deleted modules are not mentioned in any of schedules
* action #63256: [functional][y][SLE-7396][SLE-7634] Automate I/O device pre-configuration - installer part (yast and linuxrc) scenario
* action #63331: [functional][y] Test that test data files exist in case mentioned in the schedule
* action #63715: Extend openQA test for bug #1140040
* action #64752: [functional][y] Test that test data files exist in case mentioned in the schedule
* action #65100: [functional][y] Changing a value in an element does not trigger events to reload other elements of the window.
* action #65381: [functional][y] Add support for YDateField and YTimeField
* action #65384: [functional][y] Use JSON in all responses from libyui-rest-api
* action #65390: [functional][y] Add ability to enter text for editable YComboBox 
* action #65396: [functional][y] Move YRichText and YMenuButton out of "press" action block
* coordination #66209: [functional][y][epic] Move all yast modules tests from Functional job group to YaST
* coordination #66394: [epic][y] Enable VNC+SSH Installations on aarch64
* action #66415: [functional][y] Implement libyui_client widgets required to make test for expert partitioner
* action #66685: [functional][y] Create automated test for "try" feature used in ifcfg option.
* action #66769: [functional][y] Add support to search widgets using regexp as a filter
* action #67171: [functional][y] Make check enabled by VALIDATE_ETC_HOSTS work on s390x
* action #67393: [functional][y] Selection of rows does not work as expected when set in  JSON in different order than are displayed
* action #67669: [y] Enable yast2_lan_restart_bond module for s390x
* action #68579: [y] gitlab-ci needs another stage for verify_file_existence
* action #68708: [functional][y] Generate support_server image for SLES on aarch64
* action #68714: [functional][y] Enable ssh MM installations on aarch64 for SLES
* action #68797: [functional][y] Remove workaround for KDE Live installation/upgrade once openQA is more stable
* action #69175: [y] Enable firstboot_hostname yast client in first boot test
* action #69196: [y] Add validation to multipath scenario
* action #69199: [y] Schedule only relevant checks for remote_ssh_target_ftp test suite
* action #69217: [y] Add validation to nvme scenario
* action #69226: [y] Add validation to xfs scenario
* action #69259: [y] Test fully qualified domain name as an input for yast2-network
* action #69634: [y][timeboxed:24h] Add unit test for yast-metapackage-handler
* action #70561: [y] Create script to fix all licenses after new year
* action #71026: [y] Validate updated package version with self_update
* coordination #71242: [epic] Unify validation in the installed system
* action #71308: [y][timeboxed:20h] Figure out most used module for the first boot
* action #71626: [y] Reuse existing partitoning code for splitusr scenario
* coordination #71662: [epic][y] Improve managing/grouping test suites
* action #71665: [y][timeboxed:12h] Research on grouping of test suites in openQA
* action #71707: [y][sporadic] test fails in nis_server
* action #72064: [y] Verify fixes for resolved-fixed bugs
* coordination #73225: Get rid of AUTOYAST_VERIFY for AutoYaST validations 
* action #76882: Unit test for yast2-metapackage-handler OneClickInstall.rb (part II)
* action #76999: Deprecate yast2_cmd/yast_lan.pm
* coordination #81028: [epic] Test YaST modules with OOP framework with yui-rest-client and validate its configuration
* coordination #81030: [epic] Enable saving/booting snapshot in PowerVM
* action #81310: [sporadic][timeboxed:10h] test fails in mediacheck on svirt uefi
* action #87716: [qem][QU] test fails in scc_registration (Full image)
* action #87841: [SLE-12280] Hibernation proposed by Installer/Bootloader
* coordination #87910: Separate libyui REST API to separate cpan module
* coordination #87916: Rewrite partitioning to use libyui REST API
* coordination #88069: [epic] Redesign "welcome" and "accept_license" test modules using OOP and libyui-rest-api
* action #88285: Monitor sporadic issue where ncurses UI does not really disappear.
* coordination #88789: Create atomic modules to avoid unnecessary yaml schedules duplicates
* coordination #89212: Testing wi-fi networking configuration in yast2 network
* coordination #89476: Develop logging to the libyui REST API tests
* action #89542: Research alternatives to validate AutoYaST profiles
* coordination #90296: [SLE-16263][SLE-16359] An easy way to check or (re)configure the installer settings
* action #90350: Add yast2_system_settings for ncurses
* action #113725: Make autoyast tests exit when the autoyast profile encounter issues
* action #116851: test fails in check_system_info - sle-module-basesystem is not in the output of zypper lr