Project

General

Profile

Actions
Copy link

coordination #127031

open

[saga][epic] openQA for SUSE customers

Added by okurz over 1 year ago. Updated about 16 hours ago.

Status:
Blocked
Priority:
Normal
Assignee:
okurz
Category:
Feature requests
Target version:
Ready
Start date:
2020-11-04
Due date:
% Done:

51%

Estimated time:
(Total: 0.00 h)
Tags:
qaaas

Description

Motivation

SUSE customers build their own products based on SUSE products including SLE, OBS, openQA. So we must ensure openQA is usable for customers and by customers

Acceptance criteria

  • AC1: openQA (webUI+worker) is continuously built+tested+published on latest SLE+packagehub
  • AC2: python based openQA tests are usable for testing new products

Further details

Subtasks 107 (37 open — 70 closed)

coordination #80150: [epic] Scale out openQA: Easier openQA setupBlockedokurz2020-11-04

Actions
action #76978: How to run an openQA test in 5 minutes size:MResolvedjbaier_cz2020-11-04

Actions
action #80382: Provide installation recipes for automatic installations of openQA worker machinesWorkable2020-11-25

Actions
action #89920: Extend existing openQA-in-openQA tests as a learning exercise to know where our instructions or beginner situation can be improvedNew2021-03-11

Actions
action #90038: Better error handling when reading API key+secret from ~/.config/openqa/client.confResolvedmkittler2021-03-12

Actions
coordination #90758: [epic] python bindings for openQAResolvedokurz2021-04-07

Actions
action #90761: os-autoinst-distri-opensuse CI checks fail due to `cpanm --installdeps` failing on Inline::PythonResolvedosukup2021-04-07

Actions
action #91257: try out python backend for production tests in a new test distribution or os-autoinst-distri-openQAResolvedlivdywan2021-04-15

Actions
action #91653: Python tests fail with generic error message regardless of the problem size:MResolvedmkittler2021-04-23

Actions
coordination #93609: [epic] openqa-bootstrap support on Leap 15.3Resolvedmkittler2021-06-07

Actions
action #95317: openqa-bootstrap on Leap 15.3 from devel:openQA passesResolvedmkittler2021-06-07

Actions
action #95320: openqa-bootstrap on Leap 15.3 from official repos passesResolvedmkittler2021-06-07

Actions
action #95323: openqa-bootstrap support on current version of Leap - automatic test size:SResolvedmkittler2021-07-09

Actions
action #95185: openqa-bootstrap ignores errors when systemd is not availableResolveddheidler2021-07-07

Actions
action #129883: all-in-one openQA container solutionResolvedokurz

Actions
action #129958: Ensure openSUSE container best practices are followed for our container images in devel: openQA size:MResolvedjbaier_cz2023-05-28

Actions
action #138440: devel:openQA container files follow cha.obs.supported_formats#id-1.5.10.8.5 and set BuildVersion+BuildName consistently size:SResolvedjbaier_cz

Actions
action #153499: Ensure the openQA developer mode works straight-forward in the container setup when following our documentation size:MResolvedmkittler2024-01-13

Actions
action #155473: Avoid the need for API keys within the same container/clientRejected2024-01-13

Actions
action #155491: Extend documentation for single-instance-container covering at least how to trigger/clone existing jobs size:SResolvedjbaier_cz2024-01-13

Actions
action #162119: Restructure and simplify documentation with a single suggested way for newcomers how to get startedNew2024-01-13

Actions
action #165399: Unable to use openqa-single-instance due to "Valid metadata not found at specified URL" reproducing often size:SResolvedmkittler2024-08-16

Actions
action #174295: The cache loading from the fixed folder is not workingNew2024-12-12

Actions
coordination #127028: [epic] openQA on SLE+packagehubBlockedokurz2023-03-31

Actions
action #127034: [spike][timeboxed:20h] Run openQA (webUI+worker) based on SLE to find out problems size:MResolvedmkittler2023-03-31

Actions
action #127037: os-autoinst on SLE+packagehub size:MWorkable2023-03-31

Actions
action #127286: Run openQA (webUI+worker) based on SLE+packagehub size:MWorkable2023-03-31

Actions
action #127541: Test os-autoinst+openQA against openSUSE:Backports:SLE-X in pull request OBS CI checks size:MResolvedybonatakis2023-03-31

Actions
action #127757: Cover SLE in openQA docsResolvedokurz

Actions
action #127883: Cleanup OBS project devel:openQA:Leap:15.4Resolvedtinita2023-04-18

Actions
action #128087: Regular cleanup of OBS project devel:openQA:* size:MResolvedjbaier_cz

Actions
action #129949: Enable build+test of openQA and deps on s390xResolvedokurz2023-05-27

Actions
action #132458: Fix documentation ambiguity about openQA-worker installation on SLE size:SResolveddheidler2023-07-07

Actions
action #150959: openQA fails to build on SLE/Leap 15.6 Backports due to test-unit-and-integration failures size:MResolvedosukup2023-11-16

Actions
action #160715: Error message in obs-check-package-origin size:SResolvedjbaier_cz2024-05-22

Actions
openQA Infrastructure (public) - action #168949: Deploy OSD from SLE+packagehub instead of custom OBS repo devel:openQANew2023-03-31

Actions
action #127868: [qaaas] openQA test results should be archived and not tampered size:MNew2023-04-18

Actions
coordination #127910: [epic] openQA in SLE modulesResolvedokurz2023-03-01

Actions
QA (public) - action #127907: jenkins package (and others) not upgraded on jenkins.qa.suse.de since some time size:MResolvedokurz2023-04-19

Actions
action #128318: [spike][timeboxed:20h] Current openQA+os-autoinst+dependencies in pure SLE size:MResolvedmkittler2023-04-26

Actions
action #128651: [spike][timeboxed:20h] Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:MResolvedjbaier_cz2023-04-26

Actions
action #132236: Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:M Closeddheidler2023-04-26

Actions
action #132395: Current openQA+os-autoinst+dependencies are updated automatically in SLE+packagehubRejectedokurz

Actions
action #154723: Complete list of openQA+os-autoinst+dependencies packages not currently in current SLE in development is known size:MResolvedjbaier_cz2023-04-26

Actions
openQA Tests (public) - action #154747: [qe-core] Complete list of os-autoinst-distri-opensuse dependencies not currently in current SLE and also not provided already by openQA itselfRejectedokurz2023-03-01

Actions
action #155512: Complete list of openQA+os-autoinst+dependencies packages not currently in current SLE in development is known - automatically and recurringly generated size:MResolvedjbaier_cz

Actions
action #161432: Sporadic package failures in devel:openQA/openQA/15.6/s390x on "Could not find input asset "../node_modules/datatables.net-bs4/css/dataTables.bootstrap4.min.css"Resolvedokurz2024-06-03

Actions
action #165683: Current openQA+os-autoinst+dependencies in pure SLE size:MResolvedmkittler2024-08-22

Actions
coordination #129313: [epic] openQA on ALPNew2023-05-15

Actions
action #129316: [spike][timeboxed:20h] openQA container on ALPResolvedokurz2023-05-15

Actions
coordination #130414: [epic] Improved code coverage in os-autoinstBlockedokurz2023-01-10

Actions
action #122929: [os-autoinst] Unhandled test output in t/18-backend-qemu.t size:SResolvedosukup2023-01-10

Actions
action #130417: Improved code coverage in os-autoinst - consoles/amtSol or remove along with the deprecated backend size:SResolvedybonatakis2023-06-06

Actions
action #130420: Improved code coverage in os-autoinst - testapi size:SResolvedmkittler2023-06-06

Actions
action #130423: Improved code coverage in os-autoinst - all the restNew2023-06-06

Actions
action #166661: [beginner][os-autoinst][CI] Unhandled output in t/20-openqa-isotovideo-utils.t size:SResolvedjbaier_cz2024-09-11

Actions
action #166664: [beginner][os-autoinst][CI] Unhandled output in t/23-baseclass.t size:SResolvedjbaier_cz2024-09-11

Actions
action #166667: [beginner][os-autoinst][CI] Unhandled output in t/26-video_stream.t size:SResolvedjbaier_cz2024-09-11

Actions
action #166670: [beginner][os-autoinst][CI] Unhandled output in t/27-consoles-local_xvnc.t size:SResolvedjbaier_cz2024-09-11

Actions
action #166673: [beginner][os-autoinst][CI] Unhandled output in t/29-backend-ipmi.t size:SResolvedrobert.richardson2024-09-11

Actions
action #167920: Cover code of os-autoinst path consoles/ fully (statement coverage)Blockedokurz

Actions
action #167923: Cover code of os-autoinst path script/ fully (statement coverage)Blockedokurz2024-10-08

Actions
action #167926: Cover code of os-autoinst path autotest.pm fully (statement coverage) size:SIn Progressgpathak2024-10-08

Actions
action #167929: Cover code of os-autoinst path testapi.pm fully (statement coverage) size:MResolvedmkittler2024-10-08

Actions
action #167932: Cover code of os-autoinst path needle.pm fully (statement coverage) size:SWorkable2024-10-08

Actions
action #167935: Cover code of os-autoinst path myjsonrpc.pm fully (statement coverage) size:SResolvedgpuliti2024-10-08

Actions
action #167938: Cover code of os-autoinst path lockapi.pm fully (statement coverage) size:SResolvedgpuliti2024-10-08

Actions
action #167941: Cover code of os-autoinst path distribution.pm fully (statement coverage) size:SIn Progressgpathak2024-10-08

Actions
action #167944: Cover code of os-autoinst path cv.pm fully (statement coverage)Resolvedokurz2024-10-08

Actions
action #167947: Cover code of os-autoinst path commands.pm fully (statement coverage) size:SWorkable2024-10-08

Actions
action #167950: Cover code of os-autoinst path basetest.pm fully (statement coverage)Resolvedokurz2024-10-08

Actions
action #167953: Ensure complete statement coverage within os-autoinstNew2024-10-08

Actions
action #168364: Improved code coverage in os-autoinst - consoles/s3270 size:MWorkable2023-06-06

Actions
action #168367: Improved code coverage in os-autoinst - consoles/sshIucvconn.pm size:SResolvedybonatakis2023-06-06

Actions
action #168370: Improved code coverage in os-autoinst - consoles/sshVirtsh.pm size:MResolvedybonatakis2023-06-06

Actions
action #170476: Cover code of os-autoinst path backend/ fully (statement coverage) (again)Resolvedjbaier_cz2024-11-28

Actions
action #174094: [beginner][os-autoinst][CI] Unhandled output in t/08-autotest.t size:SResolvedgpathak

Actions
action #174229: Cover code of os-autoinst path script/check_qemu_oom fully (statement coverage) size:SResolvedgpuliti2024-10-08

Actions
action #174232: Cover code of os-autoinst path script/dewebsockify fully (statement coverage) size:SIn Progressrobert.richardson2024-10-08

Actions
action #174235: Cover code of os-autoinst path script/os-autoinst-openvswitch fully (statement coverage) size:SWorkable2024-10-08

Actions
action #174238: Cover code of os-autoinst path script/vnctest fully (statement coverage) size:SWorkable2024-10-08

Actions
action #174244: Improved code coverage in os-autoinst - consoles/sshXterm.pm size:SWorkable

Actions
action #174247: Improved code coverage in os-autoinst - consoles/s3270.pm size:SRejectedokurz2024-12-12

Actions
action #174250: Improved code coverage in os-autoinst - consoles/sshXtermIPMI.pm size:SWorkable2024-12-12

Actions
action #174253: Improved code coverage in os-autoinst - consoles/video_stream.pm size:SWorkable2024-12-12

Actions
action #174256: Improved code coverage in os-autoinst - consoles/ssh_screen.pm size:SIn Progressgpuliti2024-12-12

Actions
action #174268: Improved code coverage in os-autoinst - consoles/video_base.pm size:SResolvedgpuliti2024-12-12

Actions
action #174271: Improved code coverage in os-autoinst - consoles/vnc_base.pm size:SResolvedgpuliti2024-12-12

Actions
coordination #138365: [epic] openQA works in SELinux enforced environmentsBlockedokurz2023-10-23

Actions
openQA Tests (public) - action #138368: [qe-core] An openQA-in-openQA test runs in any openSUSE/SLE test with SELinux enforcedBlockedvkatkalov2023-10-23

Actions
coordination #152955: [epic] Metric-driven project management in SUSE QE Tools teamBlockedokurz2023-12-28

Actions
action #152957: Weekly evaluation of cycle-times within SUSE QE Tools size:SResolvedlivdywan2023-12-28

Actions
QA (public) - action #155917: [backlogger] Count "Feedback" ticket state for cycle time as well size:SResolvedokurz2024-02-23

Actions
openQA Infrastructure (public) - action #158556: Single-value SLI of OSD HTTP response code successful vs. all size:SResolvedokurz2024-04-07

Actions
openQA Infrastructure (public) - action #158559: Single-value SLI of OSD HTTP response time size:SResolvedokurz2024-04-07

Actions
action #158808: Prevent HTTP response codes 500 as observed in OSD monitoring size:MResolvedmkittler

Actions
action #159327: [research][timeboxed:10h] investigate and benchmark OSD, in particular /, /tests, test details pages size:SWorkable2024-04-19

Actions
action #168184: Show a notification for jobs that have worker classes that are not fulfilled by any currently online or registered workerNew2024-10-01

Actions
coordination #165393: [epic] Improved code coverage in openQANew2024-09-06

Actions
action #165396: Improved code coverage in openQA for unit tests in t/ size:SResolvedmkittler

Actions
openQA Tests (public) - action #166445: [openQA-in-openQA][sporadic] test fails in tests, simple_boot incomplete auto_review:"no candidate needle.*openqa-test-details.*matched":retry size:SWorkable2024-09-06

Actions
action #167482: [sporadic] codecov checks missing from pull requests size:SResolvedybonatakis2024-09-13

Actions
action #167611: [sporadic] t/ui/21-admin-needles.t fails - Failed test 'search five_month needle correctly' size:SResolvedmkittler2024-09-30

Actions
action #167803: flaky coverage: lib/OpenQA/Shared/Controller/Running.pm size:SResolvedmkittler2024-10-04

Actions
action #167914: Improved code coverage in openQA in lib/OpenQA/WorkerResolvedmkittler2024-10-08

Actions
action #173881: Cover code of openQA path script/client fully (statement coverage)New

Actions
action #174259: [sporadic] isotovideo fails complaining about still existing testfd filehandle size:MWorkabletinita

Actions

Related issues 1 (0 open — 1 closed)

Related to openQA Tests (public) - action #126590: [qe-core] loading tests in Python is broken when using YAMLResolvedmgrifalconi2023-03-24

Actions
Actions
Copy link

Also available in: Atom PDF