Project

General

Custom queries

Profile

Actions

coordination #127031

open

[saga][epic] openQA for SUSE customers

Added by okurz over 1 year ago. Updated 7 days ago.

Status:
Blocked
Priority:
High
Assignee:
Category:
Feature requests
Target version:
Start date:
2020-11-04
Due date:
% Done:

51%

Estimated time:
(Total: 0.00 h)
Tags:

Description

Motivation

SUSE customers build their own products based on SUSE products including SLE, OBS, openQA. So we must ensure openQA is usable for customers and by customers

Acceptance criteria

  • AC1: openQA (webUI+worker) is continuously built+tested+published on latest SLE+packagehub
  • AC2: python based openQA tests are usable for testing new products

Further details


Subtasks 107 (36 open71 closed)

coordination #80150: [epic] Scale out openQA: Easier openQA setupBlockedokurz2020-11-04

Actions
action #76978: How to run an openQA test in 5 minutes size:MResolvedjbaier_cz2020-11-04

Actions
action #80382: Provide installation recipes for automatic installations of openQA worker machinesWorkable2020-11-25

Actions
action #89920: Extend existing openQA-in-openQA tests as a learning exercise to know where our instructions or beginner situation can be improvedNew2021-03-11

Actions
action #90038: Better error handling when reading API key+secret from ~/.config/openqa/client.confResolvedmkittler2021-03-12

Actions
coordination #90758: [epic] python bindings for openQAResolvedokurz2021-04-07

Actions
action #90761: os-autoinst-distri-opensuse CI checks fail due to `cpanm --installdeps` failing on Inline::PythonResolvedosukup2021-04-07

Actions
action #91257: try out python backend for production tests in a new test distribution or os-autoinst-distri-openQAResolvedlivdywan2021-04-15

Actions
action #91653: Python tests fail with generic error message regardless of the problem size:MResolvedmkittler2021-04-23

Actions
coordination #93609: [epic] openqa-bootstrap support on Leap 15.3Resolvedmkittler2021-06-07

Actions
action #95317: openqa-bootstrap on Leap 15.3 from devel:openQA passesResolvedmkittler2021-06-07

Actions
action #95320: openqa-bootstrap on Leap 15.3 from official repos passesResolvedmkittler2021-06-07

Actions
action #95323: openqa-bootstrap support on current version of Leap - automatic test size:SResolvedmkittler2021-07-09

Actions
action #95185: openqa-bootstrap ignores errors when systemd is not availableResolveddheidler2021-07-07

Actions
action #129883: all-in-one openQA container solutionResolvedokurz

Actions
action #129958: Ensure openSUSE container best practices are followed for our container images in devel: openQA size:MResolvedjbaier_cz2023-05-28

Actions
action #138440: devel:openQA container files follow cha.obs.supported_formats#id-1.5.10.8.5 and set BuildVersion+BuildName consistently size:SResolvedjbaier_cz

Actions
action #153499: Ensure the openQA developer mode works straight-forward in the container setup when following our documentation size:MResolvedmkittler2024-01-13

Actions
action #155473: Avoid the need for API keys within the same container/clientRejected2024-01-13

Actions
action #155491: Extend documentation for single-instance-container covering at least how to trigger/clone existing jobs size:SResolvedjbaier_cz2024-01-13

Actions
action #162119: Restructure and simplify documentation with a single suggested way for newcomers how to get startedNew2024-01-13

Actions
action #165399: Unable to use openqa-single-instance due to "Valid metadata not found at specified URL" reproducing often size:SResolvedmkittler2024-08-16

Actions
action #174295: The cache loading from the fixed folder is not working size:SWorkable2024-12-12

Actions
coordination #127028: [epic] openQA on SLE+packagehubBlockedokurz2023-03-31

Actions
action #127034: [spike][timeboxed:20h] Run openQA (webUI+worker) based on SLE to find out problems size:MResolvedmkittler2023-03-31

Actions
action #127037: os-autoinst on SLE+packagehub size:MWorkable2023-03-31

Actions
action #127286: Run openQA (webUI+worker) based on SLE+packagehub size:MWorkable2023-03-31

Actions
action #127541: Test os-autoinst+openQA against openSUSE:Backports:SLE-X in pull request OBS CI checks size:MResolvedybonatakis2023-03-31

Actions
action #127757: Cover SLE in openQA docsResolvedokurz

Actions
action #127883: Cleanup OBS project devel:openQA:Leap:15.4Resolvedtinita2023-04-18

Actions
action #128087: Regular cleanup of OBS project devel:openQA:* size:MResolvedjbaier_cz

Actions
action #129949: Enable build+test of openQA and deps on s390xResolvedokurz2023-05-27

Actions
action #132458: Fix documentation ambiguity about openQA-worker installation on SLE size:SResolveddheidler2023-07-07

Actions
action #150959: openQA fails to build on SLE/Leap 15.6 Backports due to test-unit-and-integration failures size:MResolvedosukup2023-11-16

Actions
action #160715: Error message in obs-check-package-origin size:SResolvedjbaier_cz2024-05-22

Actions
openQA Infrastructure (public) - action #168949: Deploy OSD from SLE+packagehub instead of custom OBS repo devel:openQANew2023-03-31

Actions
action #127868: [qaaas] openQA test results should be archived and not tampered size:MNew2023-04-18

Actions
coordination #127910: [epic] openQA in SLE modulesResolvedokurz2023-03-01

Actions
QA (public) - action #127907: jenkins package (and others) not upgraded on jenkins.qa.suse.de since some time size:MResolvedokurz2023-04-19

Actions
action #128318: [spike][timeboxed:20h] Current openQA+os-autoinst+dependencies in pure SLE size:MResolvedmkittler2023-04-26

Actions
action #128651: [spike][timeboxed:20h] Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:MResolvedjbaier_cz2023-04-26

Actions
action #132236: Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:M Closeddheidler2023-04-26

Actions
action #132395: Current openQA+os-autoinst+dependencies are updated automatically in SLE+packagehubRejectedokurz

Actions
action #154723: Complete list of openQA+os-autoinst+dependencies packages not currently in current SLE in development is known size:MResolvedjbaier_cz2023-04-26

Actions
openQA Tests (public) - action #154747: [qe-core] Complete list of os-autoinst-distri-opensuse dependencies not currently in current SLE and also not provided already by openQA itselfRejectedokurz2023-03-01

Actions
action #155512: Complete list of openQA+os-autoinst+dependencies packages not currently in current SLE in development is known - automatically and recurringly generated size:MResolvedjbaier_cz

Actions
action #161432: Sporadic package failures in devel:openQA/openQA/15.6/s390x on "Could not find input asset "../node_modules/datatables.net-bs4/css/dataTables.bootstrap4.min.css"Resolvedokurz2024-06-03

Actions
action #165683: Current openQA+os-autoinst+dependencies in pure SLE size:MResolvedmkittler2024-08-22

Actions
coordination #129313: [epic] openQA on ALPNew2023-05-15

Actions
action #129316: [spike][timeboxed:20h] openQA container on ALPResolvedokurz2023-05-15

Actions
coordination #130414: [epic] Improved code coverage in os-autoinstBlockedokurz2023-01-10

Actions
action #122929: [os-autoinst] Unhandled test output in t/18-backend-qemu.t size:SResolvedosukup2023-01-10

Actions
action #130417: Improved code coverage in os-autoinst - consoles/amtSol or remove along with the deprecated backend size:SResolvedybonatakis2023-06-06

Actions
action #130420: Improved code coverage in os-autoinst - testapi size:SResolvedmkittler2023-06-06

Actions
action #130423: Improved code coverage in os-autoinst - all the restNew2023-06-06

Actions
action #166661: [beginner][os-autoinst][CI] Unhandled output in t/20-openqa-isotovideo-utils.t size:SResolvedjbaier_cz2024-09-11

Actions
action #166664: [beginner][os-autoinst][CI] Unhandled output in t/23-baseclass.t size:SResolvedjbaier_cz2024-09-11

Actions
action #166667: [beginner][os-autoinst][CI] Unhandled output in t/26-video_stream.t size:SResolvedjbaier_cz2024-09-11

Actions
action #166670: [beginner][os-autoinst][CI] Unhandled output in t/27-consoles-local_xvnc.t size:SResolvedjbaier_cz2024-09-11

Actions
action #166673: [beginner][os-autoinst][CI] Unhandled output in t/29-backend-ipmi.t size:SResolvedrobert.richardson2024-09-11

Actions
action #167920: Cover code of os-autoinst path consoles/ fully (statement coverage)Blockedokurz

Actions
action #167923: Cover code of os-autoinst path script/ fully (statement coverage)Blockedokurz2024-10-08

Actions
action #167926: Cover code of os-autoinst path autotest.pm fully (statement coverage) size:SIn Progressgpathak2024-10-08

Actions
action #167929: Cover code of os-autoinst path testapi.pm fully (statement coverage) size:MResolvedmkittler2024-10-08

Actions
action #167932: Cover code of os-autoinst path needle.pm fully (statement coverage) size:SIn Progressgpuliti2024-10-08

Actions
action #167935: Cover code of os-autoinst path myjsonrpc.pm fully (statement coverage) size:SResolvedgpuliti2024-10-08

Actions
action #167938: Cover code of os-autoinst path lockapi.pm fully (statement coverage) size:SResolvedgpuliti2024-10-08

Actions
action #167941: Cover code of os-autoinst path distribution.pm fully (statement coverage) size:SIn Progressgpathak2024-10-08

Actions
action #167944: Cover code of os-autoinst path cv.pm fully (statement coverage)Resolvedokurz2024-10-08

Actions
action #167947: Cover code of os-autoinst path commands.pm fully (statement coverage) size:SWorkable2024-10-08

Actions
action #167950: Cover code of os-autoinst path basetest.pm fully (statement coverage)Resolvedokurz2024-10-08

Actions
action #167953: Ensure complete statement coverage within os-autoinstNew2024-10-08

Actions
action #168364: Improved code coverage in os-autoinst - consoles/s3270 size:MWorkable2023-06-06

Actions
action #168367: Improved code coverage in os-autoinst - consoles/sshIucvconn.pm size:SResolvedybonatakis2023-06-06

Actions
action #168370: Improved code coverage in os-autoinst - consoles/sshVirtsh.pm size:MResolvedybonatakis2023-06-06

Actions
action #170476: Cover code of os-autoinst path backend/ fully (statement coverage) (again)Resolvedjbaier_cz2024-11-28

Actions
action #174094: [beginner][os-autoinst][CI] Unhandled output in t/08-autotest.t size:SResolvedgpathak

Actions
action #174229: Cover code of os-autoinst path script/check_qemu_oom fully (statement coverage) size:SResolvedgpuliti2024-10-08

Actions
action #174232: Cover code of os-autoinst path script/dewebsockify fully (statement coverage) size:SWorkablerobert.richardson2024-10-08

Actions
action #174235: Cover code of os-autoinst path script/os-autoinst-openvswitch fully (statement coverage) size:SWorkable2024-10-08

Actions
action #174238: Cover code of os-autoinst path script/vnctest fully (statement coverage) size:SWorkable2024-10-08

Actions
action #174244: Improved code coverage in os-autoinst - consoles/sshXtermVt.pm size:SFeedback

Actions
action #174247: Improved code coverage in os-autoinst - consoles/s3270.pm size:SRejectedokurz2024-12-12

Actions
action #174250: Improved code coverage in os-autoinst - consoles/sshXtermIPMI.pm size:SWorkable2024-12-12

Actions
action #174253: Improved code coverage in os-autoinst - consoles/video_stream.pm size:SWorkable2024-12-12

Actions
action #174256: Improved code coverage in os-autoinst - consoles/ssh_screen.pm size:SResolvedgpuliti2024-12-12

Actions
action #174268: Improved code coverage in os-autoinst - consoles/video_base.pm size:SResolvedgpuliti2024-12-12

Actions
action #174271: Improved code coverage in os-autoinst - consoles/vnc_base.pm size:SResolvedgpuliti2024-12-12

Actions
coordination #138365: [epic] openQA works in SELinux enforced environmentsBlockedokurz2023-10-23

Actions
openQA Tests (public) - action #138368: [qe-core] An openQA-in-openQA test runs in any openSUSE/SLE test with SELinux enforcedBlockedvkatkalov2023-10-23

Actions
coordination #152955: [epic] Metric-driven project management in SUSE QE Tools teamBlockedokurz2023-12-28

Actions
action #152957: Weekly evaluation of cycle-times within SUSE QE Tools size:SResolvedlivdywan2023-12-28

Actions
QA (public) - action #155917: [backlogger] Count "Feedback" ticket state for cycle time as well size:SResolvedokurz2024-02-23

Actions
openQA Infrastructure (public) - action #158556: Single-value SLI of OSD HTTP response code successful vs. all size:SResolvedokurz2024-04-07

Actions
openQA Infrastructure (public) - action #158559: Single-value SLI of OSD HTTP response time size:SResolvedokurz2024-04-07

Actions
action #158808: Prevent HTTP response codes 500 as observed in OSD monitoring size:MResolvedmkittler

Actions
action #159327: [research][timeboxed:10h] investigate and benchmark OSD, in particular /, /tests, test details pages size:SWorkable2024-04-19

Actions
action #168184: Show a notification for jobs that have worker classes that are not fulfilled by any currently online or registered workerNew2024-10-01

Actions
coordination #165393: [epic] Improved code coverage in openQANew2024-09-06

Actions
action #165396: Improved code coverage in openQA for unit tests in t/ size:SResolvedmkittler

Actions
openQA Tests (public) - action #166445: [openQA-in-openQA][sporadic] test fails in tests, simple_boot incomplete auto_review:"no candidate needle.*openqa-test-details.*matched":retry size:SWorkable2024-09-06

Actions
action #167482: [sporadic] codecov checks missing from pull requests size:SResolvedybonatakis2024-09-13

Actions
action #167611: [sporadic] t/ui/21-admin-needles.t fails - Failed test 'search five_month needle correctly' size:SResolvedmkittler2024-09-30

Actions
action #167803: flaky coverage: lib/OpenQA/Shared/Controller/Running.pm size:SResolvedmkittler2024-10-04

Actions
action #167914: Improved code coverage in openQA in lib/OpenQA/WorkerResolvedmkittler2024-10-08

Actions
action #173881: Cover code of openQA path script/client fully (statement coverage)New

Actions
action #174259: [sporadic] isotovideo fails complaining about still existing testfd filehandle size:MWorkabletinita

Actions

Related issues 1 (0 open1 closed)

Related to openQA Tests (public) - action #126590: [qe-core] loading tests in Python is broken when using YAMLResolvedmgrifalconi2023-03-24

Actions
#1

Updated by okurz over 1 year ago

#2

Updated by szarate over 1 year ago

  • Related to action #126590: [qe-core] loading tests in Python is broken when using YAML added
#5

Updated by okurz over 1 year ago

  • Target version changed from Ready to Tools - Next
#6

Updated by okurz about 1 year ago

  • Subtask #138365 added
#7

Updated by okurz 12 months ago

  • Subtask #152955 added
#8

Updated by okurz 7 months ago

  • Target version changed from Tools - Next to Ready
#9

Updated by okurz 4 months ago

  • Subtask #165393 added
#10

Updated by okurz 3 months ago

  • Subtask #167917 added
#11

Updated by okurz 2 months ago

  • Subtask deleted (#167917)
#12

Updated by mkittler 27 days ago

  • Subtask #173365 added
Actions

Also available in: Atom PDF