Project

General

Profile

Actions

coordination #127031

open

[saga][epic] openQA for SUSE customers

Added by okurz over 1 year ago. Updated about 21 hours ago.

Status:
Blocked
Priority:
High
Assignee:
Category:
Feature requests
Target version:
Start date:
2020-11-04
Due date:
2024-10-22 (Due in 10 days)
% Done:

42%

Estimated time:
(Total: 0.00 h)
Tags:

Description

Motivation

SUSE customers build their own products based on SUSE products including SLE, OBS, openQA. So we must ensure openQA is usable for customers and by customers

Acceptance criteria

  • AC1: openQA (webUI+worker) is continuously built+tested+published on latest SLE+packagehub
  • AC2: python based openQA tests are usable for testing new products

Further details


Subtasks 87 (40 open47 closed)

coordination #80150: [epic] Scale out openQA: Easier openQA setupBlockedokurz2020-11-04

Actions
action #76978: How to run an openQA test in 5 minutes size:MResolvedjbaier_cz2020-11-04

Actions
action #80382: Provide installation recipes for automatic installations of openQA worker machinesWorkable2020-11-25

Actions
action #89920: Extend existing openQA-in-openQA tests as a learning exercise to know where our instructions or beginner situation can be improvedNew2021-03-11

Actions
action #90038: Better error handling when reading API key+secret from ~/.config/openqa/client.confResolvedmkittler2021-03-12

Actions
coordination #90758: [epic] python bindings for openQAResolvedokurz2021-04-07

Actions
action #90761: os-autoinst-distri-opensuse CI checks fail due to `cpanm --installdeps` failing on Inline::PythonResolvedosukup2021-04-07

Actions
action #91257: try out python backend for production tests in a new test distribution or os-autoinst-distri-openQAResolvedlivdywan2021-04-15

Actions
action #91653: Python tests fail with generic error message regardless of the problem size:MResolvedmkittler2021-04-23

Actions
coordination #93609: [epic] openqa-bootstrap support on Leap 15.3Resolvedmkittler2021-06-07

Actions
action #95317: openqa-bootstrap on Leap 15.3 from devel:openQA passesResolvedmkittler2021-06-07

Actions
action #95320: openqa-bootstrap on Leap 15.3 from official repos passesResolvedmkittler2021-06-07

Actions
action #95323: openqa-bootstrap support on current version of Leap - automatic test size:SResolvedmkittler2021-07-09

Actions
action #95185: openqa-bootstrap ignores errors when systemd is not availableResolveddheidler2021-07-07

Actions
action #129883: all-in-one openQA container solutionResolvedokurz

Actions
action #129958: Ensure openSUSE container best practices are followed for our container images in devel: openQA size:MResolvedjbaier_cz2023-05-28

Actions
action #138440: devel:openQA container files follow cha.obs.supported_formats#id-1.5.10.8.5 and set BuildVersion+BuildName consistently size:SResolvedjbaier_cz

Actions
action #153499: Ensure the openQA developer mode works straight-forward in the container setup when following our documentation size:MResolvedmkittler2024-01-13

Actions
action #155473: Avoid the need for API keys within the same container/clientRejected2024-01-13

Actions
action #155491: Extend documentation for single-instance-container covering at least how to trigger/clone existing jobs size:SResolvedjbaier_cz2024-01-13

Actions
action #162119: Restructure and simplify documentation with a single suggested way for newcomers how to get startedNew2024-01-13

Actions
action #165399: Unable to use openqa-single-instance due to "Valid metadata not found at specified URL" reproducing often size:SResolvedmkittler2024-08-16

Actions
coordination #127028: [epic] openQA on SLE+packagehubBlockedokurz2023-03-31

Actions
action #127034: [spike][timeboxed:20h] Run openQA (webUI+worker) based on SLE to find out problems size:MResolvedmkittler2023-03-31

Actions
action #127037: os-autoinst on SLE+packagehub size:MRejectedokurz2023-03-31

Actions
action #127286: Run openQA (webUI+worker) based on SLE+packagehub size:MRejectedokurz2023-03-31

Actions
action #127541: Test os-autoinst+openQA against openSUSE:Backports:SLE-X in pull request OBS CI checks size:MResolvedybonatakis2023-03-31

Actions
action #127757: Cover SLE in openQA docsResolvedokurz

Actions
action #127883: Cleanup OBS project devel:openQA:Leap:15.4Resolvedtinita2023-04-18

Actions
action #128087: Regular cleanup of OBS project devel:openQA:* size:MResolvedjbaier_cz

Actions
action #129949: Enable build+test of openQA and deps on s390xResolvedokurz2023-05-27

Actions
action #132458: Fix documentation ambiguity about openQA-worker installation on SLE size:SResolveddheidler2023-07-07

Actions
action #150959: openQA fails to build on SLE/Leap 15.6 Backports due to test-unit-and-integration failures size:MResolvedosukup2023-11-16

Actions
action #160715: Error message in obs-check-package-origin size:SResolvedjbaier_cz2024-05-22

Actions
action #127868: [qaaas] openQA test results should be archived and not tampered size:MNew2023-04-18

Actions
coordination #127910: [epic] openQA in SLE modulesResolvedokurz2023-03-01

Actions
QA - action #127907: jenkins package (and others) not upgraded on jenkins.qa.suse.de since some time size:MResolvedokurz2023-04-19

Actions
action #128318: [spike][timeboxed:20h] Current openQA+os-autoinst+dependencies in pure SLE size:MResolvedmkittler2023-04-26

Actions
action #128651: [spike][timeboxed:20h] Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:MResolvedjbaier_cz2023-04-26

Actions
action #132236: Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:M Closeddheidler2023-04-26

Actions
action #132395: Current openQA+os-autoinst+dependencies are updated automatically in SLE+packagehubRejectedokurz

Actions
action #154723: Complete list of openQA+os-autoinst+dependencies packages not currently in current SLE in development is known size:MResolvedjbaier_cz2023-04-26

Actions
openQA Tests - action #154747: [qe-core] Complete list of os-autoinst-distri-opensuse dependencies not currently in current SLE and also not provided already by openQA itselfRejectedokurz2023-03-01

Actions
action #155512: Complete list of openQA+os-autoinst+dependencies packages not currently in current SLE in development is known - automatically and recurringly generated size:MResolvedjbaier_cz

Actions
action #161432: Sporadic package failures in devel:openQA/openQA/15.6/s390x on "Could not find input asset "../node_modules/datatables.net-bs4/css/dataTables.bootstrap4.min.css"Resolvedokurz2024-06-03

Actions
action #165683: Current openQA+os-autoinst+dependencies in pure SLE size:MResolvedmkittler2024-08-22

Actions
coordination #129313: [epic] openQA on ALPNew2023-05-15

Actions
action #129316: [spike][timeboxed:20h] openQA container on ALPResolvedokurz2023-05-15

Actions
action #167245: [spike][timeboxed:20h] Current openQA+os-autoinst+dependencies based on SLFONew

Actions
coordination #130414: [epic] Improved code coverage in os-autoinstNew2023-06-06

Actions
action #130417: Improved code coverage in os-autoinst - consolesNew2023-06-06

Actions
action #130420: Improved code coverage in os-autoinst - testapi size:SWorkable2023-06-06

Actions
action #130423: Improved code coverage in os-autoinst - all the restNew2023-06-06

Actions
action #166661: [beginner][os-autoinst][CI] Unhandled output in t/20-openqa-isotovideo-utils.t size:SWorkable2024-09-11

Actions
action #166664: [beginner][os-autoinst][CI] Unhandled output in t/23-baseclass.t size:SWorkable2024-09-11

Actions
action #166667: [beginner][os-autoinst][CI] Unhandled output in t/26-video_stream.t size:SWorkable2024-09-11

Actions
action #166670: [beginner][os-autoinst][CI] Unhandled output in t/27-consoles-local_xvnc.t size:SWorkable2024-09-11

Actions
action #166673: [beginner][os-autoinst][CI] Unhandled output in t/29-backend-ipmi.t size:SWorkable2024-09-11

Actions
coordination #138365: [epic] openQA works in SELinux enforced environmentsBlockedokurz2023-10-23

Actions
openQA Tests - action #138368: [qe-core] An openQA-in-openQA test runs in any openSUSE/SLE test with SELinux enforcedWorkable2023-10-23

Actions
coordination #152955: [epic] Metric-driven project management in SUSE QE Tools teamBlockedokurz2023-12-28

Actions
action #152957: Weekly evaluation of cycle-times within SUSE QE Tools size:SResolvedlivdywan2023-12-28

Actions
QA - action #155917: [backlogger] Count "Feedback" ticket state for cycle time as well size:SResolvedokurz2024-02-23

Actions
openQA Infrastructure - action #158556: Single-value SLI of OSD HTTP response code successful vs. all size:SResolvedokurz2024-04-07

Actions
openQA Infrastructure - action #158559: Single-value SLI of OSD HTTP response time size:SResolvedokurz2024-04-07

Actions
action #158808: Prevent HTTP response codes 500 as observed in OSD monitoring size:MResolvedmkittler

Actions
action #159327: [research][timeboxed:10h] investigate and benchmark OSD, in particular /, /tests, test details pages size:SWorkable2024-04-19

Actions
coordination #165393: [epic] Improved code coverage in openQANew2024-09-062024-10-22

Actions
action #165396: Improved code coverage in openQA for unit tests in t/ size:SResolvedmkittler

Actions
openQA Tests - action #166445: [openQA-in-openQA][sporadic] test fails in tests, simple_boot incomplete auto_review:"no candidate needle.*openqa-test-details.*matched":retry size:MWorkable2024-09-06

Actions
action #167482: [sporadic] codecov checks missing from pull requests size:SBlockedybonatakis2024-09-132024-10-22

Actions
action #167611: [sporadic] t/ui/21-admin-needles.t fails - Failed test 'search five_month needle correctly' size:SFeedbackmkittler2024-09-30

Actions
action #167803: flaky coverage: lib/OpenQA/Shared/Controller/Running.pm size:SWorkable2024-10-04

Actions
action #167914: Improved code coverage in openQA in lib/OpenQA/WorkerIn Progressmkittler2024-10-08

Actions
coordination #167917: [epic] Stable os-autoinst unit tests with complete coverageBlockedokurz2024-10-08

Actions
action #167920: Cover code of os-autoinst path consoles/ fully (statement coverage) size:MNew

Actions
action #167923: Cover code of os-autoinst path scripts/ fully (statement coverage) size:MNew2024-10-08

Actions
action #167926: Cover code of os-autoinst path autotest.pm fully (statement coverage) size:MNew2024-10-08

Actions
action #167929: Cover code of os-autoinst path testapi.pm fully (statement coverage) size:MNew2024-10-08

Actions
action #167932: Cover code of os-autoinst path needle.pm fully (statement coverage) size:MNew2024-10-08

Actions
action #167935: Cover code of os-autoinst path myjsonrpc.pm fully (statement coverage) size:MNew2024-10-08

Actions
action #167938: Cover code of os-autoinst path lockapi.pm fully (statement coverage) size:MNew2024-10-08

Actions
action #167941: Cover code of os-autoinst path distribution.pm fully (statement coverage) size:MNew2024-10-08

Actions
action #167944: Cover code of os-autoinst path cv.pm fully (statement coverage) size:MNew2024-10-08

Actions
action #167947: Cover code of os-autoinst path commands.pm fully (statement coverage) size:MNew2024-10-08

Actions
action #167950: Cover code of os-autoinst path basetest.pm fully (statement coverage) size:MNew2024-10-08

Actions
action #167953: Ensure complete statement coverage within os-autoinstNew2024-10-08

Actions

Related issues 1 (0 open1 closed)

Related to openQA Tests - action #126590: [qe-core] loading tests in Python is broken when using YAMLResolvedmgrifalconi2023-03-24

Actions
Actions #1

Updated by okurz over 1 year ago

Actions #2

Updated by szarate over 1 year ago

  • Related to action #126590: [qe-core] loading tests in Python is broken when using YAML added
Actions #5

Updated by okurz about 1 year ago

  • Target version changed from Ready to Tools - Next
Actions #6

Updated by okurz 12 months ago

  • Subtask #138365 added
Actions #7

Updated by okurz 10 months ago

  • Subtask #152955 added
Actions #8

Updated by okurz 4 months ago

  • Target version changed from Tools - Next to Ready

Moving to "Ready" after #121720 freed the spot :)

Actions #9

Updated by okurz about 2 months ago

  • Subtask #165393 added
Actions #10

Updated by okurz 4 days ago

  • Subtask #167917 added
Actions

Also available in: Atom PDF