Project

General

Profile

Actions
Copy link

coordination #127031

open

[saga][epic] openQA for SUSE customers

Added by okurz about 2 years ago. Updated about 4 hours ago.

Status:
Blocked
Priority:
Normal
Assignee:
okurz
Category:
Feature requests
Target version:
Ready
Start date:
2020-11-04
Due date:
% Done:

61%

Estimated time:
(Total: 0.00 h)
Tags:
qaaas

Description

Motivation

SUSE customers build their own products based on SUSE products including SLE, OBS, openQA. So we must ensure openQA is usable for customers and by customers

Acceptance criteria

  • AC1: openQA (webUI+worker) is continuously built+tested+published on latest SLE+packagehub
  • AC2: python based openQA tests are usable for testing new products

Further details

Subtasks 144 (35 open — 109 closed)

coordination #80150: [epic] Scale out openQA: Easier openQA setupBlockedokurz2020-11-04

Actions
action #76978: How to run an openQA test in 5 minutes size:MResolvedjbaier_cz2020-11-04

Actions
action #80382: Provide installation recipes for automatic installations of openQA worker machinesWorkable2020-11-25

Actions
action #89920: Extend existing openQA-in-openQA tests as a learning exercise to know where our instructions or beginner situation can be improvedNew2021-03-11

Actions
action #90038: Better error handling when reading API key+secret from ~/.config/openqa/client.confResolvedmkittler2021-03-12

Actions
coordination #90758: [epic] python bindings for openQAResolvedokurz2021-04-07

Actions
action #90761: os-autoinst-distri-opensuse CI checks fail due to `cpanm --installdeps` failing on Inline::PythonResolvedosukup2021-04-07

Actions
action #91257: try out python backend for production tests in a new test distribution or os-autoinst-distri-openQAResolvedlivdywan2021-04-15

Actions
action #91653: Python tests fail with generic error message regardless of the problem size:MResolvedmkittler2021-04-23

Actions
coordination #93609: [epic] openqa-bootstrap support on Leap 15.3Resolvedmkittler2021-06-07

Actions
action #95317: openqa-bootstrap on Leap 15.3 from devel:openQA passesResolvedmkittler2021-06-07

Actions
action #95320: openqa-bootstrap on Leap 15.3 from official repos passesResolvedmkittler2021-06-07

Actions
action #95323: openqa-bootstrap support on current version of Leap - automatic test size:SResolvedmkittler2021-07-09

Actions
action #95185: openqa-bootstrap ignores errors when systemd is not availableResolveddheidler2021-07-07

Actions
action #129883: all-in-one openQA container solutionResolvedokurz

Actions
action #129958: Ensure openSUSE container best practices are followed for our container images in devel: openQA size:MResolvedjbaier_cz2023-05-28

Actions
action #138440: devel:openQA container files follow cha.obs.supported_formats#id-1.5.10.8.5 and set BuildVersion+BuildName consistently size:SResolvedjbaier_cz

Actions
action #153499: Ensure the openQA developer mode works straight-forward in the container setup when following our documentation size:MResolvedmkittler2024-01-13

Actions
action #155473: Avoid the need for API keys within the same container/clientRejected2024-01-13

Actions
action #155491: Extend documentation for single-instance-container covering at least how to trigger/clone existing jobs size:SResolvedjbaier_cz2024-01-13

Actions
action #162119: Restructure and simplify documentation with a single suggested way for newcomers how to get startedNew2024-01-13

Actions
action #165399: Unable to use openqa-single-instance due to "Valid metadata not found at specified URL" reproducing often size:SResolvedmkittler2024-08-16

Actions
action #174295: The cache loading from the fixed folder is not working size:SResolvedgpathak2024-12-12

Actions
coordination #127028: [epic] openQA on SLE+packagehubBlockedokurz2023-03-31

Actions
action #127034: [spike][timeboxed:20h] Run openQA (webUI+worker) based on SLE to find out problems size:MResolvedmkittler2023-03-31

Actions
action #127037: os-autoinst on SLE+packagehub size:MFeedbackybonatakis2023-03-31

Actions
action #127286: Run openQA (webUI+worker) based on SLE+packagehub size:MBlockedokurz2023-03-31

Actions
action #127541: Test os-autoinst+openQA against openSUSE:Backports:SLE-X in pull request OBS CI checks size:MResolvedybonatakis2023-03-31

Actions
action #127757: Cover SLE in openQA docsResolvedokurz

Actions
action #127883: Cleanup OBS project devel:openQA:Leap:15.4Resolvedtinita2023-04-18

Actions
action #128087: Regular cleanup of OBS project devel:openQA:* size:MResolvedjbaier_cz

Actions
action #129949: Enable build+test of openQA and deps on s390xResolvedokurz2023-05-27

Actions
action #132458: Fix documentation ambiguity about openQA-worker installation on SLE size:SResolveddheidler2023-07-07

Actions
action #150959: openQA fails to build on SLE/Leap 15.6 Backports due to test-unit-and-integration failures size:MResolvedosukup2023-11-16

Actions
action #160715: Error message in obs-check-package-origin size:SResolvedjbaier_cz2024-05-22

Actions
openQA Infrastructure (public) - action #168949: Deploy OSD from SLE+packagehub instead of custom OBS repo devel:openQANew2023-03-31

Actions
action #179008: perl-DBIx-Class-DeploymentHandler not properly linked and documented failing Scripts CI in GitLabResolvedtinita2025-03-17

Actions
action #127868: [qaaas] openQA test results should be archived and not tampered size:MNew2023-04-18

Actions
coordination #127910: [epic] openQA in SLE modulesResolvedokurz2023-03-01

Actions
QA (public) - action #127907: jenkins package (and others) not upgraded on jenkins.qa.suse.de since some time size:MResolvedokurz2023-04-19

Actions
action #128318: [spike][timeboxed:20h] Current openQA+os-autoinst+dependencies in pure SLE size:MResolvedmkittler2023-04-26

Actions
action #128651: [spike][timeboxed:20h] Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:MResolvedjbaier_cz2023-04-26

Actions
action #132236: Current openQA+os-autoinst+dependencies updated in SLE+packagehub size:M Closeddheidler2023-04-26

Actions
action #132395: Current openQA+os-autoinst+dependencies are updated automatically in SLE+packagehubRejectedokurz

Actions
action #154723: Complete list of openQA+os-autoinst+dependencies packages not currently in current SLE in development is known size:MResolvedjbaier_cz2023-04-26

Actions
openQA Tests (public) - action #154747: [qe-core] Complete list of os-autoinst-distri-opensuse dependencies not currently in current SLE and also not provided already by openQA itselfRejectedokurz2023-03-01

Actions
action #155512: Complete list of openQA+os-autoinst+dependencies packages not currently in current SLE in development is known - automatically and recurringly generated size:MResolvedjbaier_cz

Actions
action #161432: Sporadic package failures in devel:openQA/openQA/15.6/s390x on "Could not find input asset "../node_modules/datatables.net-bs4/css/dataTables.bootstrap4.min.css"Resolvedokurz2024-06-03

Actions
action #165683: Current openQA+os-autoinst+dependencies in pure SLE size:MResolvedmkittler2024-08-22

Actions
coordination #129313: [epic] openQA on SLFO (was: ALP)New2023-05-15

Actions
action #129316: [spike][timeboxed:20h] openQA container on ALPResolvedokurz2023-05-15

Actions
coordination #130414: [epic] Improved code coverage in os-autoinstResolvedokurz2023-01-10

Actions
action #122929: [os-autoinst] Unhandled test output in t/18-backend-qemu.t size:SResolvedosukup2023-01-10

Actions
action #130417: Improved code coverage in os-autoinst - consoles/amtSol or remove along with the deprecated backend size:SResolvedybonatakis2023-06-06

Actions
action #130420: Improved code coverage in os-autoinst - testapi size:SResolvedmkittler2023-06-06

Actions
action #130423: Improved code coverage in os-autoinst - all the restResolvedokurz2023-06-06

Actions
action #166661: [beginner][os-autoinst][CI] Unhandled output in t/20-openqa-isotovideo-utils.t size:SResolvedjbaier_cz2024-09-11

Actions
action #166664: [beginner][os-autoinst][CI] Unhandled output in t/23-baseclass.t size:SResolvedjbaier_cz2024-09-11

Actions
action #166667: [beginner][os-autoinst][CI] Unhandled output in t/26-video_stream.t size:SResolvedjbaier_cz2024-09-11

Actions
action #166670: [beginner][os-autoinst][CI] Unhandled output in t/27-consoles-local_xvnc.t size:SResolvedjbaier_cz2024-09-11

Actions
action #166673: [beginner][os-autoinst][CI] Unhandled output in t/29-backend-ipmi.t size:SResolvedrobert.richardson2024-09-11

Actions
action #167920: Cover code of os-autoinst path consoles/ fully (statement coverage)Resolvedokurz

Actions
action #167923: Cover code of os-autoinst path script/ fully (statement coverage)Resolvedokurz2024-10-08

Actions
action #167926: Cover code of os-autoinst path autotest.pm fully (statement coverage) size:SResolvedgpathak2024-10-08

Actions
action #167929: Cover code of os-autoinst path testapi.pm fully (statement coverage) size:MResolvedmkittler2024-10-08

Actions
action #167932: Cover code of os-autoinst path needle.pm fully (statement coverage) size:SResolvedgpuliti2024-10-08

Actions
action #167935: Cover code of os-autoinst path myjsonrpc.pm fully (statement coverage) size:SResolvedgpuliti2024-10-08

Actions
action #167938: Cover code of os-autoinst path lockapi.pm fully (statement coverage) size:SResolvedgpuliti2024-10-08

Actions
action #167941: Cover code of os-autoinst path distribution.pm fully (statement coverage) size:SResolvedgpathak2024-10-08

Actions
action #167944: Cover code of os-autoinst path cv.pm fully (statement coverage)Resolvedokurz2024-10-08

Actions
action #167947: Cover code of os-autoinst path commands.pm fully (statement coverage) size:SResolvedgpathak2024-10-08

Actions
action #167950: Cover code of os-autoinst path basetest.pm fully (statement coverage)Resolvedokurz2024-10-08

Actions
action #167953: Ensure complete statement coverage within os-autoinstResolvedokurz2024-10-08

Actions
action #168364: Improved code coverage in os-autoinst - consoles/s3270 size:MResolvedgpathak2023-06-06

Actions
action #168367: Improved code coverage in os-autoinst - consoles/sshIucvconn.pm size:SResolvedybonatakis2023-06-06

Actions
action #168370: Improved code coverage in os-autoinst - consoles/sshVirtsh.pm size:MResolvedybonatakis2023-06-06

Actions
action #170476: Cover code of os-autoinst path backend/ fully (statement coverage) (again)Resolvedjbaier_cz2024-11-28

Actions
action #174094: [beginner][os-autoinst][CI] Unhandled output in t/08-autotest.t size:SResolvedgpathak

Actions
action #174229: Cover code of os-autoinst path script/check_qemu_oom fully (statement coverage) size:SResolvedgpuliti2024-10-08

Actions
action #174232: Cover code of os-autoinst path script/dewebsockify fully (statement coverage) size:SResolvedrobert.richardson2025-01-13

Actions
action #174235: Cover code of os-autoinst path script/os-autoinst-openvswitch fully (statement coverage) size:SResolvedgpuliti2024-10-08

Actions
action #174238: Cover code of os-autoinst path script/vnctest fully (statement coverage) size:SResolvedybonatakis2024-10-08

Actions
action #174244: Improved code coverage in os-autoinst - consoles/sshXtermVt.pm size:SResolvedybonatakis

Actions
action #174247: Improved code coverage in os-autoinst - consoles/s3270.pm size:SRejectedokurz2024-12-12

Actions
action #174250: Improved code coverage in os-autoinst - consoles/sshXtermIPMI.pm size:SResolvedgpathak2024-12-12

Actions
action #174253: Improved code coverage in os-autoinst - consoles/video_stream.pm size:SResolvedgpathak2024-12-12

Actions
action #174256: Improved code coverage in os-autoinst - consoles/ssh_screen.pm size:SResolvedgpuliti2024-12-12

Actions
action #174268: Improved code coverage in os-autoinst - consoles/video_base.pm size:SResolvedgpuliti2024-12-12

Actions
action #174271: Improved code coverage in os-autoinst - consoles/vnc_base.pm size:SResolvedgpuliti2024-12-12

Actions
action #175099: autotest::loadtestdir() creates a warning in find_script() and does not add necessary library path size:SResolvedgpuliti2025-01-08

Actions
action #175192: The CI badge in https://github.com/os-autoinst/os-autoinst?tab=readme-ov-file#os-autoinst-- always shows "no status", should be "passed"Resolvedtinita2025-01-10

Actions
action #175335: Improved code by refactoring in os-autoinst - OpenQA/Isotovideo/Dewebsockify.pmResolvedokurz2025-01-13

Actions
action #175746: [sporadic][unstable][os-autoinst] Failed test 'expected data received via WebSocket' 3: # at t/27-consoles-vmware.t line 230.Resolvedtinita2025-01-18

Actions
action #176343: Improved code coverage in os-autoinst - consoles/sshVirtshSUT.pmResolvedokurz

Actions
coordination #138365: [epic] openQA works in SELinux enforced environmentsBlockedokurz2023-10-23

Actions
openQA Tests (public) - action #138368: [qe-core] An openQA-in-openQA test runs in any openSUSE/SLE test with SELinux enforcedWorkable2023-10-23

Actions
openQA Tests (public) - action #177081: openqa_install_nginx test fails in apparmor size:SResolvedjbaier_cz2025-02-12

Actions
openQA Tests (public) - action #177261: [openQA-in-openQA] Consider adding SELinux supportNew

Actions
action #178642: openQA in openQA tests failing with 503 errors and timeouts due to misbehaving MirrorCache / CDN auto_review:"retry.*zypper.*ref && zypper --no-cd -n in openQA-worker.*timed out" size:SResolvedlivdywan2025-03-11

Actions
action #178822: openQA in openQA tests failing with unreachable webUI, possibly due to SELinux size:SResolveddheidler

Actions
action #178825: Ensure our documentation explains how to handle apparmor+SELinux based on the current supportNew

Actions
action #179131: Tests failing with zypper error about package corrupted during transfer auto_review:"Package perl-DBIx-Class-DeploymentHandler.*seems to be corrupted during transfer"Resolvedokurz

Actions
coordination #152955: [epic] Metric-driven project management in SUSE QE Tools teamBlockedokurz2023-12-28

Actions
action #152957: Weekly evaluation of cycle-times within SUSE QE Tools size:SResolvedlivdywan2023-12-28

Actions
QA (public) - action #155917: [backlogger] Count "Feedback" ticket state for cycle time as well size:SResolvedokurz2024-02-23

Actions
openQA Infrastructure (public) - action #158556: Single-value SLI of OSD HTTP response code successful vs. all size:SResolvedokurz2024-04-07

Actions
openQA Infrastructure (public) - action #158559: Single-value SLI of OSD HTTP response time size:SResolvedokurz2024-04-07

Actions
action #158808: Prevent HTTP response codes 500 as observed in OSD monitoring size:MResolvedmkittler

Actions
action #159327: [research][timeboxed:10h] investigate and benchmark OSD, in particular /, /tests, test details pages size:SWorkable2024-04-19

Actions
action #168184: Show a notification for jobs that have worker classes that are not fulfilled by any currently online or registered workerNew2024-10-01

Actions
coordination #165393: [epic] Improved code coverage in openQANew2024-07-15

Actions
action #163940: Warning in test: SQL::Translator::Diff::schema_diff(): producer_args is deprecated size:SResolvedokurz2024-07-15

Actions
action #165396: Improved code coverage in openQA for unit tests in t/ size:SResolvedmkittler

Actions
openQA Tests (public) - action #166445: [openQA-in-openQA][sporadic] test fails in tests, simple_boot incomplete auto_review:"no candidate needle.*openqa-test-details.*matched":retryBlockedokurz2024-09-06

Actions
action #167482: [sporadic] codecov checks missing from pull requests size:SResolvedybonatakis2024-09-13

Actions
action #167611: [sporadic] t/ui/21-admin-needles.t fails - Failed test 'search five_month needle correctly' size:SResolvedmkittler2024-09-30

Actions
action #167803: flaky coverage: lib/OpenQA/Shared/Controller/Running.pm size:SResolvedmkittler2024-10-04

Actions
action #167914: Improved code coverage in openQA in lib/OpenQA/WorkerResolvedmkittler2024-10-08

Actions
action #173881: [beginner][easy] Cover code of openQA path script/client fully (statement coverage)New

Actions
action #174259: [sporadic] isotovideo fails complaining about still existing testfd filehandle size:MResolvedmkittler

Actions
action #178111: [beginner][openQA][CI] Unhandled output in t/05-scheduler-restart-and-duplicate.tResolvedtinita

Actions
action #178114: [beginner][openQA][CI] Unhandled output in t/deploy.tResolvedtinita2025-03-01

Actions
action #178117: [openQA][CI] Prevent unhandled output in prove test calls with automatic checks size:SWorkable2025-03-01

Actions
action #178207: t: Many leftover t/poolXXXX directories in openQA size:SResolvedgpuliti2025-03-03

Actions
action #178933: [beginner][easy] Cover code of openQA path script/ fully (statement coverage)New2025-03-14

Actions
action #178936: [beginner][easy] Cover code of openQA path lib/ fully (statement coverage)New2025-03-14

Actions
action #178939: [beginner][easy] Cover code of openQA path lib/OpenQA fully (statement coverage)New2025-03-14

Actions
action #178942: [beginner][easy] Cover code of openQA path lib/OpenQA/Utils.pm (statement coverage) size:SIn Progressemiler2025-03-14

Actions
action #178945: [beginner][easy] Cover code of openQA path lib/OpenQA/BuildResults.pm (statement coverage)Resolvedgpuliti2025-03-14

Actions
action #178948: [beginner][easy] Cover code of openQA path lib/OpenQA/WebAPI (statement coverage)New2025-03-14

Actions
action #178951: [beginner][easy] Cover code of openQA path lib/OpenQA/Task (statement coverage)New2025-03-14

Actions
action #178954: [beginner][easy] Cover code of openQA path lib/OpenQA/Shared (statement coverage)New2025-03-14

Actions
action #178957: [beginner][easy] Cover code of openQA path lib/OpenQA/Script (statement coverage)New2025-03-14

Actions
action #179708: Ensure clean git status in openQA testsNewtinita2025-03-03

Actions
coordination #168127: [epic] Up-to-date Perl stackNew2023-07-20

Actions
action #133112: Switch unit tests to Test2-SuiteNew2023-07-20

Actions
QA (public) - action #163571: cpanspec: Move cronjob for auto updating devel:languages:perl:CPAN-{A..Z} off the obsolete engcloud size:MResolvedtinita

Actions
QA (public) - action #164314: devel:languages:perl Module version normalizing size:MWorkabletinita2024-07-22

Actions
QA (public) - action #169633: Setup an environment to run cpan cronjobs size:SResolvedtinita

Actions
QA (public) - action #174709: Select better network for obs-cpan-mirror VM on op-prg2 harvesterNew

Actions
QA (public) - action #175323: [devel:languages:perl] Fix autosetup handling in cpanspec size:SResolvedtinita2025-01-13

Actions
action #176475: Use Feature::Compat::Try in our code - os-autoinst size:SResolvedokurz2025-02-03

Actions
action #176862: [beginner][easy] Use Feature::Compat::Try in our code - openQA size:SResolvedybonatakis

Actions
action #179975: perlcritic openQA - Check more than just lib/ and use Perl::Critic::TooMuchCodeBlockedokurz2025-04-03

Actions

Related issues 2 (1 open — 1 closed)

Related to openQA Tests (public) - action #126590: [qe-core] loading tests in Python is broken when using YAMLResolvedmgrifalconi2023-03-24

Actions
Copied to openQA Project (public) - coordination #177042: [saga][epic] Future ideas for higher quality os-autoinst+openQA productNew2025-02-05

Actions
Actions
Copy link
 #1

Updated by okurz about 2 years ago

Actions
Copy link
 #2

Updated by szarate about 2 years ago

  • Related to action #126590: [qe-core] loading tests in Python is broken when using YAML added
Actions
Copy link
 #5

Updated by okurz over 1 year ago

  • Target version changed from Ready to Tools - Next
Actions
Copy link
 #6

Updated by okurz over 1 year ago

  • Subtask #138365 added
Actions
Copy link
 #7

Updated by okurz over 1 year ago

  • Subtask #152955 added
Actions
Copy link
 #8

Updated by okurz 10 months ago

  • Target version changed from Tools - Next to Ready

Moving to "Ready" after #121720 freed the spot :)

Actions
Copy link
 #9

Updated by okurz 8 months ago

  • Subtask #165393 added
Actions
Copy link
 #10

Updated by okurz 6 months ago

  • Subtask #167917 added
Actions
Copy link
 #11

Updated by okurz 6 months ago

  • Subtask deleted (#167917)
Actions
Copy link
 #12

Updated by mkittler 4 months ago

  • Subtask #173365 added
Actions
Copy link
 #13

Updated by okurz 2 months ago

  • Target version changed from Ready to Tools - Next
Actions
Copy link
 #14

Updated by okurz about 2 months ago

  • Copied to coordination #177042: [saga][epic] Future ideas for higher quality os-autoinst+openQA product added
Actions
Copy link
 #15

Updated by okurz 21 days ago

  • Subtask #178819 added
Actions
Copy link
 #16

Updated by okurz 21 days ago

  • Subtask deleted (#178819)
Actions
Copy link
 #17

Updated by okurz about 5 hours ago

  • Target version changed from Tools - Next to Ready
Actions
Copy link
 #18

Updated by okurz about 4 hours ago

  • Subtask #168127 added
Actions
Copy link

Also available in: Atom PDF