Project

General

Profile

Actions

action #48644

open

Dynamic scheduling of small script snippets to execute, e.g. scripts as downloadable assets

Added by okurz almost 6 years ago. Updated almost 5 years ago.

Status:
New
Priority:
Low
Assignee:
-
Category:
Feature requests
Target version:
QA (public, currently private due to #173521) - future
Start date:
2018-06-08
Due date:
% Done:

0%

Estimated time:

Description

Motivation

Linked to UC4 as well as UC7. As a bug assignee or QA contact I want openQA to execute a custom scenario with only limited test modules and optional override test or investigation code to be able to reproduce bugs easily which are most easily or only reproduced in openQA context without needing to adapt the normal validation test code and not needing a complete fork of gh#os-autoinst/os-autoinst-distri-opensuse

Acceptance criteria

  • AC1: Override code for test modules or parts of test modules can be specified as downloadable asset

Suggestions

  • openQA workers download additional test assets if specified by variables to allow injecting new test modules or override modules on-the-fly before isotovideo is called, e.g. using the existing openQA feature of downloading test assets using variables which specify the '_URL' suffix on test parameters.

Further details

From #62387 "easily pluggable reproducer injection"

From security point of view, we occasionaly want to add security reproducer testcases easily to openqa.
one case would be e.g. ImageMagick and GraphicsMagick.
Here our security reproducers usually fall into:
* identify IMAGE -> crash
* valgrind identify IMAGE -> valgrind errors / and leaks
* convert IMAGE output.jpg -> crash
* valgrind convert IMAGE output.jpg -> valgrind errors / and leaks
As there is a small number of possible testscenarios adding of testimages could even be done without any adjustments to run scripts, or more trivial adjustments.
So something in the form of "data/imagemagick/bg_script.sh", but more simple.
What I want to avoid is that we need to setup our own openqa just to test it, but more throw it over the fence style submissions.

Related issues 2 (0 open2 closed)

Related to openQA Project (public) - action #62387: easily pluggable reproducer injectionResolvedokurz2020-01-202020-04-04

Actions
Copied from openQA Project (public) - action #36994: Dynamic test flow definition + overrideResolvedokurz2018-06-08

Actions
Actions #1

Updated by okurz almost 6 years ago

  • Copied from action #36994: Dynamic test flow definition + override added
Actions #2

Updated by okurz almost 5 years ago

I consider this still relevant even though for many people using http://open.qa/docs/#_triggering_tests_based_on_an_any_remote_git_refspec_or_open_github_pull_request works just fine and seems to be a great help.

Actions #3

Updated by okurz almost 5 years ago

  • Description updated (diff)

Merged in content from #62387

Actions #4

Updated by okurz almost 5 years ago

  • Related to action #62387: easily pluggable reproducer injection added
Actions

Also available in: Atom PDF