Project

General

Profile

action #48644

Dynamic scheduling of small script snippets to execute, e.g. scripts as downloadable assets

Added by okurz over 1 year ago. Updated 7 months ago.

Status:
New
Priority:
Low
Assignee:
-
Category:
Feature requests
Target version:
Start date:
2018-06-08
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Motivation

Linked to UC4 as well as UC7. As a bug assignee or QA contact I want openQA to execute a custom scenario with only limited test modules and optional override test or investigation code to be able to reproduce bugs easily which are most easily or only reproduced in openQA context without needing to adapt the normal validation test code and not needing a complete fork of gh#os-autoinst/os-autoinst-distri-opensuse

Acceptance criteria

  • AC1: Override code for test modules or parts of test modules can be specified as downloadable asset

Suggestions

  • openQA workers download additional test assets if specified by variables to allow injecting new test modules or override modules on-the-fly before isotovideo is called, e.g. using the existing openQA feature of downloading test assets using variables which specify the '_URL' suffix on test parameters.

Further details

From #62387 "easily pluggable reproducer injection"

From security point of view, we occasionaly want to add security reproducer testcases easily to openqa.
one case would be e.g. ImageMagick and GraphicsMagick.
Here our security reproducers usually fall into:
* identify IMAGE -> crash
* valgrind identify IMAGE -> valgrind errors / and leaks
* convert IMAGE output.jpg -> crash
* valgrind convert IMAGE output.jpg -> valgrind errors / and leaks
As there is a small number of possible testscenarios adding of testimages could even be done without any adjustments to run scripts, or more trivial adjustments.
So something in the form of "data/imagemagick/bg_script.sh", but more simple.
What I want to avoid is that we need to setup our own openqa just to test it, but more throw it over the fence style submissions.

Related issues

Related to openQA Project - action #62387: easily pluggable reproducer injectionResolved2020-01-202020-04-04

Copied from openQA Project - action #36994: Dynamic test flow definition + overrideResolved2018-06-08

History

#1 Updated by okurz over 1 year ago

  • Copied from action #36994: Dynamic test flow definition + override added

#2 Updated by okurz 7 months ago

I consider this still relevant even though for many people using http://open.qa/docs/#_triggering_tests_based_on_an_any_remote_git_refspec_or_open_github_pull_request works just fine and seems to be a great help.

#3 Updated by okurz 7 months ago

  • Description updated (diff)

Merged in content from #62387

#4 Updated by okurz 7 months ago

  • Related to action #62387: easily pluggable reproducer injection added

Also available in: Atom PDF