Dynamic scheduling of small script snippets to execute, e.g. scripts as downloadable assets
Linked to UC4 as well as UC7. As a bug assignee or QA contact I want openQA to execute a custom scenario with only limited test modules and optional override test or investigation code to be able to reproduce bugs easily which are most easily or only reproduced in openQA context without needing to adapt the normal validation test code and not needing a complete fork of gh#os-autoinst/os-autoinst-distri-opensuse
- AC1: Override code for test modules or parts of test modules can be specified as downloadable asset
- openQA workers download additional test assets if specified by variables to allow injecting new test modules or override modules on-the-fly before isotovideo is called, e.g. using the existing openQA feature of downloading test assets using variables which specify the '_URL' suffix on test parameters.
From #62387 "easily pluggable reproducer injection"
From security point of view, we occasionaly want to add security reproducer testcases easily to openqa. one case would be e.g. ImageMagick and GraphicsMagick. Here our security reproducers usually fall into: * identify IMAGE -> crash * valgrind identify IMAGE -> valgrind errors / and leaks * convert IMAGE output.jpg -> crash * valgrind convert IMAGE output.jpg -> valgrind errors / and leaks As there is a small number of possible testscenarios adding of testimages could even be done without any adjustments to run scripts, or more trivial adjustments. So something in the form of "data/imagemagick/bg_script.sh", but more simple. What I want to avoid is that we need to setup our own openqa just to test it, but more throw it over the fence style submissions.
#2 Updated by okurz over 1 year ago
I consider this still relevant even though for many people using http://open.qa/docs/#_triggering_tests_based_on_an_any_remote_git_refspec_or_open_github_pull_request works just fine and seems to be a great help.