Project

General

Profile

action #123864

Updated by livdywan almost 2 years ago

## Observation 

 openQA test in scenario openqa-Tumbleweed-dev-x86_64-openqa_install+publish@64bit-2G fails in 
 [start_test](https://openqa.opensuse.org/tests/3086954/modules/start_test/steps/19) 
  due to empty response from internal openQA instance 

 ## Test suite description 
 Maintainer: okurz@suse.de Test for installation of openQA itself. To be used with "openqa" distri. Publishes an qcow2 image including the openQA installation ready to run as an appliance. 


 ## Reproducible 

 Fails since (at least) Build [:TW.16820](https://openqa.opensuse.org/tests/3086954) (current job) 
 https://openqa.opensuse.org/tests/3086954#comments shows that this is a sporadic issue. 


 ## Expected result 

 Last good: [:TW.16819](https://openqa.opensuse.org/tests/3086918) (or more recent) 


 ## Suggestions 
 * Catch the error if no jobs are found from an API query, maybe just `set -u` in bash is enough to fail when using variables? 
 * Right now the test module is looking for openQA assets to find the "most recent Tumbleweed build" and then query jobs but it can very well happen that assets are created and registered before all openQA jobs are scheduled so this approach can fail. Find a better way in https://github.com/os-autoinst/os-autoinst-distri-openQA/blob/master/tests/osautoinst/start_test.pm to identify the latest job in a scenario and just clone that. 
 - If the above fails then consider adding a retry with waiting in between 
 - Ensure we're not waiting too long e.g. avoid waiting a day and spawning more jobs in-between 
 - The issue doesn't seem to be reproducible reliably 

 ## Further details 

 Always latest result in this scenario: [latest](https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=openqa&flavor=dev&machine=64bit-2G&test=openqa_install%2Bpublish&version=Tumbleweed) 

Back