calculate overall test result in os-autoinst or worker?
os-autoinst doesn't know the overall status of a run anymore, it only uploads individual module results the openqa and that one calculates the result when the job is set to done.
When uploading hard disk images however one needs to know the overall status as images shouldn't be uploaded if the test completed but failed
#6 Updated by okurz over 3 years ago
- Status changed from Resolved to In Progress
Why don't we have images as assets for failed jobs in the webUI then? Because they are discarded after uploading? If this is the case then it would be a good starting point to preserve qcow images of failed jobs for investigation purposes on demand.
#9 Updated by okurz over 3 years ago
we don't want to upload them as the STARTS_AFTER tests should only run on working images. And we don't upload failed images for investigation as we rollback failing job modules - make any hints disappear.
I don't see a general problem with that. My idea was to provide some kind of variable, like we have with KEEPHDDS, which can be used to make all modules fatal, not trigger START_AFTER tests and publish the image maybe even to a special "investigation" space pool with it's own quota where we can store these.
- Status changed from New to Resolved
so I guess we can state it was done with https://github.com/os-autoinst/os-autoinst/pull/597 . Also there is another, dedicated ticket for the feature request to upload images on demand even from failed jobs (but also not trigger downstream jobs on them)