QA » openQA Project

Observation¶

https://github.com/os-autoinst/os-autoinst/runs/2619306122?check_suite_focus=true#step:3:538 shows

6: [10:47:32] ./18-backend-qemu.t ...................... ok     5026 ms ( 0.00 usr  0.01 sys +  4.83 cusr  0.20 csys =  5.04 CPU)
6: 
6:     #   Failed test 'execution time of isotovideo (24.3694479465485 s) within reasonable limits'
6:     #   at ./18-qemu-options.t line 87.
6:     #     '24.3694479465485'
6:     #         <
6:     #     '24'
6:     # Looks like you failed 1 test of 16.
6: 
6: #   Failed test 'qemu_append_option'
6: #   at ./18-qemu-options.t line 110.
6: # Looks like you failed 1 test of 4.

Without coverage the test takes locally 13 seconds to run and with it takes 146 so it is 11.2307692308 times slower with coverage. For the concrete check of isotovideo's runtime it is 1.50357818603516 s vs. 17.4516468048096 s so the factor is 11.606744 which is even worse than the overall.

This is very likely no regression.

Acceptance criteria¶

• AC1: t/18-backend-qemu.t is significantly faster with coverage analysis

Suggestions¶

• fix the underlying problem of slow coverage analysis when forking, e.g. not collecting coverage from subprocesses and instead having the according coverage provided by other test modules.