Project

General

Profile

action #93336

unstable test in os-autoinst master - slow coverage analysis when forking in t/18-backend-qemu.t

Added by okurz about 2 months ago. Updated about 2 months ago.

Status:
New
Priority:
Low
Assignee:
-
Category:
Feature requests
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

https://github.com/os-autoinst/os-autoinst/runs/2619306122?check_suite_focus=true#step:3:538 shows

6: [10:47:32] ./18-backend-qemu.t ...................... ok     5026 ms ( 0.00 usr  0.01 sys +  4.83 cusr  0.20 csys =  5.04 CPU)
6: 
6:     #   Failed test 'execution time of isotovideo (24.3694479465485 s) within reasonable limits'
6:     #   at ./18-qemu-options.t line 87.
6:     #     '24.3694479465485'
6:     #         <
6:     #     '24'
6:     # Looks like you failed 1 test of 16.
6: 
6: #   Failed test 'qemu_append_option'
6: #   at ./18-qemu-options.t line 110.
6: # Looks like you failed 1 test of 4.

Without coverage the test takes locally 13 seconds to run and with it takes 146 so it is 11.2307692308 times slower with coverage. For the concrete check of isotovideo's runtime it is 1.50357818603516 s vs. 17.4516468048096 s so the factor is 11.606744 which is even worse than the overall.

This is very likely no regression.

Acceptance criteria

  • AC1: t/18-backend-qemu.t is significantly faster with coverage analysis

Suggestions

  • fix the underlying problem of slow coverage analysis when forking, e.g. not collecting coverage from subprocesses and instead having the according coverage provided by other test modules.

Related issues

Copied from openQA Project - action #93083: unstable test in os-autoinst masterResolved2021-05-252021-06-12

History

#1 Updated by okurz about 2 months ago

  • Copied from action #93083: unstable test in os-autoinst master added

#2 Updated by okurz about 2 months ago

  • Subject changed from unstable test in os-autoinst master - to unstable test in os-autoinst master - slow coverage analysis when forking in t/18-backend-qemu.t

Also available in: Atom PDF