Project

General

Profile

coordination #55364

Updated by okurz over 4 years ago

## Observation 

 codecov reports often report about coverage changes which are obviously not related to the actual changes of a PR, e.g. when documentation is changed or as in https://github.com/os-autoinst/openQA/pull/2253#issuecomment-520042072 . It seems some of our tests – maybe the full stack test – introduced a flakyness in coverage. 

 ## Suggestions 

 We should try to make the reports more reliable and hence less annoying with big red color when it is not helpful. 
 Let's try to collect our observations here: 

 * https://github.com/os-autoinst/openQA/pull/2253#issuecomment-520042072 
  * lib/OpenQA/Worker/Settings.pm  	 84.9% <0%> (-13.21%)  	 arrow_down 
  * lib/OpenQA/Worker/WebUIConnection.pm  	 84.42% <0%> (+2.51%)  	 arrow_up 
 * https://github.com/os-autoinst/openQA/pull/2135#issuecomment-506641541 
  * lib/OpenQA/WebSockets.pm  	 88.4% <0%> (-5.8%)  	 arrow_down 
  * lib/OpenQA/Scheduler/Model/Jobs.pm  	 86.11% <0%> (-2.78%)  	 arrow_down 
  * lib/OpenQA/Worker/Commands.pm  	 81.17% <0%> (-2.36%)  	 arrow_down 
  * lib/OpenQA/Utils.pm  	 95.81% <0%> (-0.2%)  	 arrow_down 
 * https://github.com/os-autoinst/openQA/pull/2161#issuecomment-513477665 
  * lib/OpenQA/Setup.pm  	 90.83% <100%> (ø)  	 arrow_up 
  * lib/OpenQA/Worker/Settings.pm  	 84.31% <0%> (-13.73%)  	 arrow_down 
  * lib/OpenQA/Worker/Engines/isotovideo.pm  	 94.66% <0%> (+0.48%)  	 arrow_up 
 * https://github.com/os-autoinst/openQA/pull/2161#issuecomment-513477665 
  * lib/OpenQA/Setup.pm  	 90.83% <100%> (ø)  	 arrow_up 
  * lib/OpenQA/Worker/Settings.pm  	 84.31% <0%> (-13.73%)  	 arrow_down 
  * lib/OpenQA/Worker/Engines/isotovideo.pm  	 94.66% <0%> (+0.48%)  	 arrow_up

Back