action #163748
open
We need a smoke test which would skip all other tests in case of failure
Added by asmorodskyi 16 days ago.
Updated 5 days ago.
Description
Currently common pattern is that when something is broken in BCI tests then ALL tests got failed which means that same problem can be detected with single test execution . To achieve that let's do smoke test which would run before all other tests would have START_AFTER_TEST pointing to this one so if smoke test failing we will skip other tests
The only benefit this would have is to spare some load on our workers. But I'm a bit hesitant to do this because it increases the test scenario complexity (introduction of parent jobs), which is not desired.
I would like to know more about what the desired effect of this change is. We don't need to mark BCI tests the same way as the other maintenance test runs, so there is not the burden of applying bsc or poo references to all of them.
From here it looks like increasing the test complexity to solve a non-issue to me. @asmorodskyi can you please elaborate why this would be beneficial?
- Tags set to discussion-needed
- Priority changed from Normal to Low
Lowering prio due to pending discussion items.
Also available in: Atom
PDF