Project

General

Profile

Actions

action #163748

open

We need a smoke test which would skip all other tests in case of failure

Added by asmorodskyi 16 days ago. Updated 5 days ago.

Status:
New
Priority:
Low
Assignee:
-
Target version:
-
Start date:
2024-07-11
Due date:
% Done:

0%

Estimated time:

Description

Currently common pattern is that when something is broken in BCI tests then ALL tests got failed which means that same problem can be detected with single test execution . To achieve that let's do smoke test which would run before all other tests would have START_AFTER_TEST pointing to this one so if smoke test failing we will skip other tests

Actions #1

Updated by ph03nix 12 days ago

The only benefit this would have is to spare some load on our workers. But I'm a bit hesitant to do this because it increases the test scenario complexity (introduction of parent jobs), which is not desired.

I would like to know more about what the desired effect of this change is. We don't need to mark BCI tests the same way as the other maintenance test runs, so there is not the burden of applying bsc or poo references to all of them.

From here it looks like increasing the test complexity to solve a non-issue to me. @asmorodskyi can you please elaborate why this would be beneficial?

Actions #2

Updated by ph03nix 12 days ago

  • Tags set to discussion-needed
Actions #3

Updated by ph03nix 5 days ago

  • Priority changed from Normal to Low

Lowering prio due to pending discussion items.

Actions

Also available in: Atom PDF