Project

General

Profile

Actions

action #176886

closed

coordination #102915: [saga][epic] Automated classification of failures

QA (public) - coordination #94105: [epic] Use feedback from openqa-investigate to automatically inform on github pull requests, open tickets, weed out automatically failed tests

A "+" and other characters used in test names in $var are considered invalid in WORKER_CLASS:$var size:S

Added by okurz 3 months ago. Updated 3 months ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
Feature requests
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:

Description

Observation

From #176418-10

tinita found in the osd gru journal:

Feb 10 14:05:23 openqa openqa-gru[31894]: openqa-clone-job (83 /opt/os-autoinst-scripts/openqa-investigate): (openqa-clone-job --json-output --skip-chained-deps --max-depth 0 --parental-inheritance --within-instance https://openqa.suse.de/tests/16675956 _TRIGGER_JOB_DONE_HOOK=1 _GROUP_ID=0 BUILD= CASEDIR=https://github.com/os-autoinst/os-autoinst-distri-opensuse.git#99328f722c5266d87384cb7ffb78ab18bc7fba33 WORKER_CLASS:wsl2-main+systemd=qemu_x86_64,qemu_x86_64_staging,qemu_x86_64-large-mem,tap_secondary,windows11,wsl2,platform_intel,zone-cc,region-prg,datacenter-prg1,location-prg_office,openqaworker14,cpu-x86_64,cpu-x86_64-v2,cpu-x86_64-v3,cpu-x86_64-v4 TEST+=:investigate:last_good_tests_and_build:99328f722c5266d87384cb7ffb78ab18bc7fba33+3.76 OPENQA_INVESTIGATE_ORIGIN=https://openqa.suse.de/t16710107) stderr: >>>command-line argument 'WORKER_CLASS:wsl2-main+systemd=qemu_x86_64,qemu_x86_64_staging,qemu_x86_64-large-mem,tap_secondary,windows11,wsl2,platform_intel,zone-cc,region-prg,datacenter-prg1,location-prg_office,openqaworker14,cpu-x86_64,cpu-x86_64-v2,cpu-x86_64-v3,cpu-x86_64-v4' is no valid setting and will be ignored<<<

WORKER_CLASS:wsl2-main+systemd=...
It seems the + in the test name isn't expected:
https://github.com/os-autoinst/openQA/blob/master/lib/OpenQA/Script/CloneJob.pm#L42\

Acceptance criteria

  • AC1: Allow all valid test names in scope settings as well (SETTING:$testname=...)
  • AC2: Ensure the dependency between scopes and test names is clearly documented

Suggestions

  • Consider the implication of using an allowlist vs a blocklist e.g. if test names can contain a < or & and end up pasted in a shell command-line
  • Research relevant cases for the investigate script, which uses test names as worker classes

Our of scope

  • Characters in TEST should match, but this is covered by #177267

Related issues 2 (0 open2 closed)

Related to openQA Project (public) - action #177267: Forbid unprintable characters, white space, colons, equal signs and quotes in TEST names size:SResolvedmkittler2025-02-14

Actions
Copied from openQA Project (public) - action #176418: last_good_tests_and_build is not triggered even though matching worker instance seems to be free and 0 jobs running due to jobs as part of parallel clustersResolvedokurz2025-02-01

Actions
Actions

Also available in: Atom PDF