Project

General

Profile

Actions
Copy link

action #180695

closed

tests fail due to removal of '%cmd' from testapi size:S

Added by okurz 6 days ago. Updated 5 days ago.

Status:
Resolved
Priority:
Urgent
Assignee:
okurz
Category:
Regressions/Crashes
Target version:
Ready
Start date:
2025-04-10
Due date:
% Done:

0%

Estimated time:
Tags:
os-autoinst, reactive work

Description

Observation

From https://github.com/os-autoinst/os-autoinst/pull/2695#issuecomment-2791751789

https://openqa.opensuse.org/tests/4983982 and many more:
Global symbol "%cmd" requires explicit package name (did you forget to declare "my %cmd"?) at microos/lib/utils.pm line 1409.
Type of arg 1 to testapi::wait_screen_change must be block or sub {} (not reference constructor) at microos/lib/utils.pm line 1880, near "};"

Suggestions

  • Revert the change in code
  • Rollback package installations
  • Restart affected tests using openqa-advanced-retrigger-jobs
  • Monitor
  • Rollback the rollbacks
  • Ensure stability
  • Follow-up ticket for a proper fix, maybe a tied hash like with bmwqemu vars

Rollback steps

Related issues 3 (2 open — 1 closed)

Related to openQA Infrastructure (public) - action #180698: "Rollback of updates" wiki section outdated size:SFeedbackrobert.richardson2025-04-102025-04-25

Actions
Copied to openQA Project (public) - action #180701: Package cache on o3 workers does not include any os-autoinst packages size:SResolvedmkittler2025-04-10

Actions
Copied to openQA Project (public) - action #180770: Consider to remove all non-functions from the os-autoinst testapi, e.g. '%cmds'New2025-04-10

Actions
Actions
Copy link
 #1

Updated by okurz 6 days ago

  • Related to action #180698: "Rollback of updates" wiki section outdated size:S added
Actions
Copy link
 #2

Updated by okurz 6 days ago

  • Status changed from New to In Progress

https://github.com/os-autoinst/os-autoinst/pull/2696

now handling rollback on o3. Apparently package cache on o3 workers does not include os-autoinst. Reporting separate ticket and force-merging revert to expedite deployment.

Actions
Copy link
 #3

Updated by okurz 6 days ago

  • Copied to action #180701: Package cache on o3 workers does not include any os-autoinst packages size:S added
Actions
Copy link
 #4

Updated by okurz 6 days ago

I triggered openqa-continuous-update on all hosts (instead of waiting up to 5m) and then

failed_since="2025-04-09" ./openqa-advanced-retrigger-jobs

All machines with exception of w20 and qa-power8-3 have the new version os-autoinst-5.1744270001.5d9f36e-lp156.2078.1.x86_64 but all machines have an unaffected os-autoinst version so retriggering again for any leftovers and monitoring over the next hours.

Actions
Copy link
 #5

Updated by nicksinger 6 days ago

  • Description updated (diff)
Actions
Copy link
 #6

Updated by gpuliti 6 days ago

  • Subject changed from tests fail due to removal of '%cmd' from testapi to tests fail due to removal of '%cmd' from testapi size:S
  • Description updated (diff)
Actions
Copy link
 #7

Updated by okurz 6 days ago

  • Copied to action #180770: Consider to remove all non-functions from the os-autoinst testapi, e.g. '%cmds' added
Actions
Copy link
 #8

Updated by okurz 5 days ago

Checked o3 and found no more related incompletes. Re-enabled pipelines on https://gitlab.suse.de/openqa/scripts-ci/-/pipeline_schedules again.

Actions
Copy link
 #9

Updated by okurz 5 days ago

  • Status changed from In Progress to Resolved
Actions
Copy link

Also available in: Atom PDF