Project

General

Profile

action #10558

improve yast2_lan test robustness

Added by okurz about 7 years ago. Updated over 5 years ago.

Status:
Rejected
Priority:
Normal
Assignee:
-
Category:
Enhancement to existing tests
Target version:
-
Start date:
2016-08-01
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Difficulty:

Description

observation

from https://openqa.suse.de/tests/196234/file/autoinst-log.txt

Debug: /var/lib/openqa/share/tests/sle/tests/console/yast2_lan.pm:31 called testapi::assert_screen
<<< assert_screen(mustmatch=[
  'Networkmanager_controlled',
  'yast2_lan',
  'install-susefirewall2'
], timeout=60)
MATCH(Network_manager-controlled-20150715:0.00)
MATCH(Network_manager-controlled-20140522:0.00)
MATCH(yast2_lan-IPMI-20151205:0.00)
MATCH(yast2_lan-20141113:0.00)
MATCH(yast2_lan-20150512:0.00)
MATCH(yast2_lan-20150716:0.00)
MATCH(yast2_lan-hacluster-20150818:0.00)
WARNING: check_asserted_screen took 0.87 seconds - make your needles more specific
no match 60
… (repeating multiple times)
WARNING: check_asserted_screen took 0.58 seconds - make your needles more specific
>>> assert_screen: match=Networkmanager_controlled,install-susefirewall2,yast2_lan timed out after 60

steps to reproduce

This should be easy to reproduce every time

problem

openQA has a hard time completing the image comparison for all possible needles. This caused the test to timeout eventually.

suggestion

make needle tags more specific

workaround

retrigger job


Subtasks

action #13710: yast2_lan fails on script_sudo matching previous password promptResolvedmkravec

action #12968: yast2_lan test refactorResolveddgutu

History

#1 Updated by okurz about 7 years ago

  • Description updated (diff)

#2 Updated by asmorodskyi over 5 years ago

  • Status changed from New to In Progress

#3 Updated by asmorodskyi over 5 years ago

  • Status changed from In Progress to Rejected

this ticket can be always closed and open at the same time

Also available in: Atom PDF