action #38267

[functional][u][hard] ipmi test fails in consoletest_setup to write to the serial device - regression!

Added by okurz over 1 year ago. Updated over 1 year ago.

Status:ResolvedStart date:06/07/2018
Priority:HighDue date:11/09/2018
Assignee:zluo% Done:

0%

Category:Bugs in existing testsEstimated time:8.00 hours
Target version:SUSE QA tests - Milestone 19
Difficulty:hard
Duration: 48

Description

Observation

openQA test in scenario sle-12-SP4-Server-DVD-x86_64-default@64bit-ipmi fails in
consoletest_setup
writing something to /dev/serialdev but apparently nothing ever reaches the serial device.
The job is labeled with https://bugzilla.suse.com/show_bug.cgi?id=1099281 but looking at it in detail it seems that this has nothing to do with the fact that the serial port forwarding does not work so the bug should not be a blocker in this regard.

Reproducible

Tests fail in either this issue or on #37820 so I recommend to keep both in mind in parallel.

Expected result

Last good: See #37820 , that would be the very very old test https://openqa.suse.de/tests/857605 , the later job https://openqa.suse.de/tests/992659#step/consoletest_setup/9 on build 0420 already seems to fail in the same way.

Problem

Given the "expected result" above I assume that the problem was introduced in os-autoinst-distri-opensuse between "good" 749297d010f39e18c741cc3ed0c633b03445f647 and "bad" bcef7e1f06bd86fdec2b1f5dd863d6272c563ee0

Suggestions

  • Abort the current test with "INSTALLONLY" to make it green and decrease prio of this ticket
  • Try out to reproduce the "last good" with old product and old test first
  • See if we have introduced changes to the test that broke it
  • "lib/ipmi_backend_utils.pm::use_ssh_serial_console" might help
  • Fix it by fixing the regression

Further details

Always latest result in this scenario: latest

canvas.png - screenshot writing console tty parameters in PXE menu of last good (19.1 KB) okurz, 22/08/2018 11:02 am

vars.json - vars.json of last good (2.11 KB) okurz, 22/08/2018 11:02 am

6611

Related issues

Related to openQA Tests - action #37820: [functional][sle][u][hard][ipmi][sporadic] test fails in ... Resolved 26/06/2018 17/07/2018
Blocked by openQA Tests - action #38411: [functional][y][sporadic][ipmi] test fails in boot_from_p... Resolved 15/07/2018 14/08/2018

History

#1 Updated by okurz over 1 year ago

  • Related to action #37820: [functional][sle][u][hard][ipmi][sporadic] test fails in first_boot - Lost connection to SUT on SLE12-SP4 added

#2 Updated by okurz over 1 year ago

  • Description updated (diff)

#3 Updated by okurz over 1 year ago

$ git log --pretty=oneline --abbrev-commit --no-merges 749297d010f39e18c741cc3ed0c633b03445f647..bcef7e1f06bd86fdec2b1f5dd863d6272c563ee0 | wc -l
377

Nothing what a git bisect can not handle ;)

#5 Updated by okurz over 1 year ago

  • Subject changed from [functional][u] ipmi test fails in consoletest_setup to write to the serial device - regression? to [functional][u] ipmi test fails in consoletest_setup to write to the serial device - regression!
  • Description updated (diff)
  • Status changed from New to Workable

#6 Updated by okurz over 1 year ago

  • Due date changed from 31/07/2018 to 14/08/2018
  • Target version changed from Milestone 17 to Milestone 18

#7 Updated by SLindoMansilla over 1 year ago

  • Status changed from Workable to In Progress
  • Assignee set to SLindoMansilla

No free ticket in current sprint 22 found. No one ask for help. Picking this ticket from sprint 23

#8 Updated by SLindoMansilla over 1 year ago

Trying to reproduce locally and to manually send text to the serial output: http://10.160.66.74/tests/763

#9 Updated by okurz over 1 year ago

  • Blocked by action #38411: [functional][y][sporadic][ipmi] test fails in boot_from_pxe - installer does not show up added

#10 Updated by okurz over 1 year ago

  • Due date changed from 14/08/2018 to 11/09/2018
  • Status changed from In Progress to Workable
  • Assignee deleted (SLindoMansilla)
  • Target version changed from Milestone 18 to Milestone 19

As discussed with slindomansilla currently tests fail often enough in steps before consoletest_setup so it makes sense to focus on getting installation and booting more stable first, e.g. new blocker #38411

#11 Updated by SLindoMansilla over 1 year ago

  • Subject changed from [functional][u] ipmi test fails in consoletest_setup to write to the serial device - regression! to [functional][u][hard] ipmi test fails in consoletest_setup to write to the serial device - regression!
  • Estimated time set to 8.00
  • Difficulty set to hard

#12 Updated by okurz over 1 year ago

#13 Updated by zluo over 1 year ago

actually atm system_prepare failed: https://progress.opensuse.org/issues/39665
So we need to work on the ticket above at first.

#14 Updated by zluo over 1 year ago

  • Assignee set to zluo

take over now

#15 Updated by zluo over 1 year ago

https://bugzilla.suse.com/show_bug.cgi?id=1099281 is a blocker. I reported this issue about 2 months ago.

So we need to workaround this for now:
http://e13.suse.de/tests/7976#step/consoletest_setup/14

#16 Updated by zluo over 1 year ago

  • Status changed from Workable to In Progress

try with workaround: http://e13.suse.de/tests/7977

#18 Updated by zluo over 1 year ago

  • Status changed from In Progress to Resolved

Also available in: Atom PDF