Project

General

Profile

Actions
Copy link

action #27853

closed

[sle][functional][u][easy] extend SUSEConnect test with minimal UI checks

Added by okurz over 6 years ago. Updated almost 4 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
zluo
Category:
New test
Target version:
SUSE QA - Milestone 30
Start date:
2017-11-17
Due date:
% Done:

0%

Estimated time:
42.00 h
Difficulty:

Description

Observation

openQA test in scenario sle-15-Installer-DVD-x86_64-minimal+proxy_SCC-postreg_SUSEconnect@64bit in
suseconnect_scc shows that the test passes but the output is … suboptimal, e.g. "--list-extensions" does not list the "server applications" module even though it's there as it can be activated later on.

Acceptance criteria

  • AC1: There is a needle check asserting on correct rendering of the console UI of SUSEConnect
  • AC2: There is a soft-fail needle with a bugref for the missing server applications module -> https://bugzilla.suse.com/show_bug.cgi?id=1064264 , being VERIFIED FIXED

Tasks

  • Search for an existing UI test case. If the output layout of SUSEConnect --list-extensions is already tested, this ticket can be resolved. If not, the graphical output of the command needs to be tested in suseconnect_scc
  • Add a assert_screen call after the "--list-extensions" call (0.1-1h)
  • Add a needle with soft-fail reference to the bug that nsinger create(s/d) (0.1-0.5h)

Further details

I think a needle check with assert_screen is correct here because even though it's about a console application we want to check the very least of "UI" here as the customer is supposed to use the same. correct rendering is up to the ticket assignee to decide what makes sense.

Always latest result in this scenario: latest

Related issues 1 (0 open — 1 closed)

Related to openQA Tests - action #66826: [SLE][Migration][SLE15SP2][enhance] Check SUSEConnect --list-extensions， SUSEConnect --status-text，zypper lr include all module informationResolvedtinawang1232020-05-14

Actions
Actions
Copy link
 #1

Updated by riafarov over 6 years ago

  • Status changed from In Progress to Workable
Actions
Copy link
 #2

Updated by okurz about 6 years ago

  • Category changed from Bugs in existing tests to New test
  • Target version changed from Milestone 13 to Milestone 16

that's actually a "new test". Maybe something we will be able to do in M16

Actions
Copy link
 #3

Updated by okurz almost 6 years ago

  • Subject changed from [sle][functional][easy]extend SUSEConnect test with minimal UI checks to [sle][functional][u][easy] extend SUSEConnect test with minimal UI checks
  • Target version changed from Milestone 16 to Milestone 19

M16 is too ambitious it seems

Actions
Copy link
 #4

Updated by okurz almost 6 years ago

  • Target version changed from Milestone 19 to Milestone 19
Actions
Copy link
 #5

Updated by okurz over 5 years ago

  • Target version changed from Milestone 19 to future
Actions
Copy link
 #6

Updated by dheidler over 5 years ago

@okurz:

Regarding AC1: Can you rephrase this - my grammar parser fails here

Regarding AC2: Do we have a bsc here?

Actions
Copy link
 #7

Updated by okurz over 5 years ago

  • Description updated (diff)

dheidler wrote:

Regarding AC1: Can you rephrase this - my grammar parser fails here

yes, I tried to.

Regarding AC2: Do we have a bsc here?

I crossed of this point as the bug is VERIFIED FIXED since then so I think this is not needed anymore.

Actions
Copy link
 #8

Updated by okurz over 5 years ago

https://trello.com/c/q1OVLDwY/724-cnt-nicer-output-when-zypper-encounters-errors is an interesting feature request as outcome from agraul and me using SUSEConnect with our "observations" noted down in https://bugzilla.suse.com/show_bug.cgi?id=1117541

Actions
Copy link
 #11

Updated by okurz over 5 years ago

  • Status changed from Workable to Blocked
  • Assignee set to okurz

Seems some development is ongoing by hurhaj already in the related ticket, let's wait for that.

Actions
Copy link
 #12

Updated by SLindoMansilla over 5 years ago

SUSEConnect doesn't work on transactional-server role, and the suggestions output may reference to "transactional-server register".

See #42929

Not sure if we want to cover this, and if we want to cover it on this ticket.

Actions
Copy link
 #14

Updated by okurz about 5 years ago

  • Status changed from Blocked to Workable
  • Assignee deleted (okurz)
  • Target version changed from future to Milestone 24

#43136 is finished, should be easy for us to schedule the test module within product validation tests.

Actions
Copy link
 #15

Updated by okurz about 5 years ago

Suggestion: First schedule a simple scenario for both SLE12 and SLE15 with REGRESSION=suseconnect, later think about extending for what might be still missing (see description).

Actions
Copy link
 #16

Updated by okurz about 5 years ago

  • Status changed from Workable to New
  • Priority changed from Normal to Low
  • Target version changed from Milestone 24 to future

let's focus more on improving our current tests and workflows first. Putting to "holding tank" :)

Actions
Copy link
 #17

Updated by szarate about 4 years ago

  • Assignee set to mgriessmeier

Matthias to check what's needed here

Actions
Copy link
 #18

Updated by SLindoMansilla about 4 years ago

  • Assignee changed from mgriessmeier to SLindoMansilla

We have to prepare this before a grooming meeting.
The idea would be to use script_output to check that the expected SLE module are shown.

A screenshot will not cover the whole output: https://openqa.suse.de/tests/4145661#step/suseconnect_scc/10

Actions
Copy link
 #19

Updated by szarate about 4 years ago

  • Assignee changed from SLindoMansilla to mgriessmeier

A side note, we can simply use the serial console instead, and use the json output (-s option) of SUSEConnect in combination with script_output, so that perl does all the heavylifting here instead.

Actions
Copy link
 #20

Updated by SLindoMansilla about 4 years ago

  • Assignee changed from mgriessmeier to SLindoMansilla
Actions
Copy link
 #21

Updated by SLindoMansilla almost 4 years ago

  • Description updated (diff)
  • Status changed from New to Workable
  • Assignee deleted (SLindoMansilla)
  • Priority changed from Low to Normal
  • Target version changed from future to Milestone 30
  • Estimated time set to 42.00 h
Actions
Copy link
 #22

Updated by szarate almost 4 years ago

  • Related to action #66826: [SLE][Migration][SLE15SP2][enhance] Check SUSEConnect --list-extensions， SUSEConnect --status-text，zypper lr include all module information added
Actions
Copy link
 #23

Updated by zluo almost 4 years ago

  • Status changed from Workable to In Progress
  • Assignee set to zluo

okay, checking and add assert_screen call after the "--list-extensions"

Actions
Copy link
 #25

Updated by zluo almost 4 years ago

  • Status changed from In Progress to Resolved
Actions
Copy link
 #26

Updated by zluo almost 4 years ago

  • Status changed from Resolved to In Progress
Actions
Copy link
 #27

Updated by zluo almost 4 years ago

needle match only Server Applications Module 15 SP2 and Web and Scripting Module 15 SP2 without matching neither architecture, nor the instructions to activate/deactivate

Actions
Copy link
 #28

Updated by dheidler almost 4 years ago

Just make sure to match also the spaces before the module names to check for indentation:

SUSEConnect -l | grep "$(echo -en '            \e\[1mLegacy Module')"
Actions
Copy link

Also available in: Atom PDF