action #27853

[sle][functional][u][easy] extend SUSEConnect test with minimal UI checks

Added by okurz over 2 years ago. Updated 12 months ago.

Status:NewStart date:17/11/2017
Priority:LowDue date:
Assignee:-% Done:

0%

Category:New test
Target version:QA - future
Difficulty:
Duration:

Description

Observation

openQA test in scenario sle-15-Installer-DVD-x86_64-minimal+proxy_SCC-postreg_SUSEconnect@64bit in
suseconnect_scc shows that the test passes but the output is … suboptimal, e.g. "--list-extensions" does not list the "server applications" module even though it's there as it can be activated later on.

Acceptance criteria

  • AC1: There is a needle check asserting on correct rendering of the console UI of SUSEConnect
  • AC2: There is a soft-fail needle with a bugref for the missing server applications module -> https://bugzilla.suse.com/show_bug.cgi?id=1064264 , being VERIFIED FIXED

Tasks

  • Add a assert_screen call after the "--list-extensions" call (0.1-1h)
  • Add a needle with soft-fail reference to the bug that nsinger create(s/d) (0.1-0.5h)

Further details

I think a needle check with assert_screen is correct here because even though it's about a console application we want to check the very least of "UI" here as the customer is supposed to use the same. correct rendering is up to the ticket assignee to decide what makes sense.

Always latest result in this scenario: latest

History

#1 Updated by riafarov about 2 years ago

  • Status changed from In Progress to Workable

#2 Updated by okurz about 2 years ago

  • Category changed from Bugs in existing tests to New test
  • Target version changed from Milestone 13 to Milestone 16

that's actually a "new test". Maybe something we will be able to do in M16

#3 Updated by okurz almost 2 years ago

  • Subject changed from [sle][functional][easy]extend SUSEConnect test with minimal UI checks to [sle][functional][u][easy] extend SUSEConnect test with minimal UI checks
  • Target version changed from Milestone 16 to Milestone 19

M16 is too ambitious it seems

#4 Updated by okurz over 1 year ago

  • Target version changed from Milestone 19 to Milestone 19

#5 Updated by okurz over 1 year ago

  • Target version changed from Milestone 19 to future

#6 Updated by dheidler over 1 year ago

@okurz:

Regarding AC1: Can you rephrase this - my grammar parser fails here

Regarding AC2: Do we have a bsc here?

#7 Updated by okurz over 1 year ago

  • Description updated (diff)

dheidler wrote:

Regarding AC1: Can you rephrase this - my grammar parser fails here

yes, I tried to.

Regarding AC2: Do we have a bsc here?

I crossed of this point as the bug is VERIFIED FIXED since then so I think this is not needed anymore.

#8 Updated by okurz about 1 year ago

https://trello.com/c/q1OVLDwY/724-cnt-nicer-output-when-zypper-encounters-errors is an interesting feature request as outcome from agraul and me using SUSEConnect with our "observations" noted down in https://bugzilla.suse.com/show_bug.cgi?id=1117541

#11 Updated by okurz about 1 year ago

  • Status changed from Workable to Blocked
  • Assignee set to okurz

Seems some development is ongoing by hurhaj already in the related ticket, let's wait for that.

#12 Updated by SLindoMansilla about 1 year ago

SUSEConnect doesn't work on transactional-server role, and the suggestions output may reference to "transactional-server register".

See #42929

Not sure if we want to cover this, and if we want to cover it on this ticket.

#14 Updated by okurz about 1 year ago

  • Status changed from Blocked to Workable
  • Assignee deleted (okurz)
  • Target version changed from future to Milestone 24

#43136 is finished, should be easy for us to schedule the test module within product validation tests.

#15 Updated by okurz about 1 year ago

Suggestion: First schedule a simple scenario for both SLE12 and SLE15 with REGRESSION=suseconnect, later think about extending for what might be still missing (see description).

#16 Updated by okurz 12 months ago

  • Status changed from Workable to New
  • Priority changed from Normal to Low
  • Target version changed from Milestone 24 to future

let's focus more on improving our current tests and workflows first. Putting to "holding tank" :)

Also available in: Atom PDF