Project

General

Profile

action #50726

action #36712: [sle][functional][y][yast][hackweek][saga] Use YaST specific framework for GUI testing

action #50672: [funtional][y][epic] Use libyui-rest-api for YaST modules testing

[functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api

Added by riafarov about 1 year ago. Updated 11 months ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
Spike/Research
Target version:
-
Start date:
2019-04-25
Due date:
2019-07-16
% Done:

0%

Estimated time:
Difficulty:
Duration: 59

Description

Motivation

We have a chance to run same tests for multiple stages of the development which will significantly simplify bisection during the failures investigation.
I as a YaST developer want to execute same integration tests as we run for build locally.
I as a QA engineer want to run same tests on multiple development phases to simplify bisection during the investigation.

Further details

We need to communicate with YaST team to come with the stack of technologies to be used, so both parties can contribute and easily understand setup.
For QA it's given, that results have to be wrapped in openQA.


Related issues

Blocks openQA Tests - action #50723: [functional][y] Automate yast2 hostname using libyui-rest-api for tumbleweedBlocked2019-04-25

History

#1 Updated by riafarov about 1 year ago

  • Subject changed from [f to [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api
  • Description updated (diff)
  • Due date set to 2019-05-07
  • Category set to Spike/Research

#2 Updated by riafarov about 1 year ago

  • Due date changed from 2019-05-07 to 2019-05-21

#3 Updated by JERiveraMoya about 1 year ago

  • Due date changed from 2019-05-21 to 2019-06-04

#4 Updated by riafarov about 1 year ago

  • Blocks action #50723: [functional][y] Automate yast2 hostname using libyui-rest-api for tumbleweed added

#5 Updated by riafarov about 1 year ago

  • Status changed from New to Workable

#6 Updated by cwh about 1 year ago

  • Assignee set to cwh

#7 Updated by riafarov about 1 year ago

  • Due date changed from 2019-06-04 to 2019-06-18

#8 Updated by riafarov 12 months ago

  • Due date changed from 2019-06-18 to 2019-07-02

#9 Updated by riafarov 12 months ago

  • Priority changed from Normal to High

#10 Updated by riafarov 11 months ago

  • Due date changed from 2019-07-02 to 2019-07-16
  • Assignee deleted (cwh)

We need to progress here not to lose momentum. Christopher, could you please, update ticket with your findings so far?

#11 Updated by JERiveraMoya 11 months ago

  • Assignee set to JERiveraMoya

#12 Updated by riafarov 11 months ago

https://hackweek.suse.com/18/projects/controlling-and-testing-the-yast-ui-remotely-for-integration-tests-openqa Ladi did some more things for the framework, now package is split into 3 separating qt and ncurses parts, so can be used in minimal setup without dragging qt dependencies.

#13 Updated by riafarov 11 months ago

Also, please, check container created to CI purposes: https://github.com/libyui/ci-libyui-container

#14 Updated by JERiveraMoya 11 months ago

  • Status changed from Workable to In Progress

#15 Updated by cwh 11 months ago

For YaST development rspec is used for unit testing. Not sure if it can be used or anyhow makes sense to be used for integration tests.
At least this would mean to use a containerized test environment for being able to run those tests manually.

I still like the idea of using cucumber. What were the reasons for not using it?

#16 Updated by JERiveraMoya 11 months ago

  • Status changed from In Progress to Feedback

cwh I like cucumber too but for the moment we are thinking on term of complexity and cucumber is a complex framework.
According to discussion with the team, I created a mock-up transforming the initial simple ruby script in some rudimentary rspec which allows BDD: https://github.com/jknphy/sandbox-libyui-rest-api

#17 Updated by JERiveraMoya 11 months ago

I could only found allure as a suitable reporting testing framework (for ruby or python). Other frameworks like Extent Report or TestNG are attached to Java or very attached to Selenium or they are testing framework and not reporting framework.

#18 Updated by riafarov 11 months ago

  • Copied to action #54305: [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api added

#19 Updated by riafarov 11 months ago

  • Copied to deleted (action #54305: [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api )

#20 Updated by riafarov 11 months ago

  • Status changed from Feedback to Resolved

Also available in: Atom PDF