Project

General

Profile

action #50726

coordination #36712: [saga] Use YaST specific framework for GUI testing

coordination #50672: [funtional][y][epic] Use libyui-rest-api for YaST modules testing

[functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api

Added by riafarov about 2 years ago. Updated 7 months ago.

Status:
Resolved
Priority:
High
Assignee:
Target version:
-
Start date:
2019-04-25
Due date:
2019-07-16
% Done:

0%

Estimated time:

Description

Motivation

We have a chance to run same tests for multiple stages of the development which will significantly simplify bisection during the failures investigation.
I as a YaST developer want to execute same integration tests as we run for build locally.
I as a QA engineer want to run same tests on multiple development phases to simplify bisection during the investigation.

Further details

We need to communicate with YaST team to come with the stack of technologies to be used, so both parties can contribute and easily understand setup.
For QA it's given, that results have to be wrapped in openQA.


Related issues

Blocks qe-yast - action #50723: [functional][y] Automate yast2 hostname using libyui-rest-api for tumbleweedNew2019-04-25

History

#1 Updated by riafarov about 2 years ago

  • Subject changed from [f to [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api
  • Description updated (diff)
  • Due date set to 2019-05-07
  • Category set to Spike/Research

#2 Updated by riafarov about 2 years ago

  • Due date changed from 2019-05-07 to 2019-05-21

#3 Updated by JERiveraMoya about 2 years ago

  • Due date changed from 2019-05-21 to 2019-06-04

#4 Updated by riafarov almost 2 years ago

  • Blocks action #50723: [functional][y] Automate yast2 hostname using libyui-rest-api for tumbleweed added

#5 Updated by riafarov almost 2 years ago

  • Status changed from New to Workable

#6 Updated by cwh almost 2 years ago

  • Assignee set to cwh

#7 Updated by riafarov almost 2 years ago

  • Due date changed from 2019-06-04 to 2019-06-18

#8 Updated by riafarov almost 2 years ago

  • Due date changed from 2019-06-18 to 2019-07-02

#9 Updated by riafarov almost 2 years ago

  • Priority changed from Normal to High

#10 Updated by riafarov almost 2 years ago

  • Due date changed from 2019-07-02 to 2019-07-16
  • Assignee deleted (cwh)

We need to progress here not to lose momentum. Christopher, could you please, update ticket with your findings so far?

#11 Updated by JERiveraMoya almost 2 years ago

  • Assignee set to JERiveraMoya

#12 Updated by riafarov almost 2 years ago

https://hackweek.suse.com/18/projects/controlling-and-testing-the-yast-ui-remotely-for-integration-tests-openqa Ladi did some more things for the framework, now package is split into 3 separating qt and ncurses parts, so can be used in minimal setup without dragging qt dependencies.

#13 Updated by riafarov almost 2 years ago

Also, please, check container created to CI purposes: https://github.com/libyui/ci-libyui-container

#14 Updated by JERiveraMoya almost 2 years ago

  • Status changed from Workable to In Progress

#15 Updated by cwh almost 2 years ago

For YaST development rspec is used for unit testing. Not sure if it can be used or anyhow makes sense to be used for integration tests.
At least this would mean to use a containerized test environment for being able to run those tests manually.

I still like the idea of using cucumber. What were the reasons for not using it?

#16 Updated by JERiveraMoya almost 2 years ago

  • Status changed from In Progress to Feedback

cwh I like cucumber too but for the moment we are thinking on term of complexity and cucumber is a complex framework.
According to discussion with the team, I created a mock-up transforming the initial simple ruby script in some rudimentary rspec which allows BDD: https://github.com/jknphy/sandbox-libyui-rest-api

#17 Updated by JERiveraMoya almost 2 years ago

I could only found allure as a suitable reporting testing framework (for ruby or python). Other frameworks like Extent Report or TestNG are attached to Java or very attached to Selenium or they are testing framework and not reporting framework.

#18 Updated by riafarov almost 2 years ago

  • Copied to action #54305: [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api added

#19 Updated by riafarov almost 2 years ago

  • Copied to deleted (action #54305: [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api )

#20 Updated by riafarov almost 2 years ago

  • Status changed from Feedback to Resolved

Also available in: Atom PDF