action #50726
closedcoordination #36712: [saga] Use YaST specific framework for GUI testing
coordination #50672: [funtional][y][epic] Use libyui-rest-api for YaST modules testing
[functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api
0%
Description
Motivation¶
We have a chance to run same tests for multiple stages of the development which will significantly simplify bisection during the failures investigation.
I as a YaST developer want to execute same integration tests as we run for build locally.
I as a QA engineer want to run same tests on multiple development phases to simplify bisection during the investigation.
Further details¶
We need to communicate with YaST team to come with the stack of technologies to be used, so both parties can contribute and easily understand setup.
For QA it's given, that results have to be wrapped in openQA.
Updated by riafarov over 5 years ago
- Subject changed from [f to [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api
- Description updated (diff)
- Due date set to 2019-05-07
- Category set to Spike/Research
Updated by riafarov over 5 years ago
- Due date changed from 2019-05-07 to 2019-05-21
Updated by JERiveraMoya over 5 years ago
- Due date changed from 2019-05-21 to 2019-06-04
Updated by riafarov over 5 years ago
- Blocks action #50723: [functional][y] Automate yast2 hostname using libyui-rest-api for tumbleweed added
Updated by riafarov over 5 years ago
- Due date changed from 2019-06-04 to 2019-06-18
Updated by riafarov over 5 years ago
- Due date changed from 2019-06-18 to 2019-07-02
Updated by riafarov over 5 years ago
- Due date changed from 2019-07-02 to 2019-07-16
- Assignee deleted (
cwh)
We need to progress here not to lose momentum. Christopher, could you please, update ticket with your findings so far?
Updated by riafarov over 5 years ago
https://hackweek.suse.com/18/projects/controlling-and-testing-the-yast-ui-remotely-for-integration-tests-openqa Ladi did some more things for the framework, now package is split into 3 separating qt and ncurses parts, so can be used in minimal setup without dragging qt dependencies.
Updated by riafarov over 5 years ago
Also, please, check container created to CI purposes: https://github.com/libyui/ci-libyui-container
Updated by JERiveraMoya over 5 years ago
- Status changed from Workable to In Progress
Updated by cwh over 5 years ago
For YaST development rspec is used for unit testing. Not sure if it can be used or anyhow makes sense to be used for integration tests.
At least this would mean to use a containerized test environment for being able to run those tests manually.
I still like the idea of using cucumber. What were the reasons for not using it?
Updated by JERiveraMoya over 5 years ago
- Status changed from In Progress to Feedback
@cwh I like cucumber too but for the moment we are thinking on term of complexity and cucumber is a complex framework.
According to discussion with the team, I created a mock-up transforming the initial simple ruby script in some rudimentary rspec which allows BDD: https://github.com/jknphy/sandbox-libyui-rest-api
Updated by JERiveraMoya over 5 years ago
I could only found allure as a suitable reporting testing framework (for ruby or python). Other frameworks like Extent Report or TestNG are attached to Java or very attached to Selenium or they are testing framework and not reporting framework.
Updated by riafarov over 5 years ago
- Copied to action #54305: [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api added
Updated by riafarov over 5 years ago
- Copied to deleted (action #54305: [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api )