action #54305: [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api - qe-yam - openSUSE Project Management Tool

Actions

Copy link

action #54305

closed

coordination #36712: [saga] Use YaST specific framework for GUI testing

coordination #50672: [funtional][y][epic] Use libyui-rest-api for YaST modules testing

[functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api

Added by riafarov almost 5 years ago. Updated over 3 years ago.

Status:

Resolved

Priority:

High

Assignee:

JERiveraMoya

Target version:

Start date:

2019-04-25

Due date:

2019-07-30

% Done:

Estimated time:

Description

Motivation¶

We have a chance to run same tests for multiple stages of the development which will significantly simplify bisection during the failures investigation.
I as a YaST developer want to execute same integration tests as we run for build locally.
I as a QA engineer want to run same tests on multiple development phases to simplify bisection during the investigation.

This ticket is follow up on #50726, @jrivera has explored rspec and proved that it works well and can be used.
Two remaining point are integration with openQA (is that possible to generate results in xUnit?).
Can we generate better reports than openQA, e.g. allure.
Now we need to demo the solution to the YaST team and come up with the next steps to start using it for TW in openQA and in CI for the package itself.

Further details¶

We need to communicate with YaST team to come with the stack of technologies to be used, so both parties can contribute and easily understand setup.
For QA it's given, that results have to be wrapped in openQA.

Actions

Copy link

Updated by riafarov almost 5 years ago

Copied from action #50726: [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api added

Actions

Copy link

Updated by riafarov almost 5 years ago

Copied from deleted (action #50726: [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api)

Actions

Copy link

Updated by riafarov almost 5 years ago

Description updated (diff)
Parent task set to #50672

Actions

Copy link

Updated by JERiveraMoya almost 5 years ago

gem rspec_junit_formatter is able to generate an XML as follows:

<?xml version="1.0" encoding="UTF-8"?>
<testsuite name="rspec" tests="4" skipped="0" failures="0" errors="0" time="4.068435" timestamp="2019-07-17T03:38:52-04:00" hostname="susetest">
<properties>
<property name="seed" value="13398"/>
</properties>
<testcase classname="spec.add_host_spec" name="HostConfiguration When module is open is displayed a heading title &apos;Host Configuration" file="./spec/add_host_spec.rb" time="0.002166"></testcase>
<testcase classname="spec.add_host_spec" name="HostConfiguration When button Add is clicked appears a pop-up" file="./spec/add_host_spec.rb" time="0.014326"></testcase>
<testcase classname="spec.add_host_spec" name="HostConfiguration When dialog is filled in and click ok appears a new row in the table with corresponding data" file="./spec/add_host_spec.rb" time="2.016895"></testcase>
<testcase classname="spec.add_host_spec" name="HostConfiguration When confirm changes in YaST module should be added new hostname to /etc/hosts" file="./spec/add_host_spec.rb" time="2.030483"></testcase>
</testsuite>

Actions

Copy link

Updated by riafarov almost 5 years ago

Subject changed from [functional][y] Explore different ideas which technologies to use with libyui-rest-api to [functional][y][timboxed:16h] Explore different ideas which technologies to use with libyui-rest-api
Status changed from New to Workable

Actions

Copy link

Updated by JERiveraMoya almost 5 years ago

Subject changed from [functional][y][timboxed:16h] Explore different ideas which technologies to use with libyui-rest-api to [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api

Actions

Copy link