Project

General

Profile

action #54305

action #36712: [sle][functional][y][yast][hackweek][saga] Use YaST specific framework for GUI testing

action #50672: [funtional][y][epic] Use libyui-rest-api for YaST modules testing

[functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api

Added by riafarov 12 months ago. Updated 12 months ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
Spike/Research
Target version:
-
Start date:
2019-04-25
Due date:
2019-07-30
% Done:

0%

Estimated time:
Difficulty:
Duration: 69

Description

Motivation

We have a chance to run same tests for multiple stages of the development which will significantly simplify bisection during the failures investigation.
I as a YaST developer want to execute same integration tests as we run for build locally.
I as a QA engineer want to run same tests on multiple development phases to simplify bisection during the investigation.

This ticket is follow up on #50726, @jrivera has explored rspec and proved that it works well and can be used.
Two remaining point are integration with openQA (is that possible to generate results in xUnit?).
Can we generate better reports than openQA, e.g. allure.
Now we need to demo the solution to the YaST team and come up with the next steps to start using it for TW in openQA and in CI for the package itself.

Further details

We need to communicate with YaST team to come with the stack of technologies to be used, so both parties can contribute and easily understand setup.
For QA it's given, that results have to be wrapped in openQA.

History

#1 Updated by riafarov 12 months ago

  • Copied from action #50726: [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api added

#2 Updated by riafarov 12 months ago

  • Copied from deleted (action #50726: [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api)

#3 Updated by riafarov 12 months ago

  • Description updated (diff)
  • Parent task set to #50672

#4 Updated by JERiveraMoya 12 months ago

gem rspec_junit_formatter is able to generate an XML as follows:

<?xml version="1.0" encoding="UTF-8"?>
<testsuite name="rspec" tests="4" skipped="0" failures="0" errors="0" time="4.068435" timestamp="2019-07-17T03:38:52-04:00" hostname="susetest">
<properties>
<property name="seed" value="13398"/>
</properties>
<testcase classname="spec.add_host_spec" name="HostConfiguration When module is open is displayed a heading title &apos;Host Configuration" file="./spec/add_host_spec.rb" time="0.002166"></testcase>
<testcase classname="spec.add_host_spec" name="HostConfiguration When button Add is clicked appears a pop-up" file="./spec/add_host_spec.rb" time="0.014326"></testcase>
<testcase classname="spec.add_host_spec" name="HostConfiguration When dialog is filled in and click ok appears a new row in the table with corresponding data" file="./spec/add_host_spec.rb" time="2.016895"></testcase>
<testcase classname="spec.add_host_spec" name="HostConfiguration When confirm changes in YaST module should be added new hostname to /etc/hosts" file="./spec/add_host_spec.rb" time="2.030483"></testcase>
</testsuite>

#5 Updated by riafarov 12 months ago

  • Subject changed from [functional][y] Explore different ideas which technologies to use with libyui-rest-api to [functional][y][timboxed:16h] Explore different ideas which technologies to use with libyui-rest-api
  • Status changed from New to Workable

#6 Updated by JERiveraMoya 12 months ago

  • Subject changed from [functional][y][timboxed:16h] Explore different ideas which technologies to use with libyui-rest-api to [functional][y][timeboxed:16h] Explore different ideas which technologies to use with libyui-rest-api

#7 Updated by oorlov 12 months ago

  • Status changed from Workable to In Progress
  • Assignee set to oorlov

#8 Updated by oorlov 12 months ago

  • Status changed from In Progress to Workable
  • Assignee deleted (oorlov)

#9 Updated by JERiveraMoya 12 months ago

  • Assignee set to JERiveraMoya

#10 Updated by JERiveraMoya 12 months ago

  • Status changed from Workable to In Progress

#12 Updated by JERiveraMoya 12 months ago

  • Status changed from In Progress to Resolved

Also available in: Atom PDF