Project

General

Profile

Actions
Copy link

action #91187

closed

coordination #91139: [qe-core][epic] add QEM exclusive tests to product QE runs to increase coverage

[qe-core] Add existing tomcat test module to Product QE functional

Added by tjyrinki_suse about 3 years ago. Updated almost 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
zluo
Category:
New test
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

After comparing test coverage of SLE 15 SP2 and SP3 in opneQA I identified several tests that are exclusive to either pre-release or post-release testing and could be easily used to increase our coverage just by using what we already have.

It is possible that are some errors and some of the tests from the list are already being used. It is also just my opinion, therefor review from other colleagues is more then welcome.

These are the X11 tests that run only after release and could be used also before the release (QEM -> product QE)

tests/x11/piglit/piglit.pm
tests/x11/tomcat.pm

Actions
Copy link
 #1

Updated by tjyrinki_suse almost 3 years ago

  • Category set to New test
  • Status changed from New to Workable
Actions
Copy link
 #2

Updated by zluo almost 3 years ago

  • Status changed from Workable to In Progress
  • Assignee set to zluo

take over to check how to schedule these modules for QE on OSD.

Actions
Copy link
 #3

Updated by zluo almost 3 years ago

I found an issue related to zypper in tomcat packages:

https://bugzilla.suse.com/show_bug.cgi?id=1185474

and the repository 'Web_and Scripting' is not available on qcow2 image which created after sles 15 sp3 DVD Online installation, therefor it failed at moment:

Test died: 'zypper -n in tomcat tomcat-webapps tomcat-admin-webapps' failed with code 104 (ZYPPER_EXIT_INF_CAP_NOT_FOUND)

see http://10.160.64.152/tests/2223#step/tomcat/18

Actions
Copy link
 #4

Updated by zluo almost 3 years ago

Actions
Copy link
 #5

Updated by tjyrinki_suse almost 3 years ago

Seems like piglit test was added by Ondřej Súkup in 2017, but the package piglit has never been part of SLE. If you check the test suite, it's using PIGLIT_REPO=http://download.suse.de/ibs/QA:/Maintenance:/piglit/SLE-%VERSION%/ - currently there's only 15-SP1 and 15-SP2 over there. I think it's probably a good external test suite to test desktop functionality of SLE, but maybe not for our team specifically. Could be suggested to Desktop team however.

Actions
Copy link
 #6

Updated by zluo almost 3 years ago

Then we should not add piglit since we cannot/shouldn't use maintaince repo for functional tests in general. So I would like to suggest to skip it, just schedule tomcat test case. Even for tomcat I see a little problem because we need to create hdd of allmodules-allpatterns-gnome at first. I will think about it.

Actions
Copy link
 #7

Updated by zluo almost 3 years ago

testsuite 'tomcat' on osd created.

Actions
Copy link
 #10

Updated by zluo almost 3 years ago

  • Subject changed from [qe-core] Add existing X11 QEM tests to Product QE to [qe-core] Add existing tomcat test module to Product QE functional
  • Status changed from In Progress to Resolved

https://openqa.suse.de/tests/5951381

tomcat is scheduled now and it works without issue.

Actions
Copy link
 #11

Updated by tjyrinki_suse almost 3 years ago

Great, thank you, and I agree!

Actions
Copy link

Also available in: Atom PDF