Project

General

Profile

Actions
Copy link

action #16020

closed

action #13598: [sles][functional]Test module sles+extratests has inconsistent results

split "extratests" in same structure as in products/opensuse/main.pm

Added by okurz over 7 years ago. Updated about 7 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
asmorodskyi
Category:
Enhancement to existing tests
Target version:
openQA Project - Milestone 6
Start date:
2017-01-16
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

extratests must not be a bundle of all tests that fail. Currently (see parent ticket) too many tests are failing in the one big extratests scenario. In opensuse we already have a much better split so it's easiert to track there.

Actions
Copy link
 #1

Updated by asmorodskyi over 7 years ago

  • Assignee set to asmorodskyi
Actions
Copy link
 #2

Updated by okurz@suse.de over 7 years ago

please keep in mind I proposed you feel responsible which does not necessarily
mean you need to do it on your own :-)

Actions
Copy link
 #3

Updated by asmorodskyi over 7 years ago

  • Status changed from New to In Progress
Actions
Copy link
 #4

Updated by asmorodskyi over 7 years ago

  • Status changed from In Progress to Feedback
Actions
Copy link
 #5

Updated by asmorodskyi about 7 years ago

  • Status changed from Feedback to Resolved

PR merged and Test suites are updated .

Actions
Copy link
 #6

Updated by okurz about 7 years ago

  • Status changed from Resolved to In Progress

sorry, no. please see https://progress.opensuse.org/projects/openqatests/wiki#Definition-of-DONE . At least the last point: "At least one successful test run has been observed on osd or o3 and referenced in the corresponding progress item or bugzilla bug report if one exists" should be observed.

Also, as you restructured not only the test code but also the test suites: Can you please give a little bit more details about what changed and how the current situation looks like?

Also, the both main.pm files are now more similar but now duplicate content which should also be extracted, e.g. to lib/main_common.pm. Otherwise it will deteriorate very fast again, I'm afraid.

Actions
Copy link
 #7

Updated by zluo about 7 years ago

https://openqa.suse.de/tests/737252 shows still that textmode extratests got imcomplete tests status/failure, please fix this issue asap. It blocks my re-work on extra tests, thanks.

Actions
Copy link
 #8

Updated by okurz about 7 years ago

  • Target version changed from Milestone 5 to Milestone 6
Actions
Copy link
 #9

Updated by asmorodskyi about 7 years ago

  • Status changed from In Progress to Resolved
Actions
Copy link

Also available in: Atom PDF