Project

General

Profile

action #16020

action #13598: [sles][functional]Test module sles+extratests has inconsistent results

split "extratests" in same structure as in products/opensuse/main.pm

Added by okurz about 6 years ago. Updated almost 6 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Enhancement to existing tests
Start date:
2017-01-16
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

extratests must not be a bundle of all tests that fail. Currently (see parent ticket) too many tests are failing in the one big extratests scenario. In opensuse we already have a much better split so it's easiert to track there.

History

#1 Updated by asmorodskyi about 6 years ago

  • Assignee set to asmorodskyi

#2 Updated by okurz@suse.de about 6 years ago

please keep in mind I proposed you feel responsible which does not necessarily
mean you need to do it on your own :-)

#3 Updated by asmorodskyi about 6 years ago

  • Status changed from New to In Progress

#4 Updated by asmorodskyi about 6 years ago

  • Status changed from In Progress to Feedback

#5 Updated by asmorodskyi about 6 years ago

  • Status changed from Feedback to Resolved

PR merged and Test suites are updated .

#6 Updated by okurz about 6 years ago

  • Status changed from Resolved to In Progress

sorry, no. please see https://progress.opensuse.org/projects/openqatests/wiki#Definition-of-DONE . At least the last point: "At least one successful test run has been observed on osd or o3 and referenced in the corresponding progress item or bugzilla bug report if one exists" should be observed.

Also, as you restructured not only the test code but also the test suites: Can you please give a little bit more details about what changed and how the current situation looks like?

Also, the both main.pm files are now more similar but now duplicate content which should also be extracted, e.g. to lib/main_common.pm. Otherwise it will deteriorate very fast again, I'm afraid.

#7 Updated by zluo about 6 years ago

https://openqa.suse.de/tests/737252 shows still that textmode extratests got imcomplete tests status/failure, please fix this issue asap. It blocks my re-work on extra tests, thanks.

#8 Updated by okurz almost 6 years ago

  • Target version changed from Milestone 5 to Milestone 6

#9 Updated by asmorodskyi almost 6 years ago

  • Status changed from In Progress to Resolved

Also available in: Atom PDF