action #16020
closed
action #13598: [sles][functional]Test module sles+extratests has inconsistent results
split "extratests" in same structure as in products/opensuse/main.pm
Added by okurz over 7 years ago.
Updated about 7 years ago.
Category:
Enhancement to existing tests
Description
extratests must not be a bundle of all tests that fail. Currently (see parent ticket) too many tests are failing in the one big extratests scenario. In opensuse we already have a much better split so it's easiert to track there.
- Assignee set to asmorodskyi
please keep in mind I proposed you feel responsible which does not necessarily
mean you need to do it on your own :-)
- Status changed from New to In Progress
- Status changed from In Progress to Feedback
- Status changed from Feedback to Resolved
PR merged and Test suites are updated .
- Status changed from Resolved to In Progress
sorry, no. please see https://progress.opensuse.org/projects/openqatests/wiki#Definition-of-DONE . At least the last point: "At least one successful test run has been observed on osd or o3 and referenced in the corresponding progress item or bugzilla bug report if one exists" should be observed.
Also, as you restructured not only the test code but also the test suites: Can you please give a little bit more details about what changed and how the current situation looks like?
Also, the both main.pm files are now more similar but now duplicate content which should also be extracted, e.g. to lib/main_common.pm. Otherwise it will deteriorate very fast again, I'm afraid.
https://openqa.suse.de/tests/737252 shows still that textmode extratests got imcomplete tests status/failure, please fix this issue asap. It blocks my re-work on extra tests, thanks.
- Target version changed from Milestone 5 to Milestone 6
- Status changed from In Progress to Resolved
Also available in: Atom
PDF