[functional][u][userspace] Convert "qa_userspace_php7" to "console/php7"
|Category:||Enhancement to existing tests||Estimated time:||42.00 hours|
|Target version:||SUSE QA tests - Milestone 30|
In #44138 we changed most userspace scenarios to use
QA_TESTSET to provide better to understand test results on failures. The scenarios that so far could not be converted should be handled the same
We agreed to not maintain qa_userspace tests. To not loose coverage, we wanted to migrate them to normal openQA test modules.
There are already three existing modules that test php7:
- AC1: testsuite qa_userspace_php7 is covered by unit tests in OBS package, or openQA modules console/php7, console/mysql or console/php7_postgresql
- Investigate what is covered by qa_userspace_php7.
- Implement what is possible at OBS package level
- Implement the rest as normal openQA module.
- Status changed from Resolved to Workable
you are calling it "testsuite" correctly but you look for test modules. Try https://openqa.suse.de/admin/test_suites and please do not simply accept a "oh, I could not find the test" as "Resolved". You are paid to ensure that SLE has a good quality. And if for example we lost test coverage unknowingly this should not be accepted with simply a shrug.
I understand the confusion. It comes from the rename of the subject that slindomansilla did. It's apparently confusing and also a bit to too prescriptive of the implementation. Also obviously one can not convert a testsuite "qa_userspace_php7" to a test module "console/php7", which by the way already exists and is also mentioned in the description. The decision to "not maintain qa_userspace tests" in favor of plain os-autoinst tests is questionable but the important part is valid: "To not loose coverage" :)
I'm not able to find a recent job (or even a job at all) that is executing the qa_userspace_php7 testsuite.
So we don't seem to even test that one currently.
I am able to find similar tests that test eg. gzip.
That gzip test uses QA_TESTSET insted of the QA_TESTSUITE var though.
I think we should stop using that testsuite.
PHP has an upstream testsuite: https://travis-ci.org/php/php-src
And this testsuite was not touched for more than two years: https://github.com/SUSE/qa-testsuites/tree/master/tests/qa_test_php
At the same time I will extend the existing
tests/console/php7.pm module to do a bit more.
- Status changed from In Progress to Feedback