coordination #20580
Updated by okurz about 7 years ago
## goal New job group [Functional](https://openqa.suse.de/admin/job_templates/110) which should be filled with a useful test coverage. ## current state riafarov Me and okurz Oliver have migrated all test suites from "Functional: Server" job group to "Functional" sub group of SLE 15: https://openqa.suse.de/group_overview/110 We also have triggered all test suites for x86_64 architecture in order to get an overview of common issues. After identifying most common problems and fixing them for this job group, we may migrate other job groups in similar way. ## tasks * DONE: <del>dumped templates for functional job group, adjusted for sle15, load</del> * DONE: <del>temporarily adjusted sync and trigger cron job to run daily only, not every 5 minutes as most new builds won't bring changes to actually fix job failures</del> * incorporate As next step we'll review process * focus on former `create_hdd_minimal_base+sdk` scenario as a major dependency for many other job groups, e.g. `create_hdd_development` (clone existing sle15 job, add repos from dist.suse.de with ADDON_URL or similar, etc.) * fix installation only test jobs * fix jobs previously relying on server packages, addons, modules by implementing a workaround based on custom repos and isos * delete the scenarios that do not apply anymore or rename and adjust accordingly * crosscheck other job groups, e.g. "Regression: Autoyast" * implement a script based solution to compare SLE15 coverage with SLE12SP3 covering multiple job groups so that we can be sure we did not forget any important scenario ## further details okurz created new job group [Functional](https://openqa.suse.de/admin/job_templates/110) which should be filled with a useful test coverage. To make sure we don't forget anything I would 1) `dump_templates` the existing sle 12 sp3 functional job group and load_templates that into the new group and then sort out the useless parts and change the scenarios that need to be adapted Alternatives are 2) same as above but move everything into the corresponding "test development" job group of SLE 15: https://openqa.suse.de/group_overview/110 and then selectively move over jobs. 3) Pick scenario by scenario whatever is considered useful and working. Challenge: We also have triggered all probably need a script to compare the existing test suites for x86_64 architecture in order to get an overview of common issues. After identifying most common problems coverage with the current coverage, evaluate the difference status and fixing them for this job group, make sure we may migrate other job groups start bringing tests in similar way. order. Attached json file was used to create job templates.