coordination #20580
Updated by okurz over 6 years ago
## goal New job group [Functional](https://openqa.suse.de/admin/job_templates/110) which should be filled with a useful test coverage. ## current state riafarov and okurz have migrated all test suites from "Functional: Server" job group to "Functional" sub group of SLE 15: https://openqa.suse.de/group_overview/110 We also have triggered all test suites for x86_64 architecture in order to get an overview of common issues. After identifying most common problems and fixing them for this job group, we may migrate other job groups in similar way. ## tasks * DONE: <del>dumped templates for functional job group, adjusted for sle15, load</del> * DONE: <del>temporarily adjusted sync and trigger cron job to run daily only, not every 5 minutes as most new builds won't bring changes to actually fix job failures</del> * DONE: <del>incorporate incorporate review process</del> process * DONE: <del>focus focus on former `create_hdd_minimal_base+sdk` scenario as a major dependency for many other job groups, e.g. `create_hdd_development` (clone existing sle15 job, add repos from dist.suse.de with ADDON_URL or similar, etc.)</del> etc.) * DONE: <del>fix fix installation only test jobs</del> jobs * DONE: <del>fix fix jobs previously relying on server packages, addons, modules by implementing a workaround based on custom repos and isos</del> isos * DONE: <del>crosscheck other job groups, e.g. "Regression: Autoyast"</del> * delete the scenarios that do not apply anymore or rename and adjust accordingly * crosscheck other job groups, e.g. "Regression: Autoyast" * implement a script based solution to compare SLE15 coverage with SLE12SP3 covering multiple job groups so that we can be sure we did not forget any important scenario ## further details okurz created new job group [Functional](https://openqa.suse.de/admin/job_templates/110) which should be filled with a useful test coverage. To make sure we don't forget anything I would 1) `dump_templates` the existing sle 12 sp3 functional job group and load_templates that into the new group and then sort out the useless parts and change the scenarios that need to be adapted Alternatives are 2) same as above but move everything into the corresponding "test development" job group of SLE 15: https://openqa.suse.de/group_overview/110 and then selectively move over jobs. 3) Pick scenario by scenario whatever is considered useful and working. Challenge: We also have triggered all probably need a script to compare the existing test suites for x86_64 architecture in order to get an overview of common issues. After identifying most common problems coverage with the current coverage, evaluate the difference and fixing them for this job group, make sure we may migrate other job groups in similar way. Attached json file was used to create job templates.