coordination #72889: [qe-core][qem][epic] QAM move job groups, test suites, medium types to git, and then restructure QAM testing to be more easily comparable to product QA
[qe-core][qem] Move osd test suites to git
The JobGroups used by qem jobs largely use the same test suites across multiple groups and products. That means that they can't be easily defined inline in the JobGroup yaml. So a similar process with the JobGroups CI for saving and updating them off the osd instance is needed.
- Status changed from New to In Progress
This is being done here:
The archive is because qem doesn't own all the test suites it uses. We can't force other people to use our CI, so we are going to just archive those. Those that start with qam/mau will be overwritten from the CI all the time, so that any changes from the UI will be ignored.
A bit of documentation regarding the current design.
(This is also on gitlab and confluence)
For the purpose of this project testsuites, are the database entries that are
$openqa_instance/api/v1/test_suites in JSON form. We divide
testsuites in two types, those that were owned by QEM and whose name starts with
mau (QEM suites) and the rest (common suites). QEM suites are defined
at ./TestSuites/qem/ and are to be edited there, not OSD. Common testsuites
are stored at ./archive/TestSuites/common and are meant to be edited
elsewhere, on OSD or where their maintainer decides.
When a MR is done that edits the QEM testsuites, the CI runs
verify_testsuites.yml. That checks whether:
- the QEM testsuites, that are required by the JobGroups, are stored in the proper directory.
- the common testsuites, that are required by the Jobgroups, are stored in the archive directory.
- that all testsuite JSONs are canonical and "pretty".
After the MR is merged in to the main repo, the
sends only the QEM testsuites to OSD.
The archival of the common testsuites is not done automatically at the moment
but will be automated in the future.
#17 Updated by tjyrinki_suse 26 days ago
Useful to link this https://gitlab.suse.de/qa-maintenance/qam-openqa-yml/-/merge_requests/163 here as well with the review discussion.