QA » openQA Project

User Story¶

As a software stack developer I want to run synchronous qemu based tests in pull request CI runs to have system level test coverage before accepting PRs

Acceptance criteria¶

• AC1: Easy instructions how to run qemu based system level tests in any github project exist
• AC2: Scalable for multiple projects
• AC3: One example github PR or gitlab MR shows a successful test in action for any product or repository

Suggestions¶

• Experiment with local runs of isotovideo, maybe based on github.com/os-autoinst/os-autoinst-distri-example
  • isotovideo supports setting all necessary test parameters on the command line but a file vars.json can be used as well
• Look into github actions and publish on github marketplace for easy inclusion
  • you can start with https://docs.github.com/en/free-pro-team@latest/actions/creating-actions/creating-a-docker-container-action and https://github.com/actions/hello-world-docker-action
  • read how to publish on marketplace: https://docs.github.com/en/free-pro-team@latest/actions/creating-actions/publishing-actions-in-github-marketplace#publishing-an-action
• If the above is not feasible or as alternative create documentation describing how to use the proof of concept
• Try to have a generic solution that is not dependant on one specific CI provider but consider "polishing" it for at least one to be super-easy :)
• Also upload test artifacts, e.g. serial terminal log and video.ogv , e.g. see https://docs.github.com/en/free-pro-team@latest/actions/guides/storing-workflow-data-as-artifacts#uploading-build-and-test-artifacts . was suggested by pdostal in https://github.com/os-autoinst/os-autoinst-distri-example/pull/4#issuecomment-727800015