QA » openQA Project

As a first step I made a very simple test:

• Created a repo https://github.com/perlpunk/test-for-circleci
• Set up a very simple workflow where the final test depends on test1 and test2: https://github.com/perlpunk/test-for-circleci/blob/main/.circleci/config.yml
• Ran a PR: https://github.com/perlpunk/test-for-circleci/pull/1

All three tests are showing, and not the workflow name itself (which would be say-hello-workflow)
See screenshot.

So in principle it should work, but something is different for our setup.

I noticed that when clicking on the commit checks (that little icon (check mark, orance circle, red cross) besides the sha in gihub web ui, then all checks are reported as expected. See screenshot.

I got it working again, by enabling GitHub Status Updates in the Advanced Project Settings.
What I couldn't find out is, why this suddenly stopped working.

The features "GitHub Status Updates" and "GitHub checks" are explained here: https://circleci.com/docs/enable-checks

Apparently "GitHub Checks" reports the CircleCI workflow with a link to the github checks tab, and links to CircleCI from there to the jobs, while "GitHub Status Updates" reports each CircleCI job directly in the PR checks box.

The second question was, why were the ui and api check so special? The individual jobs weren't reported anymore, only the test workflow, but ui and api at least were still appearing as pending. And that is because in the openQA settings / branch protection rules, someone configured that api and ui must pass before anyone can merge. That's a GitHub feature additionally to the mergify.yml config.

Here is a PR showing all checks: https://github.com/os-autoinst/openQA/pull/4825