QA » openQA Project

Sorry you run into this, we are in the middle of making tests more reliable / redefining our workflow. Can you confirm that the same happens when e.g. you enable specific subset of tests to be run?

UITESTS=1 make docker-test

or, any other test matrix?

the question is basically: what tests did you expect to run? all of them?

I've also ran into this issue (it aborts before running anything).

Here I documented what works for me: https://github.com/os-autoinst/openQA/blob/master/docs/Contributing.asciidoc#how-to-run-tests-with-docker work. Note the exact docker pull line and make docker-test-build before make docker-test-run. Does it work when running the command manually?

the original intention with the docker-test target was to not have to run all those commands before running the actual test (as it should also pull the docker image) and the others are shortcuts to do things manually in case the automatic one fails.

• UITESTS=1 make docker-test works as it builds the docker image(s) and executes the UI tests
• make docker-test builds again but does not execute any tests:

$ make docker-test
docker build --no-cache /home/okurz/local/os-autoinst/openQA/docker/openqa -t openqa:latest
…
Successfully built 0c2d773f3229
Successfully tagged openqa:latest
env | grep -E 'FULLSTACK|UITEST|GH|TRAVIS|CPAN|DEBUG|ZYPPER' > "/home/okurz/local/os-autoinst/openQA/docker.env"
make: *** [Makefile:130: docker.env] Error 1

• make docker-test-run obviously skips the building and reproduces the last step failing

Yes, I expected it to run all tests or at least a "standard set" as the documentation https://github.com/os-autoinst/openQA/blob/master/docs/Contributing.asciidoc#how-to-run-tests-with-docker mentions this command.