QA (public) » openQA Project (public) » openQA Tests (public) » Containers and images

Observation¶

This container_host_podman_test suite is very unstable/unreliable and is based way to much on luck. AS such, the test does not give a realistic result about the quality of the snapshot.

The last run for example failed with

not ok 59 [030] podman run --pull
# (from function `bail-now' in file test/system/helpers.bash, line 187,
#  from function `die' in file test/system/helpers.bash, line 981,
#  from function `run_podman' in file test/system/helpers.bash, line 572,
#  in test file test/system/030-run.bats, line 176)
#   `run_podman run --pull=always $NONLOCAL_IMAGE true' failed
#
# [08:53:26.833007820] $ /usr/bin/podman run --pull=missing quay.io/libpod/testimage:20241011 true
#
# [08:53:26.945053153] $ /usr/bin/podman run --pull=never quay.io/libpod/testimage:20241011 true
#
# [08:53:27.062175449] $ /usr/bin/podman run --pull=never quay.io/libpod/testimage:00000004 true
# [08:53:27.104838318] Error: quay.io/libpod/testimage:00000004: image not known
# [08:53:27.107771980] [ rc=125 (expected) ]
#
# [08:53:27.114436966] $ /usr/bin/podman run --pull=missing quay.io/libpod/testimage:00000004 true
# [08:53:29.447715231] Trying to pull quay.io/libpod/testimage:00000004...
# Getting image source signatures
# Copying blob sha256:cecc78ee407586f0c9eec844d60b8d40698a35e8d3d59f11a45a6b19a21fb7f0
# Copying config sha256:560956ac186f909c45731174e2d2b62180b638aa44e16739d02f0fb39f7b4ffb
# Writing manifest to image destination
#
# [08:53:29.459373391] $ /usr/bin/podman run --pull=missing quay.io/libpod/testimage:00000004 true
#
# [08:53:29.576056961] $ /usr/bin/podman run --pull=always quay.io/libpod/testimage:00000004 true
# [08:53:30.693873720] Trying to pull quay.io/libpod/testimage:00000004...
# Error: initializing source docker://quay.io/libpod/testimage:00000004: Requesting bearer token: invalid status code from registry 502 (Bad Gateway)
# [08:53:30.696908324] [ rc=125 (** EXPECTED 0 **) ]
# #/vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
# #| FAIL: exit code is 125; expected 0
# #\^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

The run just before that one also failed, but 59 passed - i.e the failures are moving;
Is there any way to make those tests reliable?

openQA test in scenario opensuse-Tumbleweed-DVD-x86_64-container_host_podman_testsuite@64bit fails in
bats-user-local_tap

Test suite description¶

Maintainer: qe-c@suse.de https://confluence.suse.com/display/qasle/podman+upstream+tests

Reproducible¶

Fails since (at least) Build 20250113

Expected result¶

Last good: 20250112 (or more recent)

Further details¶

Always latest result in this scenario: latest