action #98183
closedcoordination #103323: [epic] BCI testing
Enable BCI tests on all the hosts
0%
Description
In this ticket we have enabled BCI tests for 15-SP3 container image on single host as a Proof of Concept.
We need to enable this test on ALL hosts that we have for testing images (sle versions, opensuse, centos, ubuntu, etc).
NOTE: the test targets only 15-SP3 container image (and 15-SP4 in the future). The rest of the images don't contain BCI repo.
Checklist
- Ubuntu 20.04
- CentOS 8
- RHEL 7 (RES)
- RHEL 8 (RES)
- openSUSE Leap 15.2
- openSUSE Leap 15.3
Updated by jlausuch over 3 years ago
- Related to action #94003: Test BCI repository on SLE Base container image. added
Updated by jlausuch over 3 years ago
- Status changed from New to Blocked
I set it to blocked due to https://progress.opensuse.org/issues/94003#note-13
Before we enable this test everywhere, we need to make sure that we are testing the right things.
Updated by jlausuch over 3 years ago
- Status changed from Workable to In Progress
Updated by jlausuch over 3 years ago
- Priority changed from High to Normal
So far, BCI tests could be run only with python 3.9.
Since we need to run it on different hosts, including 3rd party ones, that requirement is too high, not all the hosts come with python 3.9, specially old SPs..
Dan agreed to change the bci-tests code to support python 3.6, but it's not done yet.
Moving prio to "Normal" since I can start enabling hosts with python3.9 support but not all of them.
Updated by jlausuch over 3 years ago
We need to have gcc installed on the system to run the tests:
https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/13256
Updated by jlausuch over 3 years ago
bci-test repo now supports python3.6: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/13306
This way we can start enabling it on other hosts.
But there is another problem if the HOST is registered against SCC.
The tests expect 1 repository but if the host is registered, container-suseconnect-zypp
plugin will take the repos from the host and they will be available in the container.
[gw0] linux -- Python 3.6.13 /root/bci-tests/.tox/build/bin/python
container = ContainerData(image_url_or_id='c2afd431388b12b7005b5d42bf22dad4df73949f26846cd429c0e6fa82c4ae88', container_id='c133c6...fca9ca82d', connection=<testinfra.host.Host podman://c133c60b07cb8206a6f96a44e5666a25874ad9806242b9b3efc6cdcfca9ca82d>)
@pytest.mark.parametrize(
"container",
[
cont
for cont in ALL_CONTAINERS
if cont not in (MINIMAL_CONTAINER, MICRO_CONTAINER)
],
indirect=["container"],
)
def test_container_build_and_repo(container):
repos = etree.fromstring(
container.connection.run_expect([0], "zypper -x repos -u").stdout
)
repos_list = repos.xpath("//repo-list")
assert len(repos_list) == 1
> assert len(repos_list[0].getchildren()) == 1
E assert 16 == 1
E +16
E -1
Updated by jlausuch over 3 years ago
New PR that fixes some problems in s390x and ppc https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/13345
Updated by ilausuch over 3 years ago
The PR was merged. I understand this ticket is still open. Any new progress?
Updated by jlausuch over 3 years ago
There are more host to be added (e.g. Leap, Tw, Ubuntu, CentOS)...
I am slowly working on this but I want to wait until current tests are more stable.
Let's keep it "in progress" with normal priority.
Updated by jlausuch over 3 years ago
- Status changed from In Progress to Workable
- Assignee deleted (
jlausuch)
Unassigned from this for now. Might pick it up later on.
Updated by jlausuch over 3 years ago
- Status changed from Workable to In Progress
- Assignee set to jlausuch
I am now working on enabling BCI in Ubuntu and CentOS.
Updated by jlausuch over 3 years ago
https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/13757
After updating the Ubuntu and CentOS images with higher disk size, the tests can now run on those OS.
I created this guides to proper reproduce the images when needed.
https://confluence.suse.com/display/qasle/Ubuntu+image
https://confluence.suse.com/display/qasle/CentOS+image
Updated by jlausuch over 3 years ago
- Checklist item Ubuntu 20.04 added
- Checklist item CentOS 8 added
- Checklist item RHEL 7 (RES) added
- Checklist item RHEL 8 (RES) added
- Checklist item openSUSE Leap 15.2 added
- Checklist item openSUSE Leap 15.3 added
Updated by jlausuch over 3 years ago
- Checklist item Ubuntu 20.04 set to Not done
- Checklist item CentOS 8 set to Not done
Updated by jlausuch over 3 years ago
- Checklist item Ubuntu 20.04 set to Done
- Checklist item CentOS 8 set to Done
Updated by jlausuch about 3 years ago
- Status changed from In Progress to Workable
Moving to workable. Will work on Leap after Xmas break.
Updated by jlausuch about 3 years ago
- Assignee deleted (
jlausuch) - Priority changed from Normal to Low
Updated by mloviska almost 3 years ago
- Status changed from Workable to In Progress
- Assignee set to mloviska
Updated by mloviska almost 3 years ago
Current problem on RHEL 8.5 http://kepler.suse.cz/tests/16385#step/bci_prepare/39
Updated by mloviska almost 3 years ago
- Status changed from In Progress to Feedback
Updated by mloviska almost 3 years ago
- Status changed from Feedback to Resolved