Project

General

Profile

Actions

action #98183

closed

coordination #103323: [epic] BCI testing

Enable BCI tests on all the hosts

Added by jlausuch almost 3 years ago. Updated about 2 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Target version:
-
Start date:
2021-09-06
Due date:
% Done:

0%

Estimated time:

Description

In this ticket we have enabled BCI tests for 15-SP3 container image on single host as a Proof of Concept.

We need to enable this test on ALL hosts that we have for testing images (sle versions, opensuse, centos, ubuntu, etc).
NOTE: the test targets only 15-SP3 container image (and 15-SP4 in the future). The rest of the images don't contain BCI repo.


Checklist

  • Ubuntu 20.04
  • CentOS 8
  • RHEL 7 (RES)
  • RHEL 8 (RES)
  • openSUSE Leap 15.2
  • openSUSE Leap 15.3

Related issues 1 (0 open1 closed)

Related to Containers - action #94003: Test BCI repository on SLE Base container image. Resolvedjlausuch2021-06-15

Actions
Actions #1

Updated by jlausuch almost 3 years ago

  • Related to action #94003: Test BCI repository on SLE Base container image. added
Actions #2

Updated by jlausuch almost 3 years ago

  • Status changed from New to Blocked

I set it to blocked due to https://progress.opensuse.org/issues/94003#note-13
Before we enable this test everywhere, we need to make sure that we are testing the right things.

Actions #3

Updated by jlausuch almost 3 years ago

  • Status changed from Blocked to Workable
Actions #4

Updated by jlausuch almost 3 years ago

  • Status changed from Workable to In Progress
Actions #5

Updated by jlausuch almost 3 years ago

  • Assignee set to jlausuch
Actions #6

Updated by jlausuch almost 3 years ago

  • Priority changed from High to Normal

So far, BCI tests could be run only with python 3.9.
Since we need to run it on different hosts, including 3rd party ones, that requirement is too high, not all the hosts come with python 3.9, specially old SPs..

Dan agreed to change the bci-tests code to support python 3.6, but it's not done yet.

Moving prio to "Normal" since I can start enabling hosts with python3.9 support but not all of them.

Actions #7

Updated by jlausuch almost 3 years ago

We need to have gcc installed on the system to run the tests:
https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/13256

Actions #8

Updated by jlausuch almost 3 years ago

bci-test repo now supports python3.6: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/13306

This way we can start enabling it on other hosts.

But there is another problem if the HOST is registered against SCC.
The tests expect 1 repository but if the host is registered, container-suseconnect-zypp plugin will take the repos from the host and they will be available in the container.

[gw0] linux -- Python 3.6.13 /root/bci-tests/.tox/build/bin/python

container = ContainerData(image_url_or_id='c2afd431388b12b7005b5d42bf22dad4df73949f26846cd429c0e6fa82c4ae88', container_id='c133c6...fca9ca82d', connection=<testinfra.host.Host podman://c133c60b07cb8206a6f96a44e5666a25874ad9806242b9b3efc6cdcfca9ca82d>)

    @pytest.mark.parametrize(
        "container",
        [
            cont
            for cont in ALL_CONTAINERS
            if cont not in (MINIMAL_CONTAINER, MICRO_CONTAINER)
        ],
        indirect=["container"],
    )
    def test_container_build_and_repo(container):
        repos = etree.fromstring(
            container.connection.run_expect([0], "zypper -x repos -u").stdout
        )

        repos_list = repos.xpath("//repo-list")
        assert len(repos_list) == 1
>       assert len(repos_list[0].getchildren()) == 1
E       assert 16 == 1
E         +16
E         -1
Actions #9

Updated by jlausuch almost 3 years ago

New PR that fixes some problems in s390x and ppc https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/13345

Actions #10

Updated by ilausuch over 2 years ago

The PR was merged. I understand this ticket is still open. Any new progress?

Actions #11

Updated by jlausuch over 2 years ago

There are more host to be added (e.g. Leap, Tw, Ubuntu, CentOS)...
I am slowly working on this but I want to wait until current tests are more stable.
Let's keep it "in progress" with normal priority.

Actions #12

Updated by jlausuch over 2 years ago

  • Status changed from In Progress to Workable
  • Assignee deleted (jlausuch)

Unassigned from this for now. Might pick it up later on.

Actions #13

Updated by jlausuch over 2 years ago

  • Status changed from Workable to In Progress
  • Assignee set to jlausuch

I am now working on enabling BCI in Ubuntu and CentOS.

Actions #14

Updated by jlausuch over 2 years ago

https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/13757

After updating the Ubuntu and CentOS images with higher disk size, the tests can now run on those OS.
I created this guides to proper reproduce the images when needed.
https://confluence.suse.com/display/qasle/Ubuntu+image
https://confluence.suse.com/display/qasle/CentOS+image

Actions #15

Updated by jlausuch over 2 years ago

  • Checklist item Ubuntu 20.04 added
  • Checklist item CentOS 8 added
  • Checklist item RHEL 7 (RES) added
  • Checklist item RHEL 8 (RES) added
  • Checklist item openSUSE Leap 15.2 added
  • Checklist item openSUSE Leap 15.3 added
Actions #16

Updated by jlausuch over 2 years ago

  • Checklist item Ubuntu 20.04 set to Not done
  • Checklist item CentOS 8 set to Not done
Actions #17

Updated by jlausuch over 2 years ago

  • Checklist item Ubuntu 20.04 set to Done
  • Checklist item CentOS 8 set to Done
Actions #18

Updated by jlausuch over 2 years ago

  • Parent task set to #103323
Actions #19

Updated by ilausuch over 2 years ago

Still working on this ticket

Actions #20

Updated by jlausuch over 2 years ago

  • Status changed from In Progress to Workable

Moving to workable. Will work on Leap after Xmas break.

Actions #21

Updated by jlausuch over 2 years ago

  • Assignee deleted (jlausuch)
  • Priority changed from Normal to Low
Actions #22

Updated by jlausuch over 2 years ago

  • Priority changed from Low to Normal
Actions #23

Updated by mloviska about 2 years ago

  • Status changed from Workable to In Progress
  • Assignee set to mloviska
Actions #25

Updated by mloviska about 2 years ago

  • Status changed from In Progress to Feedback
Actions

Also available in: Atom PDF