action #138302
closed
Ensure automated openQA tests verify that os-autoinst-setup-multi-machine sets up valid networking size:M
Added by livdywan 7 months ago.
Updated 4 months ago.
Category:
Feature requests
Description
Motivation¶
Thanks to #133025 we cover os-autoinst-setup-multi-machine in openQA tests. However currently those tests never verify the setup and would at best catch more trivial issues with running the script.
Acceptance criteria¶
- AC1: Broken networking prepared by os-autoinst-setup-multi-machine is visible as a failed openQA test job
Suggestions¶
- Copied from action #133025: Configure Virtual Interfaces instructions do not work on Leap 15.5 size:M added
Followup on #133025
As of now the openQA-in-openQA test calls the os-autoinst-setup-multi-machine script,
but only checks that it runs through without failure.
Still afterwards only a single test is executed.
The testsuite should be extended to run a real multi machine job to verify that the
setup created by the script works.
- Due date deleted (
2023-10-31)
- Subject changed from Ensure automated openQA tests verify that os-autoinst-setup-multi-machine sets up valid networking size:M to Ensure automated openQA tests verify that os-autoinst-setup-multi-machine sets up valid networking
- Target version changed from Ready to Tools - Next
- Target version changed from Tools - Next to Ready
- Subject changed from Ensure automated openQA tests verify that os-autoinst-setup-multi-machine sets up valid networking to Ensure automated openQA tests verify that os-autoinst-setup-multi-machine sets up valid networking size:M
- Description updated (diff)
- Status changed from New to Workable
- Status changed from Workable to In Progress
- Assignee set to dheidler
- Due date set to 2023-12-16
Setting due date based on mean cycle time of SUSE QE Tools
- Due date deleted (
2023-12-16)
- Status changed from In Progress to Workable
actually wasn't started yet
- Status changed from Workable to In Progress
- Due date set to 2024-01-04
Setting due date based on mean cycle time of SUSE QE Tools
- Related to action #152098: [research][timeboxed:10h] Learn more about openvswitch with experimenting together size:S added
- Due date changed from 2024-01-04 to 2024-01-11
As you uncover multiple issues you found I suggest you focus on just getting a test running even with ugly workarounds. Fixing each and every issue can be delayed to other follow-up issues.
I suspect that the remaining issue is due to insufficient ram to start two nested VMs at the same time.
- Due date changed from 2024-01-11 to 2024-01-19
As discussed we decided it's ok to go ahead with bumped due date.
- Blocked by action #153616: Prevent `duplicate key value violates unique constraint` on image uploads size:S added
- Status changed from In Progress to Blocked
For clarity, the related ticket is being worked on now as it makes this test unreliable.
- Status changed from Blocked to Feedback
- Status changed from Feedback to In Progress
As discussed handle the test instability either by fixing or reporting in a corresponding ticket.
- Related to action #153766: [core][sporadic] Handle wild agetty better in tests/network/setup_multimachine.pm added
- Status changed from In Progress to Resolved
- Related to action #155170: [openqa-in-openqa] [sporadic] test fails in test_running: parallel_failed size:M added
- Related to action #155173: [openqa-in-openqa] [sporadic] test fails in openqa_worker: os-autoinst-setup-multi-machine timed out size:M added
Also available in: Atom
PDF