Project

General

Profile

action #91184

coordination #91139: [qe-core][epic] add QEM exclusive tests to product QE runs to increase coverage

[qe-core] Add existing network QEM tests to Product QE

Added by tjyrinki_suse 5 months ago. Updated 18 days ago.

Status:
Rejected
Priority:
Normal
Assignee:
zluo
Category:
New test
Target version:
QA - QE-Core: Ready
Start date:
2021-05-05
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Difficulty:

Description

After comparing test coverage of SLE 15 SP2 and SP3 in opneQA I identified several tests that are exclusive to either pre-release or post-release testing and could be easily used to increase our coverage just by using what we already have.

It is possible that are some errors and some of the tests from the list are already being used. It is also just my opinion, therefor review from other colleagues is more then welcome.

These are the tests that run only after release and could be used also before the release (QEM -> product QE)

tests/network/autofs_client.pm & tests/network/autofs_server.pm
tests/network/salt_master.pm
tests/network/salt_minion.pm
tests/network/samba/samba_adcli.pm

Subtasks

action #92158: [qe-core] Add autofs_client and autofs_server to Product QEResolvedzluo

action #93330: [qe-core] Add salt-server and salt-minion to Product QE (functional)Resolvedzluo

History

#1 Updated by tjyrinki_suse 5 months ago

  • Tracker changed from coordination to action

#2 Updated by tjyrinki_suse 5 months ago

  • Description updated (diff)

#3 Updated by tjyrinki_suse 5 months ago

  • Category set to New test
  • Status changed from New to Workable

#4 Updated by zluo 5 months ago

  • Assignee set to zluo

take over and check.

#5 Updated by zluo 5 months ago

these tests are multi machine testing, and they should be separated like autofs_client, autofs_server etc.
Let us talk about these offline before start to do something.

#6 Updated by zluo 5 months ago

@timo can you please provide the related tests on OSD? I cannot find them and I need to check the settings, thanks!

#7 Updated by tjyrinki_suse 5 months ago

autofs: mau-autofs-client & mau-autofs-server
salt: qam-salt-master & qam-salt-minion
(samba-ad: ignore, it's being added in another ticket)

From:
https://openqa.suse.de/tests/overview?distri=sle&version=15-SP2&build=20210507-1&groupid=308

The two multi-machine tests could be handled in separate tickets if wanted.

mau-autofs-client

AUTOFS=1
BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDD_1=SLES-%VERSION%-%ARCH%-mru-install-minimal-with-addons-Build%BUILD%-%FLAVOR%-%MACHINE%.qcow2
HOSTNAME=client
NICTYPE=tap
PARALLEL_WITH=mau-autofs-server
QEMU_DISABLE_SNAPSHOTS=1
SCC_ADDONS=%MRU_ADDONS%,%REQUIRED_ADDON%
START_AFTER_TEST=mru-install-minimal-with-addons
WORKER_CLASS=tap

mau-autofs-server
AUTOFS=1
BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDD_1=SLES-%VERSION%-%ARCH%-mru-install-minimal-with-addons-Build%BUILD%-%FLAVOR%-%MACHINE%.qcow2
HOSTNAME=server
NICTYPE=tap
QEMU_DISABLE_SNAPSHOTS=1
SCC_ADDONS=%MRU_ADDONS%,%REQUIRED_ADDON%
START_AFTER_TEST=mru-install-minimal-with-addons
WORKER_CLASS=tap

qam-salt-master
BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDD_1=SLES-%VERSION%-%ARCH%-mru-install-minimal-with-addons-Build%BUILD%-%FLAVOR%-%MACHINE%.qcow2
HOSTNAME=master
MAX_JOB_TIME=14400
NICTYPE=tap
QAM_SALT=1
QEMU_DISABLE_SNAPSHOTS=1
SCC_ADDONS=%MRU_ADDONS%,%REQUIRED_ADDON%
START_AFTER_TEST=mru-install-minimal-with-addons
WORKER_CLASS=tap

qam-salt-minion
BOOT_HDD_IMAGE=1
DESKTOP=textmode
HDD_1=SLES-%VERSION%-%ARCH%-mru-install-minimal-with-addons-Build%BUILD%-%FLAVOR%-%MACHINE%.qcow2
HOSTNAME=minion
MAX_JOB_TIME=14400
NICTYPE=tap
PARALLEL_WITH=qam-salt-master
QAM_SALT=1
QEMU_DISABLE_SNAPSHOTS=1
SCC_ADDONS=%MRU_ADDONS%,%REQUIRED_ADDON%
START_AFTER_TEST=mru-install-minimal-with-addons
WORKER_CLASS=tap

#8 Updated by zluo 4 months ago

  • Assignee deleted (zluo)

un-assign myself since separate tickets has been created.

#9 Updated by zluo 4 months ago

I create sub ticket for salt MM tests, so only samba/samba_adcli.pm is remained for now.

#10 Updated by tjyrinki_suse 3 months ago

  • Status changed from Workable to In Progress
  • Assignee set to zluo

#11 Updated by zluo 3 months ago

https://progress.opensuse.org/issues/72169 covers now the part of samba, so no need to work it for now because it should be reworked.

#12 Updated by zluo 20 days ago

  • Status changed from In Progress to Rejected

reject it now since samba part is to reworked as mentioned above.

#13 Updated by szarate 18 days ago

  • Target version set to QE-Core: Ready

Also available in: Atom PDF