action #115487
closedcoordination #121876: [epic] Handle openQA review failures in Yam squad - SLE 15 SP5
Unschedule from test suites in Migration - Regression job group all test modules unrelated with migration
Description
Motivation¶
After the migration takes places, there are plenty of test modules schedules unrelated with migration.
Other modules like migration/openldap_to_389ds
or console/orphaned_packages_check
or basic checks of the migrated system should remain there.
But test java or curl or libc, according to history of test runs there is no justification to do it, if it would worth it because we would encounter some bug we could consider to communicate other QE squad to take over for the this userspace tools.
Need update all of yaml regression files:
sle/schedule/migration # ls regression
aarch64_regression_test_offline.yaml ppc64le_regression_test_offline.yaml s390x_regression_test_offline.yaml x86_regression_test_offline.yaml
aarch64_regression_test_online.yaml ppc64le_regression_test_online.yaml s390x_regression_test_online.yaml x86_regression_test_online.yaml
Scope¶
Include all migration path in regression job group
Acceptance criteria¶
AC1: Update all the schedules mentioned above according to the motivation
Updated by JERiveraMoya about 2 years ago
- Subject changed from Need updated all migration regression yaml files to un-schedule regression testing except the orphan check to Unschedule from test suites in Migration - Regression job group all test modules unrelated with migration
- Description updated (diff)
- Target version set to Current
Updated by JERiveraMoya about 2 years ago
- Tags deleted (
qe-yast-refinement) - Status changed from New to Workable
Updated by zoecao about 2 years ago
- Status changed from Workable to In Progress
- Assignee set to zoecao
Updated by zoecao about 2 years ago
I have updated the yaml files and run the VR:
branch: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/15494
vr:
https://openqa.suse.de/tests/9508144#
https://openqa.suse.de/tests/9507861#details
Updated by zoecao about 2 years ago
Update the pr and run some VR on s390x, ppc64le and aarch64:
https://openqa.suse.de/tests/9537017
https://openqa.suse.de/tests/9537018#
https://openqa.suse.de/tests/9537019#
Updated by zoecao about 2 years ago
MR is created for this ticket:
https://gitlab.suse.de/coolgw/wegao-test/-/merge_requests/139
Updated by JERiveraMoya about 2 years ago
would be ok for you to add to this ticket tweaking of INCLUDE_SERVICES=kdump,yast2-nfs-server,users
? as this is also controlled by setting.
https://openqa.suse.de/tests/9564945#step/install_service/55
Otherwise we can handle separately.
Updated by zoecao about 2 years ago
JERiveraMoya wrote:
would be ok for you to add to this ticket tweaking of
INCLUDE_SERVICES=kdump,yast2-nfs-server,users
? as this is also controlled by setting.
https://openqa.suse.de/tests/9564945#step/install_service/55
Otherwise we can handle separately.
Yes, it's fine for me to add it, just one question here: do you mean add INCLUDE_SERVICES=kdump,yast2-nfs-server,users
for all regression cases? For service check, there are three settings: INCLUDE_SERVICES=kdump,yast2-nfs-server,users (only test these three services); EXCLUDE_SERVICES=kdump,yast2-nfs-server,users (test other services except these three, example [case]); REGRESSION_SERVICE='0' (it is for media cases only, the upgraded system is not registered, no need to check services)
Updated by zoecao about 2 years ago
- Status changed from In Progress to Resolved
Confirmed with Tina, the service checking issue will be traced on a new ticket. So close here.
Updated by zoecao about 2 years ago
- Status changed from Resolved to In Progress
Reopen it to reset the setting of service check.
Updated by zoecao about 2 years ago
This is the full services list:
sshd, docker, users, susefirewall, firewall, ntp, chrony, postfix, apache, dhcpd, bind, snmp, nfs, nodejs, rpcbind, autofs, cups, radvd, cron, apparmor, vsftp, kdump, libvirtd
Updated by zoecao about 2 years ago
Submit MR to reset the service check for migration regression cases:
https://gitlab.suse.de/coolgw/wegao-test/-/merge_requests/162
Updated by JERiveraMoya about 2 years ago
The goal is to make this test suite stable and still checking some services. Your list seems reasonable.
Could we please reflect what we include and what we don't include in the spreadsheet?, just to not forget.
Updated by zoecao about 2 years ago
JERiveraMoya wrote:
The goal is to make this test suite stable and still checking some services. Your list seems reasonable.
Could we please reflect what we include and what we don't include in the spreadsheet?, just to not forget.
Yes, do you mean reflect it in the migration matrix spreadsheet?
Updated by JERiveraMoya about 2 years ago
- Status changed from In Progress to Resolved
Updated by zoecao about 2 years ago
Done with updating the matrix spreadsheet, for regression test modules and service list.