Project

General

Profile

Actions

action #132842

closed

coordination #130216: [epic] Adapt migration test coverage and its migration matrix for SLE 15 SP6

Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3 - part 1

Added by leli about 1 year ago. Updated 10 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Target version:
Start date:
2023-10-23
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)

Description

Motivation

Following the new test matrix, we need add large-sized module combination test suites to Migration daily and milestone job group, or do the movement from Migration milestone job group to daily job group.

The test need to be added as below:
migration daily job group(https://openqa.nue.suse.com/group_overview/265)
offline:

  • offline_sles15sp3_pscc_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full@ppc64le (textmode)
  • offline_sles15sp3_pscc_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full@x86_64 (textmode)
  • offline_sles15sp3_media_basesys-srv-ltss-desk-dev_all_full@aarch64
  • offline_sles15sp3_media_basesys-srv-ltss-desk-python2_all_full@aarch64
  • offline_sles15sp3_pscc_basesys-srv-ltss-desk-dev_all_full@s390x-kvm

online:

  • online_sles15sp3_pscc_basesys-srv-ltss-desk-dev_all_full_y@ppc64le

Note: check the existing test suites to decide to add/modify test suites or move from milestone job group.

Acceptance criteria

AC1: Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3
AC2: The new test suites need to be triggered and file bug if new issue found.


Subtasks 1 (0 open1 closed)

action #138341: Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3 - part 2Resolvedsyrianidou_sofia2023-10-23

Actions
Actions #1

Updated by JERiveraMoya about 1 year ago

  • Status changed from New to Workable
  • Target version set to Current
  • Parent task set to #130216
Actions #2

Updated by leli about 1 year ago

  • Description updated (diff)
Actions #3

Updated by leli about 1 year ago

  • Description updated (diff)
Actions #4

Updated by leli about 1 year ago

  • Priority changed from Normal to High
Actions #5

Updated by leli 12 months ago

  • Description updated (diff)
Actions #6

Updated by leli 12 months ago

Updated this online_sles15sp3_pscc_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full_zypp@x86_64 (textmode) to online_sles15sp3_pscc_basesys-srv-ltss-contm-lgm-tsm-pcm-wsm_all_full_zypp@aarch64

Actions #7

Updated by leli 12 months ago

  • Description updated (diff)
Actions #8

Updated by JRivrain 12 months ago

  • Status changed from Workable to In Progress
  • Assignee set to JRivrain
Actions #9

Updated by JRivrain 12 months ago

  • Subject changed from Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3 to Optimize test coverage for large-sized module combination with all patterns from SLE 15 SP3 - part 1
  • Description updated (diff)
Actions #10

Updated by JRivrain 12 months ago

  • Description updated (diff)
Actions #12

Updated by JRivrain 12 months ago

  • Subtask #138341 added
Actions #13

Updated by JRivrain 12 months ago

I have difficulties with s390x:

  • problems with sle12 workers last week
  • qcow images are deleted each night, so I have to re-run the 2 parent jobs before doing any VR, after several hours.
  • still some failure that might be a bug, I don't know https://openqa.suse.de/tests/12682478#step/upgrade_select/5. I tried different qcows and variable combinations, it still happens.
Actions #14

Updated by leli 12 months ago

JRivrain wrote in #note-13:

I have difficulties with s390x:

  • problems with sle12 workers last week
  • qcow images are deleted each night, so I have to re-run the 2 parent jobs before doing any VR, after several hours. I will move these support images to fixed folder to avoid such unstable qcow generation issue.
  • still some failure that might be a bug, I don't know https://openqa.suse.de/tests/12682478#step/upgrade_select/5. I tried different qcows and variable combinations, it still happens. You have wrong setting for REPO_0, it should be 'SLE-15-SP6-Online-s390x-Build26.1-Media1' while not for 15SP3.
Actions #15

Updated by JRivrain 12 months ago

I excluded the s390x test from the MR so we can merge it. We will can add it after. I cannot figure out why this test fails in that way at the moment.

Actions #16

Updated by JRivrain 12 months ago

I re-added the s390 part, the issue seemed to be a bug in the build I was using. I managed to use the build 28.1 and manually work around the known issue for that build. In last VR, the test failed in reconnect_mgmt_console, but I think the MR is ready to merge.

Actions #17

Updated by JRivrain 11 months ago

s390 also passing now.

Actions #18

Updated by JRivrain 11 months ago

MR merged, waiting for next build.

Actions #19

Updated by JRivrain 11 months ago

  • Status changed from In Progress to Blocked

there has not been any build since last update, I'll unblock and resolve this when there's a build.

Actions #20

Updated by JRivrain 10 months ago

  • Status changed from Blocked to Resolved

All passed, thanks @leli for helping with that one.

Actions

Also available in: Atom PDF