QA (public) » openQA Project (public) » openQA Tests (public) » qe-yam

The testuistes names may have been changed, in order to resolve the new names, please check the MR submitted within this ticket:
https://progress.opensuse.org/issues/152083

Looking inside the repository it seems that these testsuites are no longer present.
@zoecao Could you please add some updates? Have they changed in the meantime?

lmanfredi wrote in #note-8:

Looking inside the repository it seems that these testsuites are no longer present.
@zoecao Could you please add some updates? Have they changed in the meantime?

as discussed, you just need to pick the MR which rename them.

by searching in Git log which commits are involved:

git log --oneline -G'- offline_sles15sp3_rmt_basesys-srv-ltss-desk-nvidia_def_full:'
git log --oneline -G'- offline_sles15sp3_rmt_basesys-srv-ltss-desk_def_full:'
git log --oneline -G'- online_sles15sp3_smt_basesys-srv-ltss_all_full_zypp:'
git log --oneline -G'- online_sles15sp3_smt_basesys-srv-ltss_def_full_y_pre:'
git log --oneline -G'- online_sles15sp3_smt_basesys-srv-ltss_def_full_y:'
git log --oneline -G'- online_sles15sp3_rmt_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full_y:'
git log --oneline -G'- online_sles15sp3_smt_basesys-srv-ltss-desk-dev_all_full_y:'

the commits are:

52fbc82 Unify migration test suites names for sles15sp3
8ef79fe Add migration_milestone job group

Searching the diff by:

git diff 8ef79fe 52fbc82 | grep -A1 "\- offline_sles15sp3_rmt_basesys-srv-ltss-desk-nvidia_def_full:"
git diff 8ef79fe 52fbc82 | grep -A1 "\- offline_sles15sp3_rmt_basesys-srv-ltss-desk_def_full:"
git diff 8ef79fe 52fbc82 | grep -A1 "\- online_sles15sp3_smt_basesys-srv-ltss_all_full_zypp:"
git diff 8ef79fe 52fbc82 | grep -A1 "\- online_sles15sp3_smt_basesys-srv-ltss_def_full_y_pre:"
git diff 8ef79fe 52fbc82 | grep -A1 "\- online_sles15sp3_smt_basesys-srv-ltss_def_full_y:"
git diff 8ef79fe 52fbc82 | grep -A1 "\- online_sles15sp3_rmt_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full_y:"
git diff 8ef79fe 52fbc82 | grep -A1 "\- online_sles15sp3_smt_basesys-srv-ltss-desk-dev_all_full_y:"

the rename are:

-    - offline_sles15sp3_rmt_basesys-srv-ltss-desk-nvidia_def_full:
+    - migr_sles15sp3_desk-phub:

-    - online_sles15sp3_smt_basesys-srv-ltss_all_full_zypp:
+    - migr_sles15sp3_all:

-    - online_sles15sp3_smt_basesys-srv-ltss_def_full_y_pre:
+    - migr_sles15sp3_pre:

-    - online_sles15sp3_smt_basesys-srv-ltss_def_full_y:
+    - migr_sles15sp3:

-    - online_sles15sp3_rmt_basesys-srv-lp-ltss-contm-lgm-tsm-pcm-wsm_all_full_y:
+    - migr_sles15sp3_lp-contm-lgm-tsm-pcm-wsm_all:

-    - offline_sles15sp3_rmt_basesys-srv-ltss-desk_def_full:
+    - migr_sles15sp3_desk:
--
-    - offline_sles15sp3_rmt_basesys-srv-ltss-desk_def_full:
+    - migr_sles15sp3_desk:

-    - online_sles15sp3_smt_basesys-srv-ltss-desk-dev_all_full_y:
+    - migr_sles15sp3_desk-dev_all:

So, renamed as:

Again, searching in Git log which commits are involved for the new names:

git log --oneline -G'- migr_sles15sp3_desk-phub:'
git log --oneline -G'- migr_sles15sp3_all:'
git log --oneline -G'- migr_sles15sp3_pre:'
git log --oneline -G'- migr_sles15sp3:'
git log --oneline -G'- migr_sles15sp3_lp-contm-lgm-tsm-pcm-wsm_all:'
git log --oneline -G'- migr_sles15sp3_desk:'
git log --oneline -G'- migr_sles15sp3_desk-dev_all:'

the commits are:

# - migr_sles15sp3_desk-phub:
5e77551 Unify the test suite name to change addon from SCC_ADDONS
52fbc82 Unify migration test suites names for sles15sp3

# - migr_sles15sp3_all:
52fbc82 Unify migration test suites names for sles15sp3

# - migr_sles15sp3_pre:
52fbc82 Unify migration test suites names for sles15sp3

# - migr_sles15sp3:
52fbc82 Unify migration test suites names for sles15sp3

# - migr_sles15sp3_lp-contm-lgm-tsm-pcm-wsm_all:
5e77551 Unify the test suite name to change addon from SCC_ADDONS
52fbc82 Unify migration test suites names for sles15sp3

# - migr_sles15sp3_desk:
5e77551 Unify the test suite name to change addon from SCC_ADDONS
52fbc82 Unify migration test suites names for sles15sp3

# - migr_sles15sp3_desk-dev_all:
5e77551 Unify the test suite name to change addon from SCC_ADDONS
52fbc82 Unify migration test suites names for sles15sp3

so, four of them are again changed:

Then, searching the diff by:

git diff 52fbc82 5e77551  JobGroups/migration_milestone/aarch64.yaml  | grep -A1 '\- migr_sles15sp3_desk-phub:' 
git diff 52fbc82 5e77551  JobGroups/migration_milestone/aarch64.yaml  | grep -A1 '\- migr_sles15sp3_all:' 
git diff 52fbc82 5e77551  JobGroups/migration_milestone/ppc64le.yaml  | grep -A1 '\- migr_sles15sp3_pre:' 
git diff 52fbc82 5e77551  JobGroups/migration_milestone/ppc64le.yaml  | grep -A1 '\- migr_sles15sp3:' 
git diff 52fbc82 5e77551  JobGroups/migration_milestone/s390x.yaml    | grep -A1 '\- migr_sles15sp3_lp-contm-lgm-tsm-pcm-wsm_all:' 
git diff 52fbc82 5e77551  JobGroups/migration_milestone/s390x.yaml    | grep -A1 '\- migr_sles15sp3_desk:' 
git diff 52fbc82 5e77551  JobGroups/migration_milestone/x86_64.yaml   | grep -A1 '\- migr_sles15sp3_desk-dev_all:'

the rename are:

# - migr_sles15sp3_desk-phub:
-    - migr_sles15sp3_desk-phub:
+    - migr_sles15sp3_desktop-phub:

# - migr_sles15sp3_all:

# - migr_sles15sp3_pre:

# - migr_sles15sp3:

# - migr_sles15sp3_lp-contm-lgm-tsm-pcm-wsm_all:
-    - migr_sles15sp3_lp-contm-lgm-tsm-pcm-wsm_all:
+    - migr_sles15sp3_live-contm-lgm-tsm-pcm-wsm_all:

# - migr_sles15sp3_desk:
-    - migr_sles15sp3_desk:
+    - migr_sles15sp3_desktop:

# - migr_sles15sp3_desk-dev_all:
-    - migr_sles15sp3_desk-dev_all:
+    - migr_sles15sp3_desktop-dev_all:

Final renames of testsuites in JobGroups/migration_milestone/$ARCH.yaml are:

Created MR#155

lmanfredi wrote in #note-13:

Created MR#155

Good job finding out! let's set the MR in wip and not merge it until we have the new test cases developed, otherwise we would lost test coverage.

About

[AC2:] Add the following new testsuites for milestone group:

• online_sles15sp3_smt_basesys-srv-desk_dev_all_full_y (aarch64) (gnome)
• online_sles15sp3_scc_basesys-srv-desk-nvidia_def_full_zypp (x86_64) (gnome)

a proposal for the new test cases, following the new name conventions:

# JobGroups/migration_milestone/aarch64.yaml
aarch64:
  sle-15-SP6-Migration-from-SLE15-SPx-Milestone-aarch64:
    - migr_sles15sp3_desktop_smt:
        description: online migration smt yast
        settings:
          <<: *gnome_and_qemuram
          BOOTFROM: d
          BOOT_HDD_IMAGE: '1'
          FULL_UPDATE: '1'
          HDDVERSION: 15-SP3
          HDD_1: 'autoyast-SLES-%HDDVERSION%-%ARCH%-%DESKTOP%-updated.qcow2'
          MIGRATION_METHOD: 'yast'
          ONLINE_MIGRATION: '1'
          PATCH: '1'
          SCC_ADDONS: base,serverapp,desktop,ltss
          SCC_URL: 'none'
          SMT_URL: **********
          UPGRADE: '1'
        testsuite: null

# JobGroups/migration_milestone/x86_64.yaml
x86_64:
  sle-15-SP6-Migration-from-SLE15-SPx-Milestone-x86_64:
    - migr_sles15sp3_desktop_scc:
        description: online migration scc zypper
        settings:
          <<: *gnome_and_qemuram
          BOOTFROM: d
          BOOT_HDD_IMAGE: '1'
          FULL_UPDATE: '1'
          HDDVERSION: 15-SP3
          HDD_1: SLES-%HDDVERSION%-%ARCH%-GM-ltss-desktop-nvidia-%DESKTOP%-updated.qcow2
          MIGRATION_METHOD: 'zypper'
          ONLINE_MIGRATION: '1'
          PATCH: '1'
          SCC_ADDONS: base,serverapp,desktop,nvidia,ltss
          SCC_REGCODE_LTSS: **********
          UPGRADE: '1'
        testsuite: null

@JERiveraMoya, @zoecao what do you think about?

wrong place to comment code, it is easier in gitlab for review, comments, suggestions, compare with other test suites, and of course, run verification if the settings makes sense or not.

Added new test suites in MR#155

Added VRs in dev job group

The VRs fails for smt test case in test module yast2_migration.
The same test works when use scc end set SMT_URL="".
I guess that the problem could be related with the smt server. See slack comments:

Maybe SMT server need update the repos

By using the RMT server, it works fine. See VRs
According with the doc, I will change the name, using rmt instead of smt for test case

VRs passed

Merged MR#155

Verified in production on Build 82.1