Project

General

Profile

Actions

action #68314

open

[qe-core][functional] Move setting YAML_SCHEDULE from QSF-U job group schedule to openQA test suite definition

Added by SLindoMansilla over 3 years ago. Updated over 1 year ago.

Status:
Feedback
Priority:
Normal
Assignee:
Category:
Enhancement to existing tests
Target version:
SUSE QA - Milestone 31
Start date:
2020-06-26
Due date:
% Done:

100%

Estimated time:
42.00 h (Total: 84.00 h)
Difficulty:

Description

To see remaining YAML_SCHEDULE execute:

user@host:~/gitlab/QSF-U_qa-sle-functional-userspace$ grep -n -C3 YAML_SCHEDULE functional_sle15_jobgroup.yaml

Acceptance criteria

  • AC1: Test suites extra_tests_* are synced between openqa.opensuse.org and openqa.suse.de
  • AC2: Test suite extra_tests_* have setting YAML_SCHEDULE= in openQA definition and not in job group YAML schedule.

Subtasks 1 (0 open1 closed)

action #68467: [sle][functional][u] set YAML_SCHEDULE= in openQA definition for extra_tests_* and remove it from job group YAML scheduleResolvedzluo2020-06-26

Actions

Related issues 1 (0 open1 closed)

Related to openQA Tests - action #57290: [qe-core][functional] Move module specific test modules from extra_tests_* scenarios to its respective scenarioResolvedSLindoMansilla2019-09-19

Actions
Actions #2

Updated by zluo over 3 years ago

  • Category set to Enhancement to existing tests
  • Status changed from New to In Progress
  • Assignee set to zluo
  • Target version set to Milestone 31
  • Estimated time set to 42.00 h

take over and focus on AC2 for now.

Actions #3

Updated by zluo over 3 years ago

  • Due date set to 2020-06-26
  • Start date changed from 2020-06-22 to 2020-06-26

Grund: Änderung an zugehörigem Ticket: #68467

Actions #4

Updated by zluo over 3 years ago

AC1:

check at first list of modules between sles and tubleweed

schedule/functianal/extra_tests_gnome.yaml

sles
schedule:
    - '{{bootloader}}'
    - boot/boot_to_desktop
    - console/prepare_test_data
    - console/consoletest_setup
    - x11/vnc_two_passwords
    - '{{user_defined_snapshot}}'
    - x11/remote_desktop/vino_screensharing_available
    - x11/rrdtool_x11
    - x11/yast2_lan_restart
    - '{{keyboard_layout_gdm}}'
    - console/yast2_lan_device_settings
    - console/check_default_network_manager
    - console/coredump_collect

tw
   - boot/boot_to_desktop
   - console/system_prepare
   - console/prepare_test_data
   - console/consoletest_setup
   - x11/x11_setup
   - x11/exiv2
   - x11/vnc_two_passwords
   - x11/seahorse
   - x11/steam
   - x11/chrome
   - x11/multi_users_dm
   - x11/keyboard_layout_gdm
   - x11/wine
   - x11/gnucash
   - remote_desktop/vino_screensharing_available
   - x11/libqt5_qtbase
   - x11/rrdtool_x11
   - x11/yast2_lan_restart
   - x11/network/hwsim_wpa2_enterprise_setup
   - x11/network/yast2_network_use_nm
   - x11/network/NM_wpa2_enterprise
   - console/yast2_lan_device_settings
   - texlive/latexdiff
   - appgeo/qgis

Actions #5

Updated by zluo over 3 years ago

schedule/functional/extra_test_textmode.yaml

sles
schedule:
    - '{{bootloader}}'
    - boot/boot_to_desktop
    - console/prepare_test_data
    - console/consoletest_setup
    - console/orphaned_packages_check
    - console/zypper_lr_validate
    - console/zypper_ref
    - console/zypper_info
    - console/validate_packages_and_patterns
    - console/zypper_extend
    - console/check_os_release
    - console/openvswitch
    - console/pam
    - console/sshd
    - console/update_alternatives
    - console/rpm
    - console/slp
    - console/command_not_found
    - console/openssl_alpn
    - console/autoyast_removed
    - console/cron
    - console/syslog
    - console/mta
    - console/vsftpd
    - '{{yast2_lan_device_settings}}'
    - console/check_default_network_manager
    - console/git
    - console/cups
    - console/java
    - console/sqlite3
    - console/sysctl
    - console/sysstat
    - console/curl_ipv6
    - console/wget_ipv6
    - console/ca_certificates_mozilla
    - console/unzip
    - console/gpg
    - console/rsync
    - console/clamav
    - console/shells
    - console/sudo
    - console/dstat
    - x11/evolution/evolution_prepare_servers
    - console/mutt
    - console/supportutils
    - console/mdadm
    - console/journalctl
    - console/quota
    - console/vhostmd
    - console/rpcbind
    - console/timezone
    - console/procps
    - '{{lshw}}'
    - console/kmod
    - console/suse_module_tools
    - console/zziplib
    - console/firewalld
    - console/aaa_base
    - console/osinfo_db
    - console/zypper_ref
    - console/coredump_collect

tw

    - boot/boot_to_desktop
    - console/system_prepare
    - console/prepare_test_data
    - console/consoletest_setup
    - update/zypper_clear_repos
    - console/zypper_ar
    - console/zypper_ref
    - console/zypper_lr_validate
    - console/zypper_ref
    - console/zypper_info
    - console/zypper_extend
    - console/check_os_release
    - console/orphaned_packages_check
    - tests/console/openvswitch
    - console/pam
    - console/sshd
    - console/update_alternatives
    - console/rpm
    - console/slp
    - console/aplay
    - console/soundtouch
    - console/wavpack
    - console/libvorbis
    - console/command_not_found
    - console/cron
    - console/syslog
    - console/ntp_client
    - console/mta
    - console/check_default_network_manager
    - console/git
    - console/cups
    - console/java
    - console/sqlite3
    - console/gdb
    - console/sysctl
    - console/sysstat
    - console/curl_ipv6
    - console/wget_ipv6
    - console/ca_certificates_mozilla
    - console/unzip
    - console/salt
    - console/machinery
    - console/gpg
    - console/rsync
    - console/clamav
    - console/shells
    - console/sudo
    - console/dstat
    - x11/evolution/evolution_prepare_servers
    - console/mutt
    - console/mdadm
    - console/journalctl
    - console/quota
    - console/vhostmd
    - console/rpcbind
    - sysauth/sssd
    - console/timezone
    - console/procps
    - console/lshw
    - console/kmod
    - console/suse_module_tools
    - console/firewalld
    - console/aaa_base
    - console/libgpiod
    - console/libgcrypt
    - console/gd
    - console/valgrind
    - console/sssd_samba
    - console/wpa_supplicant
    - appgeo/gdal
    - console/rabbitmq
    - console/rails
    - console/oneclick_install
    - console/pcre
    - console/openqa_review
    - console/zbar
    - console/a2ps
    - console/znc
    - console/weechat
    - console/nano
    - console/steamcmd
    - console/libqca2
    - console/kdump_and_crash
Actions #6

Updated by zluo over 3 years ago

sles
extra_tests_textmode_mod_desktop.yaml

schedule:
    - '{{bootloader}}'
    - boot/boot_to_desktop
    - console/prepare_test_data
    - console/consoletest_setup
    - '{{tests_requiring_soundcard}}' -> aplay, wavpack
    - console/libvorbis

TW
covered in extra_tests_in_textmode

Actions #7

Updated by zluo over 3 years ago

sles
extra_test_gnome_sdk.yaml

schedule:
    - '{{bootloader}}'
    - boot/boot_to_desktop
    - console/prepare_test_data
    - console/consoletest_setup
    - x11/libqt5_qtbase
    - console/coredump_collect

TW
libqt5_qtbase is covered in extra_tests_on_gnome
coredump_collect is covered in extra_tests_textmode_containers

Actions #8

Updated by zluo over 3 years ago

sles
extra_tests_in_textmode_phub.yaml

schedule:
    - '{{bootloader}}'
    - boot/boot_to_desktop
    - console/machinery
    - sysauth/sssd
    - console/coredump_collect

TW

machinery is covered in extra_tests_textmode and jeos-extra@64_virtio-2G
sssd is covered in extra_tests_textmode
coredump_collect is covered in extra_tests_textmode_containers

--
coredump_collect appears already in extra_tests_textmode_sdk.yaml, it can be removed.

Actions #9

Updated by zluo over 3 years ago

opensuse TW:
list of extra_test*:

  • extra_tests_ai_ml (tflite2)
  • extra_tests_dracut
  • extra_tests_filesystem
  • extra_tests_in_textmode
  • extra_tests_on_gnome
  • extra_tests_on_kde (chrome, multi_users_dm, wine, gnucash, libqt5_qtbase)
  • extra_tests_on_xfce (chrome, multi_users_dm, wine)
  • extra_tests_rstudio (rstudio_prepare, rstudio_desktop, rstudio_server)
  • extra_tests_textmode_containers
  • extra_tests_vagrant (add_box_virtualbox,add_box_libvirt,sshfs,tumbleweed,)
Actions #10

Updated by szarate over 3 years ago

  • Status changed from In Progress to Feedback
  • Assignee changed from zluo to szarate

Confirm if QAM is using YAML_SCHEDULE on o3

Step by step

  1. Figure out what are all the possible combinations of sub extra_tests_$var EXTRATEST=sssd,pkcon,$thing
  2. Create separated extra schedules for those "extra_tests_$thing" that were found
  3. Move these test suites to the development job group
  4. Sync extra_tests_$thing with SLE extra_tests_*_*
  5. Propose a reduced set of extra_tests_console
  6. Once every body agrees, introduce them to the main job group for TW and Leap
Actions #11

Updated by tjyrinki_suse over 3 years ago

  • Subject changed from [functional][u] Move setting YAML_SCHEDULE from QSF-U job group schedule to openQA test suite definition to [qe-core][functional] Move setting YAML_SCHEDULE from QSF-U job group schedule to openQA test suite definition
Actions #12

Updated by SLindoMansilla almost 3 years ago

  • Parent task deleted (#57290)
Actions #13

Updated by SLindoMansilla almost 3 years ago

  • Related to action #57290: [qe-core][functional] Move module specific test modules from extra_tests_* scenarios to its respective scenario added
Actions #14

Updated by slo-gin over 1 year ago

This ticket was set to Normal priority but was not updated within the SLO period. Please consider picking up this ticket or just set the ticket to the next lower priority.

Actions

Also available in: Atom PDF