coordination #52949: [qe-core][RPi3][epic] SLES on RaspberryPi - openQA Tests - openSUSE Project Management Tool

coordination #52949

[qe-core][RPi3][epic] SLES on RaspberryPi

Added by thehejik almost 3 years ago. Updated 5 months ago.

Status:

Resolved

Priority:

Normal

Assignee:

dheidler

Category:

New test

Target version:

SUSE QA - Milestone 31

Start date:

2020-09-07

Due date:

% Done:

100%

Estimated time:

42.00 h

Difficulty:

Description

Motivation¶

We introduced openQA tests for RPi3 (using general aarch64 QEMU workers) on SLE15-SP1 product which are using only textmode "initialization" process based on jeos-firstboot services (as other JeOSes does).

But now we started with SLE12-SP5 which is using original SLE12 method with X11 graphical yast2-firstboot service. And of course the JeOS tests are failing in openQA then, see https://openqa.suse.de/tests/2972221

So basically we would need to add support for JeOS openQA tests to be able test graphical as well as textmode image initialization methods for upcoming products like SLE12-SP5 and SLE15-SP2 and up.

There is a small chance we will switch all upcoming SLE12 images to use the textmode jeos-firstboot but it's still not clear so please stay tuned - afaerber said on 12.06.2019: I raised the topic for the PRD but am not aware of a clarification yet.

Until now tests were performed manually on milestone candidates following the instructions from https://bugzilla.suse.com/tr_show_plan.cgi?plan_id=6328

Acceptance criteria¶

AC1: Automatic testing for SLES on Raspberry Pi is covered for Tumbleweed and SLE15-SP3
AC2: Sub-Tasks are resolved

Further information¶

The disk image is generated reusing JeOS setup in OBS, so the behavior is similar: opensuse-Tumbleweed-JeOS-for-kvm-and-xen-x86_64-Build20200901-jeos@64bit_virtio
Tumbleweed on RPi: https://openqa.opensuse.org/tests/overview?distri=microos&distri=opensuse&version=Tumbleweed&build=20200825&groupid=3&flavor=JeOS-for-RPi
There was a previous attempt to automate testing for SLE: https://openqa.suse.de/tests/overview?arch=&machine=aarch64&modules=firstrun&groupid=162&distri=sle&build=4.131&version=12-SP5

Subtasks

Related issues

History

#1 Updated by thehejik almost 3 years ago

Subject changed from [y][JeOS][RPi3] Ability for testing graphical yast2-firstboot instead of jeos-firstboot (SLE15+) on RaspberryPi to [y][JeOS][RPi3] Ability for testing graphical yast2-firstboot together with textmode jeos-firstboot on RaspberryPi

#2 Updated by thehejik almost 3 years ago

Description updated (diff)
Category set to Enhancement to existing tests

#3 Updated by thehejik almost 3 years ago

Subject changed from [y][JeOS][RPi3] Ability for testing graphical yast2-firstboot together with textmode jeos-firstboot on RaspberryPi to [y][JeOS][RPi3] yast2-firstboot as well as jeos-firstboot on RaspberryPi

#4 Updated by okurz almost 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-filesystem-RPi
https://openqa.suse.de/tests/3021402

#5 Updated by okurz almost 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-extratest-RPi
https://openqa.suse.de/tests/3052202

#6 Updated by okurz almost 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-extratest-RPi
https://openqa.suse.de/tests/3166240

#7 Updated by okurz almost 3 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-extratest-RPi
https://openqa.suse.de/tests/3234254

#8 Updated by SLindoMansilla almost 3 years ago

Subject changed from [y][JeOS][RPi3] yast2-firstboot as well as jeos-firstboot on RaspberryPi to [functional][u][y][JeOS][RPi3] yast2-firstboot as well as jeos-firstboot on RaspberryPi
Priority changed from Normal to High

Since I am taking care of RPI for the moment, I will also take care of its openQA tests.
To be discussed in the grooming and prioritized by PO.

#9 Updated by riafarov almost 3 years ago

Subject changed from [functional][u][y][JeOS][RPi3] yast2-firstboot as well as jeos-firstboot on RaspberryPi to [functional][u][JeOS][RPi3] yast2-firstboot as well as jeos-firstboot on RaspberryPi

#10 Updated by okurz over 2 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-extratest-RPi
https://openqa.suse.de/tests/3340138

#11 Updated by okurz over 2 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-extratest-RPi
https://openqa.suse.de/tests/3400118

#12 Updated by okurz over 2 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-extratest-RPi
https://openqa.suse.de/tests/3452388

To prevent further reminder comments one of the following options should be followed:

The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
The openQA job group is moved to "Released"
The label in the openQA scenario is removed

#13 Updated by SLindoMansilla over 2 years ago

Description updated (diff)
Status changed from New to Workable
Priority changed from High to Normal
Target version set to Milestone 28
Estimated time set to 42.00 h

#14 Updated by okurz over 2 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-extratest-RPi
https://openqa.suse.de/tests/3553228

To prevent further reminder comments one of the following options should be followed:

The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
The openQA job group is moved to "Released"
The label in the openQA scenario is removed

#15 Updated by okurz over 2 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-extratest-RPi
https://openqa.suse.de/tests/3577199

To prevent further reminder comments one of the following options should be followed:

The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
The openQA job group is moved to "Released"
The label in the openQA scenario is removed

#16 Updated by okurz over 2 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: jeos-extratest-RPi
https://openqa.suse.de/tests/3577199

To prevent further reminder comments one of the following options should be followed:

The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
The openQA job group is moved to "Released"
The label in the openQA scenario is removed

#17 Updated by mgriessmeier over 2 years ago

Target version changed from Milestone 28 to Milestone 31

#18 Updated by SLindoMansilla over 1 year ago

Subject changed from [functional][u][JeOS][RPi3] yast2-firstboot as well as jeos-firstboot on RaspberryPi to [functional][u][RPi3] yast2-firstboot as well as jeos-firstboot on RaspberryPi
Status changed from Workable to New

RPi is not scope of JeOS team.
This ticket needs to be adapted for QSF-U.

#19 Updated by SLindoMansilla over 1 year ago

Subject changed from [functional][u][RPi3] yast2-firstboot as well as jeos-firstboot on RaspberryPi to [functional][u][RPi3] jeos-firstboot on RaspberryPi
Category changed from Enhancement to existing tests to New test

#20 Updated by SLindoMansilla over 1 year ago

Subject changed from [functional][u][RPi3] jeos-firstboot on RaspberryPi to [u][RPi3][epic] jeos-firstboot on RaspberryPi
Description updated (diff)

#21 Updated by SLindoMansilla over 1 year ago

Subject changed from [u][RPi3][epic] jeos-firstboot on RaspberryPi to [u][RPi3][epic] SLES on RaspberryPi

#22 Updated by SLindoMansilla over 1 year ago

Description updated (diff)

#23 Updated by maritawerner over 1 year ago

Sergio, we could add this progress ticket to the Master Test Plan as a "Level Test Plan Link" for RPi. It is at least an overview and links to Testopia? If you agee I will do that.

#24 Updated by SLindoMansilla over 1 year ago

maritawerner wrote:

Sergio, we could add this progress ticket to the Master Test Plan as a "Level Test Plan Link" for RPi. It is at least an overview and links to Testopia? If you agee I will do that.

Sure, I agree.