Project

General

Profile

Actions

action #167093

open

coordination #169654: [epic] Create test scenarios for Agama

Detect end of agama auto-installation in s390x using for example logs

Added by JERiveraMoya 2 months ago. Updated 8 days ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
-
Start date:
2024-09-20
Due date:
% Done:

0%

Estimated time:

Description

Motivation

Detect end of agama auto-installation in s390x using logs.
Usign zVM workers we don't have UI to know where the auto-installation ended, but it is possible to perform some kind of active search in a loop with some similar timeout that we have for the UI to know that the process finished.
In the future it will be some feature in agama (cli for example) to do that.

Acceptance criteria

  • AC1: Detect end of agama auto-installation in s390x using for example logs.

Additional information

get_reboot_page should give us an object that override the method to check if reboot web page is in the screen, so basically handle with Page Object Model.


Related issues 1 (1 open0 closed)

Related to qe-yam - action #166628: Avoid character limit on s390x in O3New2024-09-11

Actions
Actions #1

Updated by JERiveraMoya 2 months ago

  • Description updated (diff)
Actions #2

Updated by JERiveraMoya 2 months ago

  • Description updated (diff)
Actions #3

Updated by JERiveraMoya about 2 months ago

  • Subject changed from Detect end of agama installation in s390x using logs to Detect end of agama auto-installation in s390x using logs
Actions #4

Updated by JERiveraMoya about 2 months ago

  • Subject changed from Detect end of agama auto-installation in s390x using logs to Detect end of agama auto-installation in s390x using for example logs
  • Description updated (diff)
Actions #5

Updated by JERiveraMoya about 2 months ago

  • Tags changed from qe-yam-sep-sprint to qe-yam-oct-sprint
Actions #6

Updated by hjluo about 1 month ago

  • Assignee set to hjluo
Actions #7

Updated by hjluo about 1 month ago

  • Now all s390x cases are blocked by agama_boot. only agama_default works. but not auto test.
Actions #8

Updated by JERiveraMoya about 1 month ago · Edited

  • Status changed from Workable to In Progress

hjluo wrote in #note-7:

  • Now all s390x cases are blocked by agama_boot. only agama_default works. but not auto test.

I restarted in the morning after renaming in O3, every day you work with new builds you need to run as geekotest to make it pass the boot phase.

cd /var/lib/openqa/factory/repo/
mv agama-installer.s390x-10.0.0-openSUSE-Build<version>.iso agama.s390x-10.0.0-Build<version>.iso

due to character limitation in s390x zVM.
https://openqa.opensuse.org/tests/4558965
https://openqa.opensuse.org/tests/4558964

Actions #9

Updated by JERiveraMoya about 1 month ago

  • Related to action #166628: Avoid character limit on s390x in O3 added
Actions #10

Updated by hjluo about 1 month ago

  • Status changed from In Progress to Workable

JERiveraMoya wrote in #note-8:

hjluo wrote in #note-7:

  • Now all s390x cases are blocked by agama_boot. only agama_default works. but not auto test.

I restarted in the morning after renaming in O3, every day you work with new builds you need to run as geekotest to make it pass the boot phase.

cd /var/lib/openqa/factory/repo/
mv agama-installer.s390x-10.0.0-openSUSE-Build<version>.iso agama.s390x-10.0.0-Build<version>.iso

due to character limitation in s390x zVM.
https://openqa.opensuse.org/tests/4558965
https://openqa.opensuse.org/tests/4558964

OK, thanks for the information.

Actions #11

Updated by JERiveraMoya about 1 month ago · Edited

hjluo wrote in #note-10:

JERiveraMoya wrote in #note-8:

hjluo wrote in #note-7:

  • Now all s390x cases are blocked by agama_boot. only agama_default works. but not auto test.

I restarted in the morning after renaming in O3, every day you work with new builds you need to run as geekotest to make it pass the boot phase.

cd /var/lib/openqa/factory/repo/
mv agama-installer.s390x-10.0.0-openSUSE-Build<version>.iso agama.s390x-10.0.0-Build<version>.iso

due to character limitation in s390x zVM.
https://openqa.opensuse.org/tests/4558965
https://openqa.opensuse.org/tests/4558964

OK, thanks for the information.

Any reason to put it back on Workable? otherwise it makes not sense to assign yourself this ticket if you are not working on it.

Actions #12

Updated by hjluo about 1 month ago

  • Status changed from Workable to In Progress
Actions #13

Updated by hjluo about 1 month ago

# Test died: Can't call method "send_key" on an undefined value at /usr/lib/os-autoinst/consoles/ttyConsole.pm line 12.
at /usr/lib/os-autoinst/testapi.pm line 1690.
testapi::select_console("installation", "timeout", 600) called at /var/lib/openqa/pool/103/os-autoinst-distri-opensuse/tests/yam/agama/../../installation/bootloader_s390.pm line 346
bootloader_s390::run(boot_agama=HASH(0x560c9e4342e8)) called at /var/lib/openqa/pool/103/os-autoinst-distri-opensuse/tests/yam/agama/boot_agama.pm line 30

Actions #14

Updated by JERiveraMoya about 1 month ago · Edited

hjluo wrote in #note-13:

# Test died: Can't call method "send_key" on an undefined value at /usr/lib/os-autoinst/consoles/ttyConsole.pm line 12.
at /usr/lib/os-autoinst/testapi.pm line 1690.
testapi::select_console("installation", "timeout", 600) called at /var/lib/openqa/pool/103/os-autoinst-distri-opensuse/tests/yam/agama/../../installation/bootloader_s390.pm line 346
bootloader_s390::run(boot_agama=HASH(0x560c9e4342e8)) called at /var/lib/openqa/pool/103/os-autoinst-distri-opensuse/tests/yam/agama/boot_agama.pm line 30

Few tips here that cross my mind:

  • Instead of reporting that your custom job run doesn't work applying that simple step, it would more clear to report that our production job run doesn't work. For example I restarted https://openqa.opensuse.org/tests/4565364. So you can see if it is your branch code which creates the issue or something else has changed. In this case it seems to be on your side or at the moment that you tried because in prod the system boots fine applying the rename.
  • To report progress in your ticket you could use a better approach IMO, just summarize blockers, findings, etc. but for a technical doubt like that above it makes no sense to report it only here, you can use our slack channel and get help from anyone, not only (because not the whole squad receive notifications about tickets, only creator and partipants and watchers in progress tickets). It will be faster and more effective and you can still report back here if you consider it is needed. I hope that helps. I saw you also reported in #eng-testing, https://suse.slack.com/archives/C02CANHLANP/p1729050967190499 that is good, I missed this info here, too many channels! :) , that is why slack is more optimal than writing here more than summaries, still my advice above might be useful.
Actions #15

Updated by hjluo about 1 month ago · Edited

  • Try to use agama log store to store the agama log
  • Then try to check agama-auto.out.log and wait following line

[3/3] Configure the system
agama-auto.service: Deactivated successfully.

or in /var/log/YaST2/y2log
Error output: Installation finished. No error reported.

Actions #16

Updated by JERiveraMoya about 1 month ago

hjluo wrote in #note-15:

what will be your approach, did you find something useful to wait for the installation finishes?
we can always take a look before implementation.

Actions #17

Updated by hjluo about 1 month ago

Actions #18

Updated by hjluo about 1 month ago · Edited

Actions #19

Updated by hjluo about 1 month ago · Edited

From Ladislav Slezak

Ah, found it, the x86_64 and aarch64 use HTTP URL while s390 and PPC HTTPS.
We should switch all to plain HTTP. The repositories are GPG checked anyway it is not a problem.
I'll fix that.

JFYI: fixed in https://github.com/agama-project/agama/pull/1688

Actions #20

Updated by JERiveraMoya 29 days ago

  • Tags changed from qe-yam-oct-sprint to qe-yam-nov-sprint
Actions #21

Updated by hjluo 25 days ago

Actions #22

Updated by hjluo 23 days ago

Actions #23

Updated by JERiveraMoya 16 days ago · Edited

I guess we gave a try here (25 days) and now there are product issues that stop us to keep up testing/developing automation.
Are you ok with return the ticket to backlog to evaluate later and give the opportunity to someone else.
That would mean:

  • Unassigned yourself from the ticket.
  • Set status New.
  • Remove Tag.
  • Add a summary with your finding and draft code, you can close the PR but leave the branch accessible.
Actions #24

Updated by hjluo 16 days ago

JERiveraMoya wrote in #note-23:

I guess we gave a try here (25 days) and now there are product issues that stop us to keep up testing/developing automation.
Are you ok with return the ticket to backlog to evaluate later and give the opportunity to someone else.
That would mean:

  • Unassigned yourself from the ticket.
  • Set status New.
  • Remove Tag.
  • Add a summary with your finding and draft code, you can close the PR but leave the branch accessible.

OK.

Actions #25

Updated by JERiveraMoya 16 days ago

  • Tags deleted (qe-yam-nov-sprint)
  • Status changed from In Progress to New
  • Assignee deleted (hjluo)
Actions #26

Updated by JERiveraMoya 10 days ago

  • Parent task changed from #163919 to #169654
Actions #27

Updated by JERiveraMoya 9 days ago

  • Priority changed from High to Normal
Actions

Also available in: Atom PDF