Project

General

Profile

action #114403

[qe-core] openQA doesn't give red or fail the case there even test fails in smt_server_install

Added by rfan1 8 months ago. Updated 3 months ago.

Status:
Feedback
Priority:
Normal
Assignee:
Category:
Enhancement to existing tests
Target version:
Start date:
2022-07-20
Due date:
% Done:

80%

Estimated time:
4.00 h
Difficulty:

Description

Observation

We can see lots of error messages there, in this test module, but seems we can still get return 0.

openQA test in scenario sle-12-SP5-Server-DVD-Updates-x86_64-qam-smt-server-install@64bit fails in
smt_server_install

Test suite description

Testsuite maintained at https://gitlab.suse.de/qa-maintenance/qam-openqa-yml.

Reproducible

Fails since (at least) Build 20220714-1

Expected result

Last good: 20220712-1 (or more recent)

Further details

Always latest result in this scenario: latest


Related issues

Related to openQA Tests - action #113788: [qe-core] test fails in system_prepare - no space left on deviceResolved2022-07-19

History

#1 Updated by rfan1 8 months ago

  • Category changed from Bugs in existing tests to Enhancement to existing tests
  • Target version set to QE-Core: Ready

https://openqa.suse.de/tests/9176046#step/smt_server_install/50

I need double check if it is expected result then the mirror process doesn't quit with errors.
And I would ask for some experts' help for smt server setup.

#2 Updated by rfan1 8 months ago

  • Related to action #113788: [qe-core] test fails in system_prepare - no space left on device added

#3 Updated by rfan1 8 months ago

  • Assignee set to rfan1
  • Estimated time set to 4.00 h

https://bugzilla.suse.com/show_bug.cgi?id=1201738

File the bug above and try to enhance our test code make sure we can quit the test if any issue with "smt-mirror" process.

Action:
Check the log file to make sure no error messages.

#4 Updated by rfan1 8 months ago

  • Status changed from New to In Progress
  • % Done changed from 0 to 40

#5 Updated by rfan1 8 months ago

  • Status changed from In Progress to Feedback
  • % Done changed from 40 to 90

#6 Updated by rfan1 7 months ago

  • Status changed from Feedback to In Progress
  • % Done changed from 90 to 80

#7 Updated by rfan1 4 months ago

szarate,

Can you please double check this ticket? I think we can hold on to merge https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/15261

Because I think assert_script_run "tail -2 /var/log/smt/smt-mirror.log | grep 'Errors: : 0'"; is a bit strict for smt server sync, I may need check with migration team to see if we can have better solution to handle the error during data sync.

#8 Updated by szarate 4 months ago

It hasn't really failed in quite some time, so I guess we can wait a bit more

#9 Updated by rfan1 3 months ago

  • Status changed from In Progress to Feedback

Also available in: Atom PDF