Project

General

Profile

action #67408

[qem][qe-core] [evolution] test fails in evolution_smoke

Added by dzedro over 1 year ago. Updated 2 days ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
Bugs in existing tests
Target version:
Start date:
Due date:
% Done:

100%

Estimated time:
Difficulty:

Description

Observation

openQA test in scenario sle-15-SP2-Online-x86_64-wayland-desktopapps-message@64bit-virtio-vga fails in
evolution_smoke

Test suite description

smoke test often doesn't look up details of nooop_test3@aim.com email. https://openqa.suse.de/tests/4251958#step/evolution_smoke/13
I tried to do it in loop, but it does not help. http://10.100.12.155/tests/15936#step/evolution_smoke/56

Reproducible

Fails since (at least) Build 201.1

Expected result

Last good: 197.1 (or more recent)

Further details

Always latest result in this scenario: latest


Related issues

Related to openQA Tests - action #65169: [qam] [evolution] test fails in evolution_mail_imapResolved2020-04-02

History

#1 Updated by dzedro over 1 year ago

  • Status changed from New to In Progress
  • Assignee set to dzedro

#2 Updated by dzedro over 1 year ago

  • Related to action #65169: [qam] [evolution] test fails in evolution_mail_imap added

#3 Updated by dzedro over 1 year ago

  • Status changed from In Progress to New
  • Assignee deleted (dzedro)

#4 Updated by geor over 1 year ago

evolution_smoke no longer fails

#5 Updated by geor over 1 year ago

  • Status changed from New to Resolved

#6 Updated by dzedro over 1 year ago

This issue was not about failure, but about soft fail which I implemented to avoid failure.

#7 Updated by okurz about 1 year ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: x11-desktopapps-message@64bit-2gbram
https://openqa.suse.de/tests/4342658

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#8 Updated by okurz about 1 year ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: x11-desktopapps-message@64bit-2gbram
https://openqa.suse.de/tests/4342658

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#9 Updated by dzedro about 1 year ago

okurz any idea why bot updated this poo# with 2 months old softfail ?

#10 Updated by openqa_review about 1 year ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: x11-desktopapps-message@64bit-2gbram
https://openqa.suse.de/tests/4342658

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#11 Updated by openqa_review about 1 year ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: wayland-desktopapps-message
https://openqa.suse.de/tests/4637850

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#12 Updated by okurz 12 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: wayland-desktopapps-message
https://openqa.suse.de/tests/4816877

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#13 Updated by GraceWang 11 months ago

dzedro wrote:

This issue was not about failure, but about soft fail which I implemented to avoid failure.

dzedro
In fact, this issue was not resolved 100% and a soft fail was added to handle possible failure.
Please correct me if my understanding is not correct.

In SLE15SP3, this test suite only passed 2 times with all the other results (more than 20) go to soft fail.
Is there a way to resolve this issue without soft fail?

#14 Updated by dzedro 11 months ago

In fact, this issue does exist to document the failure and as reason for soft_fail, which does avoid failing test.
I can change this to work only for maintenance and you can have fun with failures and continue to blindly restart the test.
I don't know the reason why it is failing or how to debug it, maybe replace nooop_test3@aim.com with something else, maybe local email address.

#15 Updated by okurz 11 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: wayland-desktopapps-message
https://openqa.suse.de/tests/4922403

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#16 Updated by okurz 10 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-mail-evolution
https://openqa.suse.de/tests/5034412

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#17 Updated by okurz 10 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-mail-evolution
https://openqa.suse.de/tests/5125172

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#18 Updated by okurz 9 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-regression-message
https://openqa.suse.de/tests/5190827

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#19 Updated by okurz 9 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: wayland-desktopapps-message
https://openqa.suse.de/tests/5217869

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#20 Updated by okurz 9 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: wayland-desktopapps-message
https://openqa.suse.de/tests/5287161

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#21 Updated by okurz 8 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: wayland-desktopapps-message
https://openqa.suse.de/tests/5428752

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#22 Updated by okurz 7 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: wayland-desktopapps-message
https://openqa.suse.de/tests/5478875

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#23 Updated by openqa_review 7 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: wayland-desktopapps-message
https://openqa.suse.de/tests/5647241

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#24 Updated by okurz 6 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: x11-desktopapps-message@64bit-2gbram
https://openqa.suse.de/tests/5750482

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#25 Updated by okurz 6 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: x11-desktopapps-message@64bit-2gbram
https://openqa.suse.de/tests/5815624

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#26 Updated by okurz 5 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: x11-desktopapps-message@64bit-2gbram
https://openqa.suse.de/tests/5903880

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#27 Updated by okurz 5 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: x11-desktopapps-message@64bit-2gbram
https://openqa.suse.de/tests/5990745

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#28 Updated by okurz 4 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: wayland-desktopapps-message
https://openqa.suse.de/tests/6037440

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#29 Updated by okurz 4 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: qam-regression-message
https://openqa.suse.de/tests/6226964

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#30 Updated by openqa_review 3 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: wayland-desktopapps-message
https://openqa.suse.de/tests/6037440

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released"
  3. The label in the openQA scenario is removed

#31 Updated by okurz 3 months ago

  • Subject changed from [qam] [evolution] test fails in evolution_smoke to [qam][qe-core] [evolution] test fails in evolution_smoke
  • Status changed from Resolved to Feedback

^

#32 Updated by openqa_review 3 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: wayland-desktopapps-message
https://openqa.suse.de/tests/6037440

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The label in the openQA scenario is removed

#33 Updated by mgrifalconi about 2 months ago

  • Status changed from Feedback to Workable

Hello all, now it is failing all the time on 15-SP2 https://openqa.suse.de/tests/6786004#next_previous

#34 Updated by martinsmac about 2 months ago

Hello all, now it is failing all the time on 15-SP3

https://openqa.suse.de/tests/6788950#step/evolution_smoke/21

#35 Updated by tjyrinki_suse about 2 months ago

  • Subject changed from [qam][qe-core] [evolution] test fails in evolution_smoke to [qem][qe-core] [evolution] test fails in evolution_smoke
  • Priority changed from Normal to High
  • Start date deleted (2020-05-28)

#36 Updated by dzedro about 1 month ago

  • Status changed from Workable to In Progress
  • Assignee set to dzedro

#37 Updated by dzedro about 1 month ago

  • Status changed from In Progress to Blocked

The auth of nooops_test3@aim.com does not work in evolution, no idea why. I tried to login via web and that does work.
I reported https://bugzilla.suse.com/show_bug.cgi?id=1189513

#38 Updated by dzedro about 1 month ago

  • Status changed from Blocked to In Progress

#39 Updated by dzedro about 1 month ago

  • Status changed from In Progress to Resolved
  • % Done changed from 0 to 100

#40 Updated by szarate 20 days ago

  • Target version set to QE-Core: Ready

#41 Updated by openqa_review 2 days ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: wayland-desktopapps-message
https://openqa.suse.de/tests/7212211

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

Also available in: Atom PDF