Project

General

Profile

action #71329

[qe-core][qem] [bind] bind test fails due to change in test suite (comments due to record_soft_failure are expected)

Added by pstivanin over 1 year ago. Updated 23 days ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Bugs in existing tests
Target version:
Start date:
2020-09-14
Due date:
% Done:

100%

Estimated time:
Difficulty:

Description

Since the latest update (which is still in the testing queue and goes by S:M:13024:226223), bind test fails due to:

Refusing to run test as root. Build with --enable-developer to override.

Complete log: https://openqa.suse.de/tests/4681125/file/serial_terminal.txt

History

#1 Updated by pstivanin over 1 year ago

  • Assignee set to dzedro

I'm assigning Jozef since he's the maintainer. Feel free to change this if that's not correct :)

#2 Updated by dzedro over 1 year ago

The problem is that this is not the only failing test https://openqa.suse.de/tests/4681133#step/yast_dns_server/15, update is breaking dns same or very similar like here https://bugzilla.suse.com/show_bug.cgi?id=1175894
I will check the bind testsuite.

#3 Updated by dzedro over 1 year ago

  • Subject changed from bind test fails due to change in test suite to [qam] [bind] bind test fails due to change in test suite
  • Status changed from New to In Progress

#5 Updated by dzedro over 1 year ago

A:System test statistics is failing very often on aarch64

#6 Updated by coolo over 1 year ago

Can you please move this test to development group until this is sorted?

#7 Updated by dzedro over 1 year ago

It is not 100% solved but lately there was no statistics failure. https://openqa.suse.de/tests/4912942#next_previous

#8 Updated by coolo over 1 year ago

I'm talking SLE12 - the ticket is not SLE15 specific from what I see. https://openqa.suse.de/tests/4912684#next_previous

#9 Updated by dzedro over 1 year ago

It is not, sorry, I will also take care of SLE12

#10 Updated by tjyrinki_suse over 1 year ago

  • Subject changed from [qam] [bind] bind test fails due to change in test suite to [qe-core][qam] [bind] bind test fails due to change in test suite

#11 Updated by tjyrinki_suse over 1 year ago

  • Subject changed from [qe-core][qam] [bind] bind test fails due to change in test suite to [qe-core][qem] [bind] bind test fails due to change in test suite

#12 Updated by dzedro 8 months ago

  • Project changed from QAM to openQA Tests

#13 Updated by dzedro 8 months ago

#14 Updated by szarate 8 months ago

  • Category set to Bugs in existing tests

#15 Updated by dzedro 8 months ago

There were failures on aarch64 I guess only on SLE 15 GA
Test A:zero:System test zero failed I:zero:ns3 didn't die when sent a SIGTERM
This is happening on aarch64, I guess because it's too slow.

https://openqa.suse.de/tests/7147514

#16 Updated by dzedro 8 months ago

  • Status changed from In Progress to Resolved
  • % Done changed from 0 to 100

Works like a charm, just changed record_info to record_soft_failure easier to see retry.
http://dzedro.suse.cz/tests/19486#step/bind/72

Didn't see failure since added retry, removing CASEDIR to merged PR https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/13197
https://gitlab.suse.de/qa-maintenance/qam-openqa-yml/-/merge_requests/181

#17 Updated by dzedro 8 months ago

  • Target version set to QE-Core: Ready

#18 Updated by openqa_review 7 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: mau-bind
https://openqa.suse.de/tests/7468461

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

#19 Updated by openqa_review 6 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: mau-bind
https://openqa.suse.de/tests/7608644

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

#20 Updated by openqa_review 6 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: mau-bind
https://openqa.suse.de/tests/7707439

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

#21 Updated by openqa_review 5 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: mau-bind
https://openqa.suse.de/tests/7809748

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

#22 Updated by okurz 5 months ago

  • Status changed from Resolved to Feedback

^

#23 Updated by dzedro 5 months ago

It is expected, there is record_soft_failure to easier see the "retry".

#24 Updated by openqa_review 4 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: mau-bind
https://openqa.suse.de/tests/7979972

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

#25 Updated by dzedro 4 months ago

  • Subject changed from [qe-core][qem] [bind] bind test fails due to change in test suite to [qe-core][qem] [bind] bind test fails due to change in test suite (comments due to record_soft_failure are expected)
  • Status changed from Feedback to Resolved

#26 Updated by openqa_review 3 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: mau-bind
https://openqa.suse.de/tests/8103334

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

#27 Updated by okurz 3 months ago

If you want an easier way to find all jobs that show the ticket as reference you can use https://github.com/os-autoinst/scripts/blob/master/openqa-query-for-job-label

#28 Updated by openqa_review 2 months ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: mau-bind
https://openqa.suse.de/tests/8254006

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

Expect the next reminder at the earliest in 28 days if nothing changes in this ticket.

#29 Updated by openqa_review 23 days ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: mau-bind
https://openqa.suse.de/tests/8612378

To prevent further reminder comments one of the following options should be followed:

  1. The test scenario is fixed by applying the bug fix to the tested product or the test is adjusted
  2. The openQA job group is moved to "Released" or "EOL" (End-of-Life)
  3. The bugref in the openQA scenario is removed or replaced, e.g. label:wontfix:boo1234

Expect the next reminder at the earliest in 100 days if nothing changes in this ticket.

Also available in: Atom PDF