Project

General

Profile

Actions

action #36310

closed

[sle][u] test fails in ImageMagick - imagemagick/bg_script.sh does not convert test.png to black_level.png

Added by mloviska almost 6 years ago. Updated over 5 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Bugs in existing tests
Target version:
-
Start date:
2018-05-17
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

openQA test in scenario sle-15-Installer-DVD-x86_64-we-module@64bit fails in
ImageMagick

Bash script bg_script.sh need adjustment to convert test.png to expected output in testcase #28.

echo "black_level.png"
convert  test.png -level 100%,100% -alpha off  black_level.png
cme black_level.png 28.png

Reproducible

Fails since (at least) Build 278.1

Expected result

Last good: (unknown) (or more recent)

Further details

Always latest result in this scenario: latest

Actions #1

Updated by okurz almost 6 years ago

  • Due date set to 2018-06-19
  • Assignee set to vsvecova
  • Target version set to Milestone 17

Hi Veronika, you are the test module maintainer of "ImageMagick". Would you like to try to fix it? If not feel free to unassign again and we will try to fix it.

Actions #2

Updated by vsvecova almost 6 years ago

Hello Oliver, I have actually already filed a bug a couple days ago, since I was able to reproduce it outside of openQA on a VM:
https://bugzilla.suse.com/show_bug.cgi?id=1093395

Petr Gajdos was also able to reproduce it and is going to work on it. In the meantime he opened an issue upstream:
https://github.com/ImageMagick/ImageMagick/issues/1132

Actions #3

Updated by vsvecova almost 6 years ago

I added the bug reference as a comment to the failing job

Actions #4

Updated by vsvecova almost 6 years ago

  • Status changed from New to Feedback

bsc#1093395 has now been marked as resolved and fixed: https://bugzilla.suse.com/show_bug.cgi?id=1093395#c8

Therefore I believe this ticket can also be closed when the next test run confirms the fix -> setting status to Feedback.

Actions #5

Updated by vsvecova almost 6 years ago

The -level behaviour is now fixed and the related test step passed fine, however, the ImageMagick module is still failing due to another issue; the -gamma behavior is now off.

The test step executes the following:

convert test.png -gamma 0 -alpha off black_gamma.png

The expected result is an all black image, however the actual result is different:
https://openqa.suse.de/tests/1719953#step/ImageMagick/52

The issue is again happening on SLE 15, while the test results for SLE12 are all fine.

I updated bsc#1093395 with this observation and asked Petr Gajdos for consultation.

Also, I am now going through all the remaining test steps in the ImageMagick module manually, to make sure that we catch any other results that may be odd, without having to wait for the next execution of the test module after the new issue is fixed.

Would you like me to open a new progress ticket for the new issue, or is it fine to reopen this one?

Actions #6

Updated by vsvecova almost 6 years ago

I have reported the described issue here:
https://bugzilla.suse.com/show_bug.cgi?id=1094745
I added the bug reference as a comment to the failing test run.

I have also started going through the individual test steps manually and so far I have encountered three more potential issues, reported here:
https://bugzilla.suse.com/show_bug.cgi?id=1094744
https://bugzilla.suse.com/show_bug.cgi?id=1094742
https://bugzilla.suse.com/show_bug.cgi?id=1094741

The bugs are assigned to Petr Gajdos and I'll keep going through the test steps in search of any further issues.
I am tracking them here: https://etherpad.nue.suse.com/p/ImageMagick_issues

Actions #7

Updated by okurz almost 6 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: we-module
https://openqa.suse.de/tests/1760789

Actions #8

Updated by okurz almost 6 years ago

  • Target version changed from Milestone 17 to Milestone 17
Actions #9

Updated by mgriessmeier almost 6 years ago

  • Due date changed from 2018-06-19 to 2018-07-03
Actions #10

Updated by mgriessmeier over 5 years ago

  • Subject changed from [sle][functional][u] test fails in ImageMagick - imagemagick/bg_script.sh does not convert test.png to black_level.png to [sle][u] test fails in ImageMagick - imagemagick/bg_script.sh does not convert test.png to black_level.png
  • Due date deleted (2018-07-03)
  • Target version deleted (Milestone 17)

Removing from functional domain.
We take care about labelling the corresponding jobs accordingly.

Actions #11

Updated by okurz over 5 years ago

This is an autogenerated message for openQA integration by the openqa_review script:

This bug is still referenced in a failing openQA test: we-module
https://openqa.suse.de/tests/1773806

Actions #12

Updated by okurz over 5 years ago

I am interested in the current state regarding SLE15GM so I retriggered a special test manually:
https://openqa.suse.de/tests/1859636#live

Actions #13

Updated by okurz over 5 years ago

didn't work because of obsolete regcode, I could overwrite that as well and retrigger but nevermind. Maybe we will see SLE15SP1 tests already soon.

Actions #14

Updated by okurz over 5 years ago

  • Description updated (diff)
  • Status changed from Feedback to Resolved
Actions

Also available in: Atom PDF