Project

General

Profile

Actions

action #10432

closed

SLED "regression": a lot of firefox tests are broken

Added by okurz over 8 years ago. Updated over 7 years ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
Bugs in existing tests
Target version:
-
Start date:
2016-01-26
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

observation

https://openqa.suse.de/tests/188333
in "regression" scenario

problem

potentially product issue

Actions #1

Updated by okurz almost 8 years ago

  • Assignee set to XJin

In https://openqa.suse.de/tests/463132.

one problem is that on www.suse.com the icon is covering the text which is not nice. I reported this problem on www.suse.com as feedback. http://paste.opensuse.org/17039860. I recommend to update the test code as the tag "suse blogs" does not apply anymore.

Actions #3

Updated by okurz almost 8 years ago

Yes, it sounds reasonable to increase the timeout values.

In general, timeout should be selected to be a very robust value that is not trying to catch a slight degradation in performance but only pretty severe degradations or the test is really stuck.

Nevertheless, www.suse.com is very slow to load. I wrote this using the feedback function on www.suse.com and gave feedback on the slow performance.

Actions #4

Updated by XJin almost 8 years ago

  • Status changed from New to In Progress

Merged PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/1596 covered:

  • lengthen timeout in all firefox-regression test cases
  • obsolete 'blog-navigate' in fire_smoke

Reneedling will be achieved day by day

Then close this issue.

Actions #5

Updated by XJin almost 8 years ago

  • Status changed from In Progress to Resolved
Actions #6

Updated by RBrownSUSE over 7 years ago

  • Status changed from Resolved to In Progress
  • Priority changed from Normal to High

This issue is not resolved, still broken:

https://openqa.suse.de/tests/499611#

Actions #7

Updated by XJin over 7 years ago

  • Assignee changed from XJin to qkzhu
Actions #8

Updated by XJin over 7 years ago

RBrownSUSE wrote:

This issue is not resolved, still broken:

https://openqa.suse.de/tests/499611#

Please refer:
https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/1640

And which part has been covered pls refer:
comment#4

Actions #9

Updated by qkzhu over 7 years ago

  • firefox_java.pm
  • firefox_pagesaving.pm
  • firefox_flashplayer.pm
  • firefox_ssl.pm
  • firefox_passwd.pm
  • firefox_mhtml.pm
  • firefox_plugins.pm
  • firefox_extensions.pm
  • firefox_appearance.pm
  • firefox_html5.pm
  • firefox_private.pm
  • firefox_developertool.pm
  • firefox_gnomeshell.pm
  • firefox_rss.pm

Those failed cases would be token out from qam test for SP1, we should
bring them back once they are fixed.

PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/2020

Actions #10

Updated by qkzhu over 7 years ago

Update 3 firefox cases to fix Reader View issue

Reader View is a Firefox feature that strips away all of a website's
clutter so you can focus on what you're reading. The popup message
box in the address bar has blocked our cases for a while, we have to
close the popup box before the test.

  • improve the closing step by adding a new needle for
    • firefox_extcontent.pm
    • firefox_flashplayer.pm
    • firefox_java.pm
  • bring back firefox_flashplayer.pm and firefox_java.pm for qam test

PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/2060

validation on SP2: http://147.2.212.239/tests/887

validation on SP1: http://147.2.212.239/tests/886

Actions #11

Updated by qkzhu over 7 years ago

Update 2 firefox cases to fix poo#10432

  • firefox_pagesaving.pm: firefox was launched twice, delete the second launching
  • firefox_private.pm: fixing the closing step
  • reduce the waiting time for wait_still_screen
  • bring back firefox_private.pm and firefox_pagesaving.pm for qam test

PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/2071

validation on SP2: http://147.2.212.239/tests/896

validation on SP1: http://147.2.212.239/tests/898

Actions #12

Updated by qkzhu over 7 years ago

Update 5 firefox addon related cases to fix poo#10432

Firefox has been updated to 45.4, the steps to open about:addons page
has changed. In this commit I improved 5 related cases and brought
them back to qam test:

  • firefox_appearance.pm
  • firefox_appearance.pm
  • firefox_gnomeshell.pm
  • firefox_mhtml.pm
  • firefox_plugins.pm

see also: poo#10432

PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/2081

needles on gitlab: https://gitlab.suse.de/openqa/os-autoinst-needles-sles/merge_requests/246

validation on SP2: http://147.2.212.239/tests/914

validation on SP1: http://147.2.212.239/tests/921

Actions #13

Updated by okurz over 7 years ago

  • Category set to Bugs in existing tests
Actions #14

Updated by qkzhu over 7 years ago

Update firefox_rss, firefox_html5 and firefox_passwd to fix poo#10432

  • firefox_html5.pm Firefox has been updated to 45.4 which has set the html5 player as default. It's unnecessary to request it as default any more.
  • firefox_rss.pm Optimize the steps and change the testing url to slashdot since it's loading speed is more quick.
  • firefox_passwd.pm Update the steps according to the new version
  • Switch to use the firefox starting and quit functions
  • Bring back these cases to qam test: firefox_passwd.pm firefox_rss.pm firefox_html5.pm firefox_developertool.pm

see also: poo#10432

PR: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/2090

validation on SP2: http://147.2.212.239/tests/935

validation on SP1: http://147.2.212.239/tests/937

Actions #15

Updated by JWSun over 7 years ago

Fixed Firefox_ssl case failed #2136

  • Update steps to add security exception website. Because of CNNIC certification is no longer work for this case, change it to Hongkong Post CA.

PR https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/2136

validation on SP1: http://147.2.212.239/tests/985

validation on SP2: http://147.2.212.239/tests/983

Actions #16

Updated by qkzhu over 7 years ago

  • Status changed from In Progress to Resolved

fixed at: https://openqa.suse.de/tests/639167

Several cases are still unstable, we'd better file new issues for that since this issue is too mess to follow new issue.

Actions

Also available in: Atom PDF