action #34855: [kernel] "ltp_openposix" test results are taking too long to load -> timeout - openQA Project - openSUSE Project Management Tool

Custom queries

All 'new' issues w/o assignee, sorted by version/priority
All auto_review tickets
All auto_review+force_result tickets
openQA Infrastructure Project
openqa-review - Closed tickets last updated by openqa-review, last 30 days
QA roadmap long-term
QA SLE functional
QA SLE Functional - closed in last 14 days
QA SLE Functional - High, need to be refined
QA SLE Functional - over cycle time median
QA SLE u
QA SLE y
QA tools (tag not necessary in openQA and subprojects)
QA tools tag (tag not necessary in openQA and subprojects; excluding tickets in "Ready" version as they are already on the backlog)
QAC - Backlog
QE tools team - backlog (ready issues)
QE tools team - backlog (w/o infra)
QE tools team - backlog SLA high
QE tools team - backlog SLA immediate
QE tools team - backlog SLA no immediate/urgent in feedback/blocked
QE tools team - backlog SLA normal
QE tools team - backlog SLA urgent
QE tools team - backlog SLO high
QE tools team - backlog SLO normal
QE tools team - backlog SLO urgent
QE tools team - backlog, high-level view (epics and higher)
QE tools team - backlog, non-reactive work, needs parent
QE tools team - backlog, top-level view (all sagas)
QE tools team - closed within last 14 days
QE tools team - closed within last 60 days
QE tools team - closed yesterday
QE Tools Team - Collaborative Session
QE tools team - due date forecast
QE Tools team - due soon
QE tools team - exceeding due-date
QE tools team - infrastructure backlog
QE tools team - next - sorted by update time
QE tools team - next issues
QE tools team - non-estimated (unblocked) issues (w/o infra)
QE tools team - ready issues - Workable
QE tools team - ready, not assigned/blocked/low
QE tools team - update forecast
QE tools team - updated by priority
QE tools team - what members of the team are working on - Feedback (not-low)
QE Tools Team Backlog By Assignee
Tools Team Retrospective
Tools Team Retrospective (not estimated or assigned)

Actions

Copy link

action #34855

closed

[kernel] "ltp_openposix" test results are taking too long to load -> timeout

Added by okurz about 6 years ago. Updated over 3 years ago.

Status:

Resolved

Priority:

Normal

Assignee:

Category:

Regressions/Crashes

Target version:

QE Kernel - QE Kernel Done

Start date:

2018-04-12

Due date:

% Done:

Estimated time:

Description

Observation¶

last report generated on https://w3.nue.suse.com/~okurz/openqa_opensuse_org_status.html is from day before. This impedes our support for o3 test review.

Problem¶

Is this a new behaviour introduced with changes intendendly or a performance regression?

Related issues 1 (0 open — 1 closed)

Has duplicate openQA Project - action #63244: Ensure apache timeouts are higher than openQA internal ones (was: Latest version of openQA webui dashboard can not display big test result)

Resolved

ilausuch

2020-02-07

Actions

Issue # Delay: days Cancel

History
Notes
Property changes

Actions

Copy link

Updated by coolo about 6 years ago

If it blocks you, retry GETs. And I need details on what URLs are slow

Actions

Copy link

Updated by okurz about 6 years ago

openqa-review aborts in this case on the first error so there is only one URL per day

2018-04-07: https://openqa.opensuse.org/tests/651398
2018-04-08: https://openqa.opensuse.org/tests/652269
2018-04-09: https://openqa.opensuse.org/tests/652269
2018-04-10: https://openqa.opensuse.org/tests/653362
2018-04-11: https://openqa.opensuse.org/tests/653362
2018-04-12: https://openqa.opensuse.org/tests/654185
2018-04-13: https://openqa.opensuse.org/tests/654185
2018-04-14: no error, maybe less load over the weekend
2018-04-15: requests.exceptions.ConnectionError: ('Connection aborted.', error("(104, 'ECONNRESET')",))
2018-04-16: https://openqa.opensuse.org/tests/656338
2018-04-17: https://openqa.opensuse.org/tests/656338

If I try to load these pages manually often I also get a 504. If I manage to load after some retries I get "ltp_openposix" with a huge amount of thumbnails, hardly loads. It seems that all these pages are the same scenario "ltp_openposix". This scenario seems to really kill the server, my script, potentially even browsers ;)

Actions

Copy link

Updated by okurz about 6 years ago

Subject changed from [tools] o3 is giving me 504 when executing openqa-review since 2018-04-07 - openQA version upgrade? to [tools] o3 is giving me 504 when executing openqa-review since 2018-04-07 - openQA version upgrade? "ltp_openposix" is the culprit test suite

Actions

Copy link

Updated by coolo about 6 years ago

if the URL finishes, it's 7MB - so it's just a monster test result :(

Actions

Copy link

Updated by coolo about 6 years ago

Subject changed from [tools] o3 is giving me 504 when executing openqa-review since 2018-04-07 - openQA version upgrade? "ltp_openposix" is the culprit test suite to o3 is giving me 504 when executing openqa-review since 2018-04-07 - openQA version upgrade? "ltp_openposix" is the culprit test suite
Priority changed from High to Normal

And it's reading tons of small files - so to cure this from the openQA side of things we would need to cache such results a little harder. But that's not High prio, sorry. As said earlier: even retry or skip ltp_openposix in your client.

Actions

Copy link

Updated by coolo about 6 years ago

Subject changed from o3 is giving me 504 when executing openqa-review since 2018-04-07 - openQA version upgrade? "ltp_openposix" is the culprit test suite to "ltp_openposix" test results are taking too long to load -> timeout

Actions

Copy link

Updated by okurz about 6 years ago

sure, adapting the script is not a problem. But this will only increase load on o3 :)

Actions

Copy link

Updated by okurz about 4 years ago

Has duplicate action #63244: Ensure apache timeouts are higher than openQA internal ones (was: Latest version of openQA webui dashboard can not display big test result) added

Actions

Copy link

#10

Updated by pcervinka about 4 years ago

Subject changed from "ltp_openposix" test results are taking too long to load -> timeout to [kernel] "ltp_openposix" test results are taking too long to load -> timeout
Target version set to 454

Actions

Copy link

#11

Updated by okurz over 3 years ago

Status changed from New to Resolved

Mainly https://github.com/os-autoinst/openQA/pull/3144 has helped here.

Actions

Copy link

#12

Updated by pcervinka over 3 years ago

Target version changed from 454 to QE Kernel Done

Actions

Copy link

Also available in: Atom PDF

Project

General

Profile

QA » openQA Project

Tags

Custom queries

action #34855

[kernel] "ltp_openposix" test results are taking too long to load -> timeout

Observation¶

Problem¶

Updated by coolo about 6 years ago

Updated by okurz about 6 years ago

Updated by okurz about 6 years ago

Updated by coolo about 6 years ago

Updated by coolo about 6 years ago

Updated by coolo about 6 years ago

Updated by okurz about 6 years ago

Updated by okurz about 4 years ago

Updated by pcervinka about 4 years ago

Updated by okurz over 3 years ago

Updated by pcervinka over 3 years ago