action #34855
closed[kernel] "ltp_openposix" test results are taking too long to load -> timeout
0%
Description
Observation¶
last report generated on https://w3.nue.suse.com/~okurz/openqa_opensuse_org_status.html is from day before. This impedes our support for o3 test review.
Problem¶
Is this a new behaviour introduced with changes intendendly or a performance regression?
Updated by coolo over 6 years ago
If it blocks you, retry GETs. And I need details on what URLs are slow
Updated by okurz over 6 years ago
openqa-review aborts in this case on the first error so there is only one URL per day
- 2018-04-07: https://openqa.opensuse.org/tests/651398
- 2018-04-08: https://openqa.opensuse.org/tests/652269
- 2018-04-09: https://openqa.opensuse.org/tests/652269
- 2018-04-10: https://openqa.opensuse.org/tests/653362
- 2018-04-11: https://openqa.opensuse.org/tests/653362
- 2018-04-12: https://openqa.opensuse.org/tests/654185
- 2018-04-13: https://openqa.opensuse.org/tests/654185
- 2018-04-14: no error, maybe less load over the weekend
- 2018-04-15:
requests.exceptions.ConnectionError: ('Connection aborted.', error("(104, 'ECONNRESET')",))
- 2018-04-16: https://openqa.opensuse.org/tests/656338
- 2018-04-17: https://openqa.opensuse.org/tests/656338
If I try to load these pages manually often I also get a 504. If I manage to load after some retries I get "ltp_openposix" with a huge amount of thumbnails, hardly loads. It seems that all these pages are the same scenario "ltp_openposix". This scenario seems to really kill the server, my script, potentially even browsers ;)
Updated by okurz over 6 years ago
- Subject changed from [tools] o3 is giving me 504 when executing openqa-review since 2018-04-07 - openQA version upgrade? to [tools] o3 is giving me 504 when executing openqa-review since 2018-04-07 - openQA version upgrade? "ltp_openposix" is the culprit test suite
Updated by coolo over 6 years ago
if the URL finishes, it's 7MB - so it's just a monster test result :(
Updated by coolo over 6 years ago
- Subject changed from [tools] o3 is giving me 504 when executing openqa-review since 2018-04-07 - openQA version upgrade? "ltp_openposix" is the culprit test suite to o3 is giving me 504 when executing openqa-review since 2018-04-07 - openQA version upgrade? "ltp_openposix" is the culprit test suite
- Priority changed from High to Normal
And it's reading tons of small files - so to cure this from the openQA side of things we would need to cache such results a little harder. But that's not High prio, sorry. As said earlier: even retry or skip ltp_openposix in your client.
Updated by coolo over 6 years ago
- Subject changed from o3 is giving me 504 when executing openqa-review since 2018-04-07 - openQA version upgrade? "ltp_openposix" is the culprit test suite to "ltp_openposix" test results are taking too long to load -> timeout
Updated by okurz over 6 years ago
sure, adapting the script is not a problem. But this will only increase load on o3 :)
Updated by okurz almost 5 years ago
- Has duplicate action #63244: Ensure apache timeouts are higher than openQA internal ones (was: Latest version of openQA webui dashboard can not display big test result) added
Updated by pcervinka over 4 years ago
- Subject changed from "ltp_openposix" test results are taking too long to load -> timeout to [kernel] "ltp_openposix" test results are taking too long to load -> timeout
- Target version set to 454
Updated by okurz over 4 years ago
- Status changed from New to Resolved
Mainly https://github.com/os-autoinst/openQA/pull/3144 has helped here.
Updated by pcervinka about 4 years ago
- Target version changed from 454 to QE Kernel Done