Project

General

Profile

Actions

action #106011

closed

[sle][security][sle15sp4][s390x]test fails in curl_https, script_timeount?

Added by rfan1 about 2 years ago. Updated about 2 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Bugs in existing tests
Target version:
-
Start date:
2022-02-07
Due date:
% Done:

100%

Estimated time:
16.00 h
Difficulty:

Description

Observation

openQA test in scenario sle-15-SP4-Online-s390x-fips_env_mode_tests_crypt_web@s390x-kvm-sle12 fails in
curl_https

Test suite description

Maintainer: bchou@suse.com. Workaround for FIPS single module mode

Reproducible

Fails since (at least) Build 91.2

Expected result

Last good: 84.1 (or more recent)

Further details

Always latest result in this scenario: latest

===============
@bchou
I tried to re-run the test, but can still hit the issue, seems timeout on s390x platform, can you please try to increase the timeout value or adjust the mem size?

[2022-02-07T03:20:23.259059+01:00] [debug] curl -f -v https://eu.httpbin.org/get failed: script timeout: curl -f -v https://httpbin.org/get 2>&1 at /usr/lib/os-autoinst/distribution.pm line 312.

Actions #1

Updated by bchou about 2 years ago

Thanks Richard,

How about increasing the timeout value to 180?

Actions #2

Updated by bchou about 2 years ago

Refer to poo #106020
[security][sle][s390x] user console access 'ttysclp0' permission denied

PR from Richard: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/14178

Actions #3

Updated by bchou about 2 years ago

Refer to bug 1195620 - [Build 91.2] The permission of device '/dev/tty*' is changed to '1154' after login it
https://bugzilla.suse.com/show_bug.cgi?id=1195620

Actions #4

Updated by bchou about 2 years ago

After increasing the timeout to 180, the problem still shows up. It could not be the problem related to the less timeout value. It's more like the permission denied.

[ 131.958148] systemd[1834]: Started Virtual filesystem metadata service.
[2022-02-08T05:56:05.111810+01:00] [debug] >>> testapi::wait_serial: SCRIPT_FINISHED4V9zF-\d+-: fail
[2022-02-08T05:56:05.113363+01:00] [debug] curl -f -v https://eu.httpbin.org/get failed: script timeout: curl -f -v https://httpbin.org/get 2>&1 at /usr/lib/os-autoinst/distribution.pm line 312.
distribution::script_output(undef, undef, "type_command", undef, "timeout", 180, "quiet", undef, ...) called at /usr/lib/os-autoinst/testapi.pm line 1164
testapi::script_output("curl -f -v https://httpbin.org/get 2>\x{26}1", "proceed_on_failure", 1, "quiet", undef, "timeout", 180) called at /usr/lib/os-autoinst/testapi.pm line 1247
testapi::validate_script_output(undef, undef, "timeout", 180, "proceed_on_failure", 1) called at /var/lib/openqa/pool/33/os-autoinst-distri-opensuse/tests/console/curl_https.pm line 27
eval {...} called at /var/lib/openqa/pool/33/os-autoinst-distri-opensuse/tests/console/curl_https.pm line 26
curl_https::run(curl_https=HASH(0x10025b7b5b8)) called at /usr/lib/os-autoinst/basetest.pm line 360
eval {...} called at /usr/lib/os-autoinst/basetest.pm line 354
basetest::runtest(curl_https=HASH(0x10025b7b5b8)) called at /usr/lib/os-autoinst/autotest.pm line 372
eval {...} called at /usr/lib/os-autoinst/autotest.pm line 372
autotest::runalltests() called at /usr/lib/os-autoinst/autotest.pm line 242
eval {...} called at /usr/lib/os-autoinst/autotest.pm line 242
autotest::run_all() called at /usr/lib/os-autoinst/autotest.pm line 296
autotest::ANON(Mojo::IOLoop::ReadWriteProcess=HASH(0x10026d4d8f8)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 326
eval {...} called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 326
Mojo::IOLoop::ReadWriteProcess::_fork(Mojo::IOLoop::ReadWriteProcess=HASH(0x10026d4d8f8), CODE(0x1002649e648)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 488
Mojo::IOLoop::ReadWriteProcess::start(Mojo::IOLoop::ReadWriteProcess=HASH(0x10026d4d8f8)) called at /usr/lib/os-autoinst/autotest.pm line 298
autotest::start_process() called at /usr/bin/isotovideo line 261

[2022-02-08T05:56:05.113441+01:00] [debug] Maybe the network is busy. Retry: 1 of 7

Actions #5

Updated by bchou about 2 years ago

  • Status changed from New to In Progress

[2022-02-08T06:14:52.942079+01:00] [debug] >>> testapi::wait_serial: SCRIPT_FINISHED4V9zF-\d+-: fail
[2022-02-08T06:14:52.943501+01:00] [debug] curl -f -v https://eu.httpbin.org/get failed: script timeout: curl -f -v https://httpbin.org/get 2>&1 at /usr/lib/os-autoinst/distribution.pm line 312.
distribution::script_output(undef, undef, "quiet", undef, "timeout", 180, "proceed_on_failure", 1, ...) called at /usr/lib/os-autoinst/testapi.pm line 1164
testapi::script_output("curl -f -v https://httpbin.org/get 2>\x{26}1", "quiet", undef, "timeout", 180, "proceed_on_failure", 1) called at /usr/lib/os-autoinst/testapi.pm line 1247
testapi::validate_script_output(undef, undef, "timeout", 180, "proceed_on_failure", 1) called at /var/lib/openqa/pool/33/os-autoinst-distri-opensuse/tests/console/curl_https.pm line 27
eval {...} called at /var/lib/openqa/pool/33/os-autoinst-distri-opensuse/tests/console/curl_https.pm line 26
curl_https::run(curl_https=HASH(0x10025b7b5b8)) called at /usr/lib/os-autoinst/basetest.pm line 360
eval {...} called at /usr/lib/os-autoinst/basetest.pm line 354
basetest::runtest(curl_https=HASH(0x10025b7b5b8)) called at /usr/lib/os-autoinst/autotest.pm line 372
eval {...} called at /usr/lib/os-autoinst/autotest.pm line 372
autotest::runalltests() called at /usr/lib/os-autoinst/autotest.pm line 242
eval {...} called at /usr/lib/os-autoinst/autotest.pm line 242
autotest::run_all() called at /usr/lib/os-autoinst/autotest.pm line 296
autotest::ANON(Mojo::IOLoop::ReadWriteProcess=HASH(0x10026d4d8f8)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 326
eval {...} called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 326
Mojo::IOLoop::ReadWriteProcess::_fork(Mojo::IOLoop::ReadWriteProcess=HASH(0x10026d4d8f8), CODE(0x1002649e648)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 488
Mojo::IOLoop::ReadWriteProcess::start(Mojo::IOLoop::ReadWriteProcess=HASH(0x10026d4d8f8)) called at /usr/lib/os-autoinst/autotest.pm line 298
autotest::start_process() called at /usr/bin/isotovideo line 261

[2022-02-08T06:14:52.943581+01:00] [debug] Maybe the network is busy. Retry: 7 of 7
[2022-02-08T06:14:52.944140+01:00] [info] ::: basetest::runtest: # Test died: curl failed (with retries) at /var/lib/openqa/pool/33/os-autoinst-distri-opensuse/tests/console/curl_https.pm line 33.
curl_https::run(curl_https=HASH(0x10025b7b5b8)) called at /usr/lib/os-autoinst/basetest.pm line 360
eval {...} called at /usr/lib/os-autoinst/basetest.pm line 354
basetest::runtest(curl_https=HASH(0x10025b7b5b8)) called at /usr/lib/os-autoinst/autotest.pm line 372
eval {...} called at /usr/lib/os-autoinst/autotest.pm line 372
autotest::runalltests() called at /usr/lib/os-autoinst/autotest.pm line 242
eval {...} called at /usr/lib/os-autoinst/autotest.pm line 242
autotest::run_all() called at /usr/lib/os-autoinst/autotest.pm line 296
autotest::ANON(Mojo::IOLoop::ReadWriteProcess=HASH(0x10026d4d8f8)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 326
eval {...} called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 326
Mojo::IOLoop::ReadWriteProcess::_fork(Mojo::IOLoop::ReadWriteProcess=HASH(0x10026d4d8f8), CODE(0x1002649e648)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 488
Mojo::IOLoop::ReadWriteProcess::start(Mojo::IOLoop::ReadWriteProcess=HASH(0x10026d4d8f8)) called at /usr/lib/os-autoinst/autotest.pm line 298
autotest::start_process() called at /usr/bin/isotovideo line 261

Actions #6

Updated by bchou about 2 years ago

After a series of investigations and discussions, the problem is confirmed as the permission problem.
Submit a PR can be workaround the issue. https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/14193
Still need to wait for the bug update from the developer to decide the PR will be merged or not.
Refer to bug 1195620 - [Build 91.2] The permission of device '/dev/tty*' is changed to '1154' after login it. https://bugzilla.suse.com/show_bug.cgi?id=1195620

Actions #7

Updated by bchou about 2 years ago

There are a series of cases are from the same dependency and got the permission denied problem.

https://openqa.suse.de/tests/8114241#dependencies

Actions #8

Updated by bchou about 2 years ago

  • % Done changed from 0 to 50
  • Estimated time set to 16.00 h
Actions #9

Updated by llzhao about 2 years ago

New fail found on this case: Test died: no candidate needle with tag(s) 'user-console' matched found
https://openqa.suse.de/tests/8168998#step/curl_https/5
https://openqa.suse.de/tests/8169004#step/curl_https/5

Actions #11

Updated by bchou about 2 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 50 to 100

PR was merged and the issue was fixed.
https://openqa.suse.de/tests/8221910

Actions

Also available in: Atom PDF