action #120720
opencoordination #68794: [qe-core][functional][epic] rework postfail hooks
[qe-core] Use Utils::Logging::save_ulog to redefine upload_logs in opensusebasetest
0%
Description
In order for us to shed some time when uploading logs, we can directly cat the logs to the serial console, using script_output and save the contents to the ulogs/ directory in the worker's pool directory, which os-autoinst will upload at the end of the test
This will allow us to save a lot of time and avoid problems with typing when the host is under heavy load.
Tasks¶
- Modify
save_and_upload_logandtar_and_upload_logsto usesave_uloginstead ofupload_logs - Allow a
force_uploadflag, so corner cases can be considered
Suggestions¶
Acceptance Criteria¶
- AC1: os-autoinst uploads the logs properly
- AC2: Binary files can be used/viewed properly (images, tar files, executables)
- AC3: Large files (500MB) can be uploaded too
Updated by szarate over 1 year ago
- Subject changed from Use Utils::Logging::save_ulog to redefine upload_logs in opensusebasetest to [qe-core] Use Utils::Logging::save_ulog to redefine upload_logs in opensusebasetest
Updated by szarate over 1 year ago
- Copied to action #120735: [qe-core] PoC: Decrease typing on `post_fail_hooks` log collection added
Updated by szarate over 1 year ago
- Sprint changed from QE-Core: November Sprint (Nov 09 - Dec 07) to QE-Core: December Sprint (Dec 07 - Jan 04)
Updated by szarate over 1 year ago
- Sprint changed from QE-Core: December Sprint (Dec 07 - Jan 11) to QE-Core: January Sprint (Jan 11 - Feb 08)
Updated by dvenkatachala over 1 year ago
- Status changed from Workable to In Progress
Updated by szarate over 1 year ago
- Related to action #120723: [qe-core] Guarantee `show_tasks_in_blocked_state` will always be called added
Updated by dvenkatachala about 1 year ago
Modified the functions in lib/Utils/Logging.pm to save the logs in ulogs directory. All files are getting uploaded except the tar files when the test fails. Currently I am working on it.
Updated by szarate about 1 year ago
- Sprint changed from QE-Core: January Sprint (Jan 11 - Feb 08) to QE-Core: February Sprint (Feb 08 - Mar 08)
Updated by dvenkatachala about 1 year ago
I tried to modify the save_and_upload_log function call in the libs/Utils/logging.pm to save logs in the ulogs directory of the worker's pool.
As suggested in the ticket, I modified the function save_and_upload_log to directly cat the logs to the serial console, using script_output and save the contents to the ulogs/ directory in the worker's pool.
This solution works fine for txt file with limited size. With this approach I think there is not much time saving compared with the existing code(verified with single test run)
However in this method cat commands hangs up when there is text/tar file with large size(for e.g., 100MB)
I would suggest to copy the log files directly to worker's pool instead of cat and save the contents.
Updated by dvenkatachala about 1 year ago
- Status changed from In Progress to Feedback