action #64809
Updated by mkittler about 4 years ago
## Observation Worker uploads some text results possibly multiple times. I've created the following change track result uploads (and their size): https://github.com/os-autoinst/openQA/compare/master...Martchus:log-size-accounting?expand=1 With this modification one can see lots of duplicated uploads in the web UI log. I used the following command with the web UI log from a local test run: log, e.g. ``` sort webui-log-job-1260-opensuse-15.1-DVD-Updates-x86_64-Build20200321-1-gnome@uefi.log | uniq -d | grep -i accounting ``` (The log file is attached.) ## Problem This wastes resources mainly network bandwidth, increased disk I/O on the web UI host and time. ## Expected result Every result is only uploaded once unless a retry is necessary due to transfer problems. ## Suggestions * Investigate provided log files * Reproduce locally * Ensure there is no duplicate upload, e.g. – if necessary – apply the same hash lookup algorithm as for screenshots ## Notes / suggestion For screenshots the web UI provides the worker with a list of known screenshot MD5 sums to avoid this. A similar mechanism could be implemented for text results.