Project

General

Profile

action #69637

Updated by okurz over 3 years ago

## Motivation 

 The chunked asset uploader we use to move assets from workers to the webui is extremely inefficient. This is especially noticeable when worker and webui are running on the same host and very large assets have to be uploaded. This has been a big problem with SUSE Manager for Retail tests, to the point where an optimization could save multiple hours per day. 
 A similar problem has been reported by "marmarek" in [#opensuse-factory](irc://chat.freenode.net/opensuse-factory) 

 ## Acceptance criteria 
 * **AC1:** Asset upload on "localhost" (worker and webui on same machine) is significantly faster, e.g. ask marmarek for verification in his environment 
 * **AC2:** Asset upload on non-localhost workers still use remote upload methods with no significant performance degradation 

 ## Suggestions 

 * Try to add a "secondary code path" to just move files between local folders (regardless if same or differing filesystem) on the same machine instead of uploading them completely via HTTP

Back