Project

General

Profile

action #119767

Updated by okurz over 1 year ago

## Observation 

 https://gitlab.suse.de/openqa/salt-states-openqa/-/jobs/1217506 

 ``` 
 Retrieving: os-autoinst-4.6.1666985981.c33e9ef-1421.1.x86_64.rpm [not found] 
 Abort, retry, ignore? [a/r/i/...? shows all options] (a): a 
 [ERROR     ] stderr: File './x86_64/os-autoinst-4.6.1666985981.c33e9ef-1421.1.x86_64.rpm' not found on medium 'http://download.opensuse.org/repositories/devel:/openQA/openSUSE_Tumbleweed/' 
 Problem occurred during or after installation or removal of packages: 
 Installation has been aborted as directed. 
 Please see the above error message for a hint. 
 [ERROR     ] retcode: 8 
 [ERROR     ] An error was encountered while installing package(s): Zypper command failure: File './x86_64/os-autoinst-4.6.1666985981.c33e9ef-1421.1.x86_64.rpm' not found on medium 'http://download.opensuse.org/repositories/devel:/openQA/openSUSE_Tumbleweed/' 
 Problem occurred during or after installation or removal of packages: 
 Installation has been aborted as directed. 
 … 
           ID: worker.packages 
     Function: pkg.installed 
       Result: False 
      Comment: Attempt 1: Returned a result of "False", with the following comment: "An error was encountered while installing package(s): Zypper command failure: File './x86_64/os-autoinst-4.6.1666985981.c33e9ef-1421.1.x86_64.rpm' not found on medium 'http://download.opensuse.org/repositories/devel:/openQA/openSUSE_Tumbleweed/' 
               Problem occurred during or after installation or removal of packages: 
               Installation has been aborted as directed. 
               Please see the above error message for a hint." 
               Attempt 2: Returned a result of "False", with the following comment: "An error was encountered while installing package(s): Zypper command failure: File './x86_64/os-autoinst-4.6.1666985981.c33e9ef-1421.1.x86_64.rpm' not found on medium 'http://download.opensuse.org/repositories/devel:/openQA/openSUSE_Tumbleweed/' 
               Problem occurred during or after installation or removal of packages: 
               Installation has been aborted as directed. 
               Please see the above error message for a hint." 
               Attempt 3: Returned a result of "False", with the following comment: "An error was encountered while installing package(s): Zypper command failure: File './x86_64/os-autoinst-4.6.1666985981.c33e9ef-1421.1.x86_64.rpm' not found on medium 'http://download.opensuse.org/repositories/devel:/openQA/openSUSE_Tumbleweed/' 
               Problem occurred during or after installation or removal of packages: 
               Installation has been aborted as directed. 
               Please see the above error message for a hint." 
               Attempt 4: Returned a result of "False", with the following comment: "An error was encountered while installing package(s): Zypper command failure: File './x86_64/os-autoinst-4.6.1666985981.c33e9ef-1421.1.x86_64.rpm' not found on medium 'http://download.opensuse.org/repositories/devel:/openQA/openSUSE_Tumbleweed/' 
               Problem occurred during or after installation or removal of packages: 
               Installation has been aborted as directed. 
               Please see the above error message for a hint." 
               An error was encountered while installing package(s): Zypper command failure: File './x86_64/os-autoinst-4.6.1666985981.c33e9ef-1421.1.x86_64.rpm' not found on medium 'http://download.opensuse.org/repositories/devel:/openQA/openSUSE_Tumbleweed/' 
               Problem occurred during or after installation or removal of packages: 
               Installation has been aborted as directed. 
               Please see the above error message for a hint. 
 ``` 

 Retried the pipeline for now: https://gitlab.suse.de/openqa/salt-states-openqa/-/jobs/1222315 

 ## Acceptance criteria 
 * **AC1:** Pipeline passes again 
 * **AC2:** It is known why the pipeline failed 

 ## Suggestions 
 * Read the git history of what changes we applied in the past to the package installations 
 * We already have instructed salt to call zypper multiple times for retry. But it looks like the repository data is not refreshed between each call. So we need to ensure that also the refreshing is done multiple times. In https://gitlab.suse.de/openqa/salt-states-openqa/-/blob/master/openqa/server.sls#L8 we say "refresh: False" to save time but here it does not help us. So we should check if we change back to refresh how long it takes in comparison. 
 * Maybe we can find something that only applies the refresh where it's actually necessary, e.g. split the repo statements for devel:openQA and do explicit refresh there, but not in other cases 
 * Make sure to comment explicitly why certain things are done, e.g. why we would need a refresh 
 * Conduct simple benchmark to find out what the impact of no-refresh vs. refresh vs. salt-default is in the gitlab CI pipeline and applying of state 
 * According to salt docs the salt-default and not specifying should ensure that refresh is only done once but okurz doubts this works so needs to be verified, e.g. check salt with debug log level output

Back