action #13646

Ensuring asset files integrity (was: "An error occurred during the installation" on images)

Added by okurz over 3 years ago. Updated about 1 month ago.

Status:NewStart date:09/09/2016
Priority:LowDue date:
Assignee:-% Done:

0%

Category:Feature requests
Target version:QA - future
Difficulty:
Duration:

Description

user story

As a test reviewer I want to have checksums of asset files so that I can triage infrastructure/product/test issues in case the media seem to be corrupt

acceptance criteria

  • AC1: The checksum of asset files is reported when configured
  • AC2: No checksum checks of ISO files in general (too expensive)

suggestions

  • more checksum checks and such, maybe on the level of tests, not os-autoinst or openQA
  • don't sync images to o.s.d when rsync.pl can already know it's broken (or incomplete)

further details

There is a bug open in bugzilla bsc#994617 for the same symptoms and the bug reviewers judge it's an openQA issue. The issue is happening from time to time:


Related issues

Related to openQA Project - action #35299: Potential corrupted file causing installation tests to fail Resolved 20/04/2018
Related to openQA Tests - action #51743: [openqa] All LTP tests are failing on boot_ltp for openSU... Resolved 21/05/2019

History

#1 Updated by okurz over 3 years ago

  • Description updated (diff)
  • Priority changed from Normal to High

#2 Updated by okurz over 3 years ago

  • Project changed from openQA Tests to openQA Project
  • Description updated (diff)

#4 Updated by coolo over 3 years ago

  • Status changed from New to Feedback

The same ISO worked fine here: https://openqa.suse.de/tests/569770 - so if the ARM worker has a problem with its NFS implementation, you better report that in bugzilla related to the host system. Does this happen on other workers as well?

#5 Updated by okurz over 3 years ago

  • Description updated (diff)

It does not look like we have seen this error on other workers so far. As can be seen in the description this issue was originally reported in bugzilla and we are playing ping-pong here. I should have kept the bugzilla bug open and just change the product and component to refer to test infrastructure I guess. I reopened bsc#994617 with the new information. Still, should we add more checksums or maybe we already have more checksums now or not on the used ISOs?

#6 Updated by coolo about 3 years ago

  • Status changed from Feedback to New
  • Priority changed from High to Low

I don't want checksums of ISOs in general - it's pretty expensive and it would only be a measure to debug NFS implementations. We can potentionally add a workers.ini setting, but not on high prio

#7 Updated by okurz about 3 years ago

  • Subject changed from "An error occurred during the installation" on images to Ensuring asset files integrity (was: "An error occurred during the installation" on images)
  • Description updated (diff)
  • Category set to Feature requests

#8 Updated by coolo over 2 years ago

  • Target version set to future

#9 Updated by okurz almost 2 years ago

  • Related to action #35299: Potential corrupted file causing installation tests to fail added

#10 Updated by okurz over 1 year ago

  • Target version changed from future to future

#11 Updated by andriinikitin 12 months ago

  • Category changed from Feature requests to 443

#12 Updated by okurz 8 months ago

  • Category changed from 443 to Feature requests

#13 Updated by rpalethorpe about 1 month ago

  • Related to action #51743: [openqa] All LTP tests are failing on boot_ltp for openSUSE (o3) on [x86_64] added

#14 Updated by rpalethorpe about 1 month ago

This would be very helpful in determining where problems happen:

Basically the following could be done:

1) Take sha256 hash of assets on the worker (maybe just for problem assets), create a sum file .sha256 which is uploaded with the asset
2) Check the hash after uploading and every other operation where an asset is moved or copied.

From what I can see there have been many bugs with the asset handling.

#15 Updated by pvorel about 1 month ago

+1 for this (but maybe allow to enable/disable with variable).

Also available in: Atom PDF