Project

General

Profile

action #13646

Ensuring asset files integrity (was: "An error occurred during the installation" on images)

Added by okurz almost 5 years ago. Updated over 1 year ago.

Status:
Workable
Priority:
Low
Assignee:
-
Category:
Feature requests
Target version:
Start date:
2016-09-09
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

user story

As a test reviewer I want to have checksums of asset files so that I can triage infrastructure/product/test issues in case the media seem to be corrupt

acceptance criteria

  • AC1: The checksum of asset files is reported when configured
  • AC2: No checksum checks of ISO files in general (too expensive)

suggestions

  • more checksum checks and such, maybe on the level of tests, not os-autoinst or openQA
  • don't sync images to o.s.d when rsync.pl can already know it's broken (or incomplete)

further details

There is a bug open in bugzilla bsc#994617 for the same symptoms and the bug reviewers judge it's an openQA issue. The issue is happening from time to time:


Related issues

Related to openQA Project - action #35299: Potential corrupted file causing installation tests to failResolved2018-04-20

Related to openQA Tests - action #51743: [openqa] All LTP tests are failing on boot_ltp for openSUSE (o3) on [x86_64]Resolved2019-05-21

History

#1 Updated by okurz almost 5 years ago

  • Description updated (diff)
  • Priority changed from Normal to High

#2 Updated by okurz almost 5 years ago

  • Project changed from openQA Tests to openQA Project
  • Description updated (diff)

#4 Updated by coolo almost 5 years ago

  • Status changed from New to Feedback

The same ISO worked fine here: https://openqa.suse.de/tests/569770 - so if the ARM worker has a problem with its NFS implementation, you better report that in bugzilla related to the host system. Does this happen on other workers as well?

#5 Updated by okurz almost 5 years ago

  • Description updated (diff)

It does not look like we have seen this error on other workers so far. As can be seen in the description this issue was originally reported in bugzilla and we are playing ping-pong here. I should have kept the bugzilla bug open and just change the product and component to refer to test infrastructure I guess. I reopened bsc#994617 with the new information. Still, should we add more checksums or maybe we already have more checksums now or not on the used ISOs?

#6 Updated by coolo over 4 years ago

  • Status changed from Feedback to New
  • Priority changed from High to Low

I don't want checksums of ISOs in general - it's pretty expensive and it would only be a measure to debug NFS implementations. We can potentionally add a workers.ini setting, but not on high prio

#7 Updated by okurz over 4 years ago

  • Subject changed from "An error occurred during the installation" on images to Ensuring asset files integrity (was: "An error occurred during the installation" on images)
  • Description updated (diff)
  • Category set to Feature requests

#8 Updated by coolo over 3 years ago

  • Target version set to future

#9 Updated by okurz over 3 years ago

  • Related to action #35299: Potential corrupted file causing installation tests to fail added

#10 Updated by okurz about 3 years ago

  • Target version changed from future to future

#11 Updated by andriinikitin over 2 years ago

  • Category changed from Feature requests to 443

#12 Updated by okurz about 2 years ago

  • Category changed from 443 to Feature requests

#13 Updated by rpalethorpe over 1 year ago

  • Related to action #51743: [openqa] All LTP tests are failing on boot_ltp for openSUSE (o3) on [x86_64] added

#14 Updated by rpalethorpe over 1 year ago

This would be very helpful in determining where problems happen:

Basically the following could be done:

1) Take sha256 hash of assets on the worker (maybe just for problem assets), create a sum file .sha256 which is uploaded with the asset
2) Check the hash after uploading and every other operation where an asset is moved or copied.

From what I can see there have been many bugs with the asset handling.

#15 Updated by pvorel over 1 year ago

+1 for this (but maybe allow to enable/disable with variable).

#16 Updated by okurz over 1 year ago

  • Status changed from New to Workable

obsrsync commonly handles sha256 files as well so we should be able to handle them more easily on worker side, e.g. a simple "check sha256 sum if exists for asset file" in the startup process of tests

Also available in: Atom PDF