Project

General

Profile

Actions

action #13646

open

Ensuring asset files integrity (was: "An error occurred during the installation" on images)

Added by okurz over 8 years ago. Updated almost 5 years ago.

Status:
Workable
Priority:
Low
Assignee:
-
Category:
Feature requests
Target version:
Start date:
2016-09-09
Due date:
% Done:

0%

Estimated time:

Description

user story

As a test reviewer I want to have checksums of asset files so that I can triage infrastructure/product/test issues in case the media seem to be corrupt

acceptance criteria

  • AC1: The checksum of asset files is reported when configured
  • AC2: No checksum checks of ISO files in general (too expensive)

suggestions

  • more checksum checks and such, maybe on the level of tests, not os-autoinst or openQA
  • don't sync images to o.s.d when rsync.pl can already know it's broken (or incomplete)

further details

There is a bug open in bugzilla bsc#994617 for the same symptoms and the bug reviewers judge it's an openQA issue. The issue is happening from time to time:


Related issues 2 (0 open2 closed)

Related to openQA Project (public) - action #35299: Potential corrupted file causing installation tests to failResolvedEDiGiacinto2018-04-20

Actions
Related to openQA Tests (public) - action #51743: [openqa] All LTP tests are failing on boot_ltp for openSUSE (o3) on [x86_64]Resolvedpvorel2019-05-21

Actions
Actions #1

Updated by okurz over 8 years ago

  • Description updated (diff)
  • Priority changed from Normal to High
Actions #2

Updated by okurz over 8 years ago

  • Project changed from openQA Tests (public) to openQA Project (public)
  • Description updated (diff)
Actions #4

Updated by coolo over 8 years ago

  • Status changed from New to Feedback

The same ISO worked fine here: https://openqa.suse.de/tests/569770 - so if the ARM worker has a problem with its NFS implementation, you better report that in bugzilla related to the host system. Does this happen on other workers as well?

Actions #5

Updated by okurz over 8 years ago

  • Description updated (diff)

It does not look like we have seen this error on other workers so far. As can be seen in the description this issue was originally reported in bugzilla and we are playing ping-pong here. I should have kept the bugzilla bug open and just change the product and component to refer to test infrastructure I guess. I reopened bsc#994617 with the new information. Still, should we add more checksums or maybe we already have more checksums now or not on the used ISOs?

Actions #6

Updated by coolo about 8 years ago

  • Status changed from Feedback to New
  • Priority changed from High to Low

I don't want checksums of ISOs in general - it's pretty expensive and it would only be a measure to debug NFS implementations. We can potentionally add a workers.ini setting, but not on high prio

Actions #7

Updated by okurz almost 8 years ago

  • Subject changed from "An error occurred during the installation" on images to Ensuring asset files integrity (was: "An error occurred during the installation" on images)
  • Description updated (diff)
  • Category set to Feature requests
Actions #8

Updated by coolo about 7 years ago

  • Target version set to future
Actions #9

Updated by okurz over 6 years ago

  • Related to action #35299: Potential corrupted file causing installation tests to fail added
Actions #10

Updated by okurz over 6 years ago

  • Target version changed from future to future
Actions #11

Updated by andriinikitin almost 6 years ago

  • Category changed from Feature requests to 443
Actions #12

Updated by okurz over 5 years ago

  • Category changed from 443 to Feature requests
Actions #13

Updated by rpalethorpe almost 5 years ago

  • Related to action #51743: [openqa] All LTP tests are failing on boot_ltp for openSUSE (o3) on [x86_64] added
Actions #14

Updated by rpalethorpe almost 5 years ago

This would be very helpful in determining where problems happen:

Basically the following could be done:

1) Take sha256 hash of assets on the worker (maybe just for problem assets), create a sum file .sha256 which is uploaded with the asset
2) Check the hash after uploading and every other operation where an asset is moved or copied.

From what I can see there have been many bugs with the asset handling.

Actions #15

Updated by pvorel almost 5 years ago

+1 for this (but maybe allow to enable/disable with variable).

Actions #16

Updated by okurz almost 5 years ago

  • Status changed from New to Workable

obsrsync commonly handles sha256 files as well so we should be able to handle them more easily on worker side, e.g. a simple "check sha256 sum if exists for asset file" in the startup process of tests

Actions

Also available in: Atom PDF