action #61094

o3: cleanup of snapshot-changes

Added by okurz 2 months ago. Updated about 1 month ago.

Status:FeedbackStart date:17/12/2019
Priority:NormalDue date:
Assignee:andriinikitin% Done:

0%

Category:-
Target version:openQA Project - Current Sprint
Duration:

Description

Observation

ariel:/var/lib/openqa/share/factory # du -BM -d1
1M      ./tmp
377585M ./hdd
460845M ./iso
564647M ./repo
31157M  ./snapshot-changes
69747M  ./other
1503980M

so currently we have 31G for snapshot changes. We should have a cleanup strategy, asked DimStar in #opensuse-factory

History

#1 Updated by okurz 2 months ago

  • Status changed from New to Feedback
  • Assignee set to okurz
  • Target version set to Current Sprint
[17/12/2019 14:59:10] <DimStar> okurz: I'd say yes - certainly everything < 2019 is no longer needed (ever)
[17/12/2019 14:59:39] <DimStar> generally, it doesn't even make sense to keep more than 10 of the 'before the current' link ones
[17/12/2019 15:00:00] <DimStar> everything older is already as .txt on the download server
[17/12/2019 15:04:22] <okurz> cool, thx for the answer. So I will clean out manually once and we can then add a `find -mtime … -delete` in the scripts

did a manual rm $(ls | head -n -10).

https://gitlab.suse.de/openqa/scripts/merge_requests/425 for an automatic cleanup.

#2 Updated by okurz about 1 month ago

this triggered the problem that newer snapshot changes were not recorded anymore. Reverted for now with https://gitlab.suse.de/openqa/scripts/merge_requests/433

Instead of calling rm $(ls … | head -n -10) from top level I should probably do that when the perl code decends into the individual directories.

#3 Updated by okurz about 1 month ago

  • Assignee changed from okurz to andriinikitin

@andriinikitin as you are currently working on covering o3 with ObsRsync I guess it makes sense if you also take this ticket to keep in mind that "snapshot-changes" need to be covered as well which is currently triggered within rsync.pl . The task for this ticket is to ensure that older changelog files are eventually pruned.

Also available in: Atom PDF