Concerning: > Is there a way to automatically i...
# team-maintainers
m
Concerning:
Is there a way to automatically identify data files that have never been used, so we can clean them to save costs
From the meeting minutes: why not simply check all referenced test data in modules and compare with the files on the modules branch?
s
Yeah, that would be my suggestion.
j
I guess in case people are using our test data outside of nf-core, not that we have to cater for them but I would rather do that first before nuking stuff
Also we would have to check against all pipelines too because I've seen some pipelines using those
m
I would check the commit history for the ones we would scrape to find out why they were there in the first place. Not sure what you are suggesting to do before "nuking stuff"
j
Basically @Famke Bäuerle suggested to reduce the size of test datasets to see if there is anything that was never used for anything. If they weren't, we can delete them. So the idea of there a way of seeing if a file/URL was ever 'touched' somehow (which no one did) then maybe we could do that clean up without upsetting invisible people
m
Yes, I got that. Github doesn't provide that kind of information.
👍 1
j
Not sure what you are suggesting to do before "nuking stuff"
Ah sorry may I didn't understand what you meant with?
s
But if our plan is to make a new repository entirely, we'll just freeze the current github branch as it is
j
Yes, this was a temporary measure like activateing git-lfs