https://nf-co.re logo
Join Slack
Powered by
I’ve noticed that only files in the `pipeline_info...
# infrastructure
j
I’ve noticed that only files in the 
pipeline_info/
directory of the preview for AWS results of #viralmetagenome are still available, all other files are no longer available (just on AWS in general). Do they get deleted after while or what happened here?
p
Nope, they shouldn't be
Are you sure that they were definitely there before?
j
I’ve definitely checked with v1.0.0 (there they all were) but am not 100% certain I also checked with v1.0.1, but you’ve to admit it’s weird that only 
pipeline_info
is there.
p
Not that weird, that often happens if the pipeline run fails / crashes
It includes the log files and trace files etc. that get created very early on
👍 1
I also just noticed that #C0905QCFTPE is breaking the website build, so my money is on a bug in the pipeline code sorry 😬
😬 1
Hmm, the pipeline run on Platform looks fine though
Full size tests can be triggered manually, so I just kicked off a run for v1.0.1 again: https://github.com/nf-core/viralmetagenome/actions/runs/20849019456
Can keep a closer eye on it now, as it's fresh and the intermediate files / logs etc. won't yet be deleted
Just looking at your original link a bit closer - the directories are there, but not the files?
ok that is weird
Ignore this, I rebuilt and it worked so maybe a temporary glitch
Files seem to be showing up on s3 now, from the new run
🎉 1
I guess we wait until it finishes - confirm that all files are definitely there as expected, then if they start to vanish again in a few weeks we can investigate more
j
Awesome, files are now there! thanks @Phil Ewels
p
Yup, now wait and see if they stay being there! 😅
🤞 1
2 Views
Open in Slack
PreviousNext
Powered by