A new request to upload a dataset to nf-core AWS S...
# request-coret
test datasets AWS S3 v2
04/07/2026, 1:19 PMA new request to upload a dataset to nf-core AWS S3 bucket has been made!
• Requested by: @Benjamin Wehnert
• Pipeline name: nf-core/deepmutscan
• Why is this needed?: All .fastq.gz files will be used for full size AWS tests for the deepmutscan pipeline: https://github.com/nf-core/deepmutscan
• Size of the dataset: 5.51 GB
• URL: https://www.ebi.ac.uk/ena/browser/view/PRJEB110196
• Related files:
Core team will add this dataset to the nf-core bucket. Please react to the message with ✅ when this is done.
[This process is not automated]
party this 1
b
Benjamin Wehnert
04/07/2026, 1:48 PMsorry, I was wrong about the size of the dataset: It’s roughly 60 GB.
👍 1
p
Phil Ewels
04/07/2026, 2:46 PMNote that not all pipelines mirror their data for full size test datasets, many just have the ENA paths configured directly
Phil Ewels
04/07/2026, 2:47 PMWe mirrored some (such as #CE8SSJV3N) that get run a lot and/or have had repeated problems pulling from ENA. But if possible it's better to pull directly so that we don't have to pay for storage + egress.
Phil Ewels
04/07/2026, 2:47 PMHave you tried configuring the pipeline directly to work with the ENA?
m
Max Stammnitz
04/07/2026, 2:50 PM@Benjamin Wehnert can you check? Should be fine to use/pull from the ENA paths directly
🙏 1
🙏🏻 1
b
Benjamin Wehnert
04/07/2026, 4:11 PMAh that’s very good to know, thanks! I’ve opened a new PR for nf-core/test-datasets to merge in the new samplesheet with all paths
👍 1
✅ 1
2 Views