A new request to upload a dataset to nf-core AWS S...
# request-core
t
A new request to upload a dataset to nf-core AWS S3 bucket has been made! • Requested by: @Ekaterina Sakharova • Pipeline name: seqsubmit • Why is this needed?: seqsubmit tests • Size of the dataset: not too big • URL: https://github.com/nf-core/test-datasets/tree/seqsubmit/samplesheets https://github.com/nf-core/test-datasets/tree/seqsubmit/test_data • Related files: Core team will add this dataset to the nf-core bucket. Please react to the message with ✅ when this is done. [This process is not automated]
r
Looking at this data, is it the same as for the small tests?
e
yes
r
is there any real life data we can use here instead?
e
what does it mean real life data?
r
something representative of a real run, so a) we can see that the pipeline holds up on actual data and not tiny tests b) users can look at actual results on the website to see if the pipeline is suitable for their task. IDeally the full size data should be somewhat real-life like from a public data source
e
github.com/nf-core/test-datasets/blob/…/ecoli.fna.gz this is real genome for example and that organism bins are also real (it has organism name even) github.com/nf-core/test-datasets/blob/…/bin_lachnospiraceae.fa.gz used by full test samplesheet github.com/nf-core/test-datasets/blob/…/mag_complete_metadata.csv
Do I need to add that data to AWS S3 at all? it is on test-datasets repo already. It should be enough?
r
is this the datasize you will normally run this pipeline on
e
yes, FASTAs can be different 🤷‍♀️ it should be just more than 1 contig in fasta file. other things are not very important for pipeline. It just uploads what user provides, no judgement to the data