Does the 1.0 release support submitting co-assembl...
# seqsubmit
j
Does the 1.0 release support submitting co-assemblies or is that still to come?
e
not yet, there is PR github.com/nf-core/seqsubmit/pull/66 you can potentially try from that branch maybe @Sofiia Ochkalova knows better
@Jim Downie have you uploaded your reads already? I remember you said you need to do it first
j
I still need to finish doing that - it got stalled as the ENA upload server went down and I went on paternity leave
👨‍🍼 1
Perchance do you know what happens if you try to upload reads that you've already uploaded? Not exactly sure where the thing stalled to re-start the upload!
e
I think we never tried it.. maybe you will just get a new ERR accession. I would recommend contact ENA and ask them to give you all data from you webin account. It is very easy for them. Then you can see what went through and what not
👍 1
let us know when you would be ready with reads. We can try to speedup that PR. Initial work was done, we need to tune it a bit
j
I will try and get the uploading started again this week - it needs finishing as we just re-submitted the paper after review. It will take quite a while - we did a back-of-the-envelope estimate and we have nominally got ~17 terabases of sequencing data to upload
😳 2
(95-99% of it unwanted host reads 😂😂😂)
e
do you remove host before upload?
j
no
e
is host different? not human, right?
j
Oak trees (Quercus robur) for all samples. But different trees
👌 1
I'm not sure I have the host-filtered files any more in any case
s
I'm merging co-assembly branch with the latest dev. I'll check if it works and will come back to you. You can try this branch directly, it calculates coverage incorrectly at the moment, but you don't need this feature anyway AFAIR One thing to consider: For each co-assembly all included source samples should have the same metagenome field name in ENA, e.g. "tree metagenome". Otherwise pipeline will fail. It's possible to set a value via parameter, but it will be applied to all assemblies in the samplesheet
🙌 1
j
Amazing! I will finish getting the reads uploaded and then let you know how it goes
s
Hi Jim I've tested the branch, seems to be fine You can try to upload once you're done with reads 😃
❤️ 1
🌟 1
j
Perchance do you know what happens if you try to upload reads that you’ve already uploaded? Not exactly sure where the thing stalled to re-start the upload!
FYI: Using Webin-CLI, uploading a previously-uploaded manifest file just exits cleanly! Might require the output files to be in place already, though.
s
Yes, there is actually a inconsistent behaviour bug in this tool 😅 If the data is uploaded and output files are there - it exists cleanly, if the data is uploaded but output files are deleted - it fails with error I'm glad it worked for you 👍
🙌 1
j
Have you ever seen an error about an invalid username/password? I am getting intermittent failures that seem to disappear on a retry with an identical command...
😢 1
s
Yes... It happens when you overload their submission system
How many reads you are trying to upload at once?
j
I have 200+ manifest files, each which describes 2 read FASTQs (fwd/rev)
s
Well, it's not many, should be fine thinker
j
Currently traversing them with:
Copy code
ls *.manifest | xargs Webin-Cli
s
Never used xargs for this, maybe it's too fast? 🤔 Or ENA server just not feeling well today
j
It wasn't having the same problem a couple months ago when I was last doing this :( So maybe it's just the server
💯 1
s
I would try again tomorrow