Hey! In case you haven't seen it, the full size re...
# bacass
r
Hey! In case you haven't seen it, the full size release test failed: https://cloud.seqera.io/orgs/nf-core/workspaces/AWSmegatests/watch/S4FTJJjJfkdbZ Seems to be something with unicycler and fusion @Florian Wuennemann you looked into that recently, right?
✔️ 1
d
Hi @Rike Hanssen, do you mean that the
-profile test_full
failed? I just ran it and it worked for me (although it took a long time to finish).
Copy code
nextflow run nf-core/bacass -r dev \
    -profile test_full,docker \
    --outdir results \
    -resume
r
can you run it with the tagged release that is used in the linked run?
f
Thanks for pinging me @Rike Hanssen! I did have issues with unicycler in nf-core/viralrecon as well. I believe the failing Megatests might be due to the interaction of Unicycler and FUSION, this was what caused the problem in viralrecon. I am not 100% sure this is the same error yet, but will test the bacass test on our end with the fix to see if that works! The temporary fix for viralrecon when running with FUSION was to specify an exception for unicycler:
Copy code
withName:UNICYCLER {
        scratch = true
    }
@Simon Pearce and I also just updated the unicycler module to the newest version, which might also fix this issue: https://github.com/nf-core/modules/pull/5544#event-13205731695 So I see 3 options: 1) we add the exception to the Megatests to make it pass (but it will still fail for people using this configuration with FUSION on their end), 2) We introduce the fix into the config when using unicycler 3) We check whether updating the unicycler module fixes this issue and make a quick patch for bacass and viralrecon
d
can you run it with the tagged release that is used in the linked run?
Sorry, I cannot access the URL. It says "Organization with the name 'nf-core' not found". Which version of nf-core/bacass are you using?
f
@Daniel_VM This is the git revision commit that @Rike Hanssen mentioned:
d230ebf3d77e030bdcd0d002ef082a3870c68d99
which is version 2.3.0
r
Copy code
nextflow run nf-core/bacass -r <release number> \
    -profile test_full,docker \
    --outdir results \
    -resume
d
Awesome, running this revision now. Thanks. I am going to open an issue to update
local/unicycler
to
nf-core/unicycler
to avoid potential versioning issues, as stated in the PR. 😉
🥳 1
party parrot 2
f
Quick update from my test. I relaunched the Megatest adding:
Copy code
process {
    withName:UNICYCLER {
        scratch = true
    }
}
To make unicycler use scratch with FUSION. The execution log for Unicycler didn't load and the run was still "running" after 53 minutes, so I canceled it, thinking something was up. After cancelling, the unicycler logs started appearing, so it seems that with scratch it just really takes that long to run unicycler on this test data? 🤷
@Daniel_VM Can you comment on runtimes for unicycler for these tests?
d
Sure. I was surprised that the
nf-core/bacass
test_full
profile took so long. Once I finish running version 2.3.0 (
-r 2.3.0
), I'll let you know the run times. 👍
f
I can confirm that the fix for FUSION with
scratch = true
fixes the AWS Megatest issue @Rike Hanssen https://cloud.seqera.io/orgs/nf-core/workspaces/AWSmegatests/watch/hcogCMTmp0NIj The total runtime with this fix for Megatests was 1h 2 m 4s!
r
ok great, thanks @Florian Wuennemann. So then things are fixed for now and the updated unicycler should fix it for the next release automatically, right?
f
I will have to test with the new unicycler and FUSION to make sure that fixes it. If the new version doesn't fix it, we would have to build in the scratch = true for the unicycler process exclusively to fix it for FUSION based runs.
d
Hii!
-profile test_full
took 5h to complete 🥴 . I attach the execution timeline. Notably, Unicycler (sample SRR10093029) alone took 1h 37min.
I think that
NFCORE_BACASS:BACASS:KRAKEN2_DB_PREPARATION (k2_standard_8gb_20210517)
causes the time consumption... I found in
.nextflow.log
an active node for more than 3h 🤔
r
I am not particularly concerned about the time. These tests are there to mimic a real life scenario.
it's good that it passes locally. and now it has also passed on awsmegatests. For the next release, be sure to pull in the unicycler update so we can be sure it passes on the cloud as well 🙂
d
Great 👍