Rike Hanssen
06/19/2024, 8:06 AMDaniel_VM
06/19/2024, 12:20 PM-profile test_full failed? I just ran it and it worked for me (although it took a long time to finish).
nextflow run nf-core/bacass -r dev \
-profile test_full,docker \
--outdir results \
-resumeRike Hanssen
06/19/2024, 12:24 PMFlorian Wuennemann
06/19/2024, 12:30 PMwithName:UNICYCLER {
scratch = true
}
@Simon Pearce and I also just updated the unicycler module to the newest version, which might also fix this issue: https://github.com/nf-core/modules/pull/5544#event-13205731695
So I see 3 options:
1) we add the exception to the Megatests to make it pass (but it will still fail for people using this configuration with FUSION on their end),
2) We introduce the fix into the config when using unicycler
3) We check whether updating the unicycler module fixes this issue and make a quick patch for bacass and viralreconDaniel_VM
06/19/2024, 1:35 PMcan you run it with the tagged release that is used in the linked run?Sorry, I cannot access the URL. It says "Organization with the name 'nf-core' not found". Which version of nf-core/bacass are you using?
Florian Wuennemann
06/19/2024, 1:36 PMd230ebf3d77e030bdcd0d002ef082a3870c68d99 which is version 2.3.0Rike Hanssen
06/19/2024, 1:36 PMnextflow run nf-core/bacass -r <release number> \
-profile test_full,docker \
--outdir results \
-resumeDaniel_VM
06/19/2024, 1:44 PMlocal/unicycler to nf-core/unicycler to avoid potential versioning issues, as stated in the PR. 😉Florian Wuennemann
06/19/2024, 1:47 PMprocess {
withName:UNICYCLER {
scratch = true
}
}
To make unicycler use scratch with FUSION. The execution log for Unicycler didn't load and the run was still "running" after 53 minutes, so I canceled it, thinking something was up. After cancelling, the unicycler logs started appearing, so it seems that with scratch it just really takes that long to run unicycler on this test data? 🤷Florian Wuennemann
06/19/2024, 1:47 PMDaniel_VM
06/19/2024, 1:54 PMnf-core/bacass test_full profile took so long. Once I finish running version 2.3.0 (-r 2.3.0), I'll let you know the run times. 👍Florian Wuennemann
06/19/2024, 3:35 PMscratch = true fixes the AWS Megatest issue @Rike Hanssen
https://cloud.seqera.io/orgs/nf-core/workspaces/AWSmegatests/watch/hcogCMTmp0NIj
The total runtime with this fix for Megatests was 1h 2 m 4s!Rike Hanssen
06/19/2024, 3:38 PMFlorian Wuennemann
06/19/2024, 3:40 PMDaniel_VM
06/20/2024, 8:33 AM-profile test_full took 5h to complete 🥴 . I attach the execution timeline. Notably, Unicycler (sample SRR10093029) alone took 1h 37min.Daniel_VM
06/20/2024, 8:41 AMNFCORE_BACASS:BACASS:KRAKEN2_DB_PREPARATION (k2_standard_8gb_20210517) causes the time consumption... I found in .nextflow.log an active node for more than 3h 🤔Rike Hanssen
06/20/2024, 8:42 AMRike Hanssen
06/20/2024, 8:43 AMDaniel_VM
06/20/2024, 8:46 AM