Has anyone used bbnorm successfully for a large co...
# mag
d
Has anyone used bbnorm successfully for a large co-assembly? I am wondering if there is a bug with how paired reads are being handled when a single group is defined multiple samples, including the merged reads ... the process seems to hang after awhile while not outputting an error code. However, further reading suggests this may be expected behaviour to output a single interleaved file ... so it could be something with our HPC causing an issue. This was a challenge to troubleshoot as no log file is being written in the work directory for the process, just the command.run and command.sh files. It's also possible there is an I/O issue with the size of the dataset. However, I can log into the node and see there is no cpu utilization and ps aux shows this: java -ea -Xmx3040g -Xms3040g -cp /opt/conda/opt/bbmap-39.18-0/current/ jgi.KmerNormalize bits=32 in=BF_LCH_8_2023.fastq.gz,BF_LCH_18_2024_Sep_R2.fastq.gz,BF_LCH_12_2023.fastq.gz,BF_LCH_17_2024_Sep_R1.fastq.gz,BF_LCH_19_2024_Sep_R1.fastq.gz,BF_LCH_17_2024_Sep_R2.fastq.gz,BF_LCH_19_2024_Sep_R2.fastq.gz,BF_LCH_18_2024_Sep_R3.fastq.gz,BF_LCH_18_2024_Sep_R1.fastq.gz,BF_LCH_19_2024_Sep_R3.fastq.gz,BF_LCH_17_2024_Sep_R3.fastq.gz,BF_LCH_20_2024_Nov_R1.fastq.gz,BF_LCH_20_2024_Nov_R2.fastq.gz,BF_LCH_21_2024_Nov_R3.fastq.gz,BF_LCH_21_2024_Nov_R1.fastq.gz,BF_LCH_21_2024_Nov_R2.fastq.gz,BF_LCH_22_2024_Nov_R3.fastq.gz,BF_LCH_22_2024_Nov_R2.fastq.gz,BF_LCH_20_2024_Nov_R3.fastq.gz,BF_LCH_4_2023.fastq.gz,BF_LCH_22_2024_Nov_R1.fastq.gz out=group1.fastq.gz target=100 min=5 threads=64 -Xmx3040g
I've been tinkering with this more and it seems even if the dataset is chunked, BBnorm seems to hang after a certain amount of processing and doesn't complete execution.