I just created a PR: <https://github.com/nf-core/a...
# ampliseq
d
I just created a PR: https://github.com/nf-core/ampliseq/pull/931. On the command line, several tests failed in the summary report, but not consistently.
d
Oh uh that sounds bad. There is again a template update incoming, so while doing that I will run tests frequently again and will check as well. Any idea what it is related to? Not to the new database I guess...
d
It should not be the new database since that isn't used in any tests, I believe. In fact, I failed to test the new database since I ran out of memory when specifying this for the standard test.
😄 1
The message mentions a missing file. Wasn't there a discussion regarding something like this recently? If it's serious I suppose you'll run into it too.
Here's the long message:
Copy code
Assertion failed: 
  
  assert workflow.success
         |        |
         workflow false
  
  Nextflow stdout:
  
  ERROR ~ Error executing process > 'NFCORE_AMPLISEQ:AMPLISEQ:SUMMARY_REPORT (1)'
  
  Caused by:
    Process `NFCORE_AMPLISEQ:AMPLISEQ:SUMMARY_REPORT (1)` terminated with an error exit status (1)
  
  
  Command executed:
  
    #!/usr/bin/env Rscript
    library(rmarkdown)
    
    # Work around  <https://github.com/rstudio/rmarkdown/issues/1508>
    # If the symbolic link is not replaced by a physical file
    # output- and temporary files will be written to the original directory.
    file.copy("./report_template.Rmd", "./template.Rmd", overwrite = TRUE)
    
    rmarkdown::render("template.Rmd", output_file = "summary_report.html", params = list(css='nf-core_style.css',report_logo='nf-core-ampliseq_logo_light_long.png',workflow_manifest_version='2.16.0dev',workflow_scriptid='989f5de55d',report_title='Summary of analysis results',metadata='Metadata.tsv',input_samplesheet='Samplesheet.tsv',cutadapt_summary='cutadapt_summary.tsv',truncq=2,trunc_qmin=25,trunc_rmin=0.75,trunclenf='null',trunclenr='null',max_ee=2,dada_qc_f_path='FW_qual_stats.svg',dada_qc_r_path='RV_qual_stats.svg',dada_pp_qc_f_path='FW_preprocessed_qual_stats.svg',dada_pp_qc_r_path='RV_preprocessed_qual_stats.svg',dada_filtntrim_args='filterAndTrim.args.txt',dada_sample_inference='independent',dada_err_path='1_1.err.svg,1_2.err.svg',dada_err_run='1',asv_table_path='ASV_table.tsv',path_asv_fa='ASV_seqs.fasta',path_dada2_tab='DADA2_table.tsv',dada_stats_path='DADA2_stats.tsv',mergepairs_strategy='merge',path_barrnap_sum='summary.tsv',filter_ssu_stats='stats.ssu.tsv',filter_ssu_asv='ASV_seqs.ssu.fasta',filter_ssu='bac',min_len_asv=0,max_len_asv=0,dada_min_boot=50,pplace_taxonomy='test_pplace.taxonomy.tsv',pplace_heattree='test_pplace.heattree.tree.svg',qiime2_taxonomy='taxonomy.tsv',qiime2_ref_tax_title='Greengenes 16S - Version 13_8 - clustered at 85% similarity - for testing purposes only',qiime2_ref_tax_file='[<https://data.qiime2.org/2023.7/tutorials/training-feature-classifiers/85_otus.fasta>, <https://data.qiime2.org/2023.7/tutorials/training-feature-classifiers/85_otu_taxonomy.txt]',qiime2_ref_tax_citation='McDonald>, D., Price, M., Goodrich, J. et al. An improved Greengenes taxonomy with explicit ranks for ecological and evolutionary analyses of bacteria and archaea. ISME J 6, 610–618 (2012). <https://doi.org/10.1038/ismej.2011.139',val_used_taxonomy='phylogenetic> placement',filter_stats_tsv='count_table_filter_stats.tsv',qiime2_filtertaxa='276,48',exclude_taxa='mitochondria,chloroplast',min_frequency='10',min_samples='2',barplot=TRUE,abundance_tables=TRUE,diversity_indices_depth='WARNING\ The\ sampling\ depth\ of\ 500\ seems\ too\ small\ for\ rarefaction.txt',diversity_indices_alpha=TRUE,diversity_indices_beta='beta_diversity/unweighted_unifrac_distance_matrix-treatment1,beta_diversity/jaccard_distance_matrix-mix8,beta_diversity/bray_curtis_distance_matrix-treatment1,beta_diversity/jaccard_distance_matrix-treatment1,beta_diversity/weighted_unifrac_distance_matrix-treatment1,beta_diversity/weighted_unifrac_distance_matrix-mix8,beta_diversity/unweighted_unifrac_distance_matrix-mix8,beta_diversity/bray_curtis_distance_matrix-mix8',phyloseq='phyloseq/qiime2_phyloseq.rds,phyloseq/pplace_phyloseq.rds',tse='tse/qiime2_TreeSummarizedExperiment.rds,tse/pplace_TreeSummarizedExperiment.rds'), envir = new.env())
    
    writeLines(c("\"NFCORE_AMPLISEQ:AMPLISEQ:SUMMARY_REPORT\":",
        paste0("    R: ", paste0(R.Version()[c("major","minor")], collapse = ".")),
        paste0("    rmarkdown: ", packageVersion("rmarkdown")),
        paste0("    knitr: ", packageVersion("knitr")) ),
        "versions.yml")
  
  Command exit status:
    1
  
  Command output:
    [1] TRUE
    1/159                            
    2/159 [libraries]                
    3/159                            
    4/159 [setup]                    
    5/159                            
    6/159 [unnamed-chunk-1]          
    7/159                            
    8/159 [unnamed-chunk-2]          
    9/159                            
    10/159 [unnamed-chunk-3]          
    11/159                            
    12/159 [unnamed-chunk-4]          
    13/159                            
    14/159 [unnamed-chunk-5]          
    15/159                            
    16/159 [unnamed-chunk-6]          
    17/159                            
    18/159 [unnamed-chunk-7]          
    19/159                            
    20/159 [unnamed-chunk-8]          
    21/159 [!isFALSE(params$mqc_plot)]
  
  Command error:
    [1] TRUE
    
    
    processing file: template.Rmd
    1/159                            
    2/159 [libraries]                
    3/159                            
    4/159 [setup]                    
    5/159                            
    6/159 [unnamed-chunk-1]          
    7/159                            
    8/159 [unnamed-chunk-2]          
    9/159                            
    10/159 [unnamed-chunk-3]          
    11/159                            
    12/159 [unnamed-chunk-4]          
    13/159                            
    14/159 [unnamed-chunk-5]          
    15/159                            
    16/159 [unnamed-chunk-6]          
    17/159                            
    18/159 [unnamed-chunk-7]          
    19/159                            
    20/159 [unnamed-chunk-8]          
    21/159 [!isFALSE(params$mqc_plot)]
    
    Quitting from lines 256-262 [!isFALSE(params$mqc_plot)] (template.Rmd)
    Error in `file.exists()`:
    ! invalid 'file' argument
    Backtrace:
     1. base::file.exists(params$mqc_plot)
    Execution halted
  
  Work dir:
    /home/daluab/dev/nf-core-ampliseq/.nf-test/tests/c6949535cc2e539d759ad6735ccd5062/work/11/19aa79766d62b7c304e463224eac97
  
  Container:
    <http://quay.io/biocontainers/mulled-v2-b2ec1fea5791d428eebb8c8ea7409c350d31dada:a447f6b7a6afde38352b24c30ae9cd6e39df95c4-1|quay.io/biocontainers/mulled-v2-b2ec1fea5791d428eebb8c8ea7409c350d31dada:a447f6b7a6afde38352b24c30ae9cd6e39df95c4-1>
  
  Tip: you can try to figure out what's wrong by changing to the process work dir and showing the script file named `.command.sh`
  
   -- Check '/home/daluab/dev/nf-core-ampliseq/.nf-test/tests/c6949535cc2e539d759ad6735ccd5062/meta/nextflow.log' file for details
  ERROR ~ Pipeline failed. Please refer to troubleshooting docs: <https://nf-co.re/docs/usage/troubleshooting>
  
   -- Check '/home/daluab/dev/nf-core-ampliseq/.nf-test/tests/c6949535cc2e539d759ad6735ccd5062/meta/nextflow.log' file for details
  Nextflow stderr:
d
Oh no, yes I recently worked on that code, I seem to have introduced a bug. 😢
d
But it's funny, because it seems tests pass sometimes -- how would you have been able to merge your update otherwise?
d
The
file.exists(params$mqc_plot)
seems to be funny in your error message above.
Hm got the same error now on github when doing the template update. I can replicate the issue also locally. No idea why that is suddenly appearing.
MultiQC doesnt produce plots any more at all... that was always buggy, seems like its back 😱 Edit: or not... seems to be other stuff 😄
s
Hi! I have been running ampliseq on some samples for the past couple of months and today I ran into this error. Seems related to what you described above?
Copy code
Execution cancelled -- Finishing pending tasks before exit
-[nf-core/ampliseq] Pipeline completed with errors-
ERROR ~ Error executing process > 'NFCORE_AMPLISEQ:AMPLISEQ:SUMMARY_REPORT (1)'

Caused by:
 Missing output file(s) `summary_report.html` expected by process `NFCORE_AMPLISEQ:AMPLISEQ:SUMMARY_REPORT (1)`


Command executed:

 #!/usr/bin/env Rscript
 library(rmarkdown)
  
 # Work around <https://github.com/rstudio/rmarkdown/issues/1508>
 # If the symbolic link is not replaced by a physical file
 # output- and temporary files will be written to the original directory.
 file.copy("./report_template.Rmd", "./template.Rmd", overwrite = TRUE)
  
 rmarkdown::render("template.Rmd", output_file = "summary_report.html", params = list(css='nf-core_style.css',report_logo='nf-core-ampliseq_logo_light_long.png',workflow_manifest_version='2.15.0',workflow_scriptid='bf04a499cc',report_title='Summary of analysis results',metadata='metadata_COPD_smoking.tsv',input_samplesheet='samplesheet_COPD_smoking.tsv',mqc_plot='multiqc_plots/svg/fastqc_per_sequence_quality_scores_plot.svg',cutadapt_summary='cutadapt_summary.tsv',truncq=2,trunclenf='270',trunclenr='200',max_ee=2,dada_qc_f_path='FW_qual_stats.svg',dada_qc_r_path='RV_qual_stats.svg',dada_pp_qc_f_path='FW_preprocessed_qual_stats.svg',dada_pp_qc_r_path='RV_preprocessed_qual_stats.svg',dada_filtntrim_args='filterAndTrim.args.txt',dada_sample_inference='independent',dada_err_path='1_1.err.svg,1_2.err.svg',dada_err_run='1',asv_table_path='ASV_table.tsv',path_asv_fa='ASV_seqs.fasta',path_dada2_tab='DADA2_table.tsv',dada_stats_path='DADA2_stats.tsv',mergepairs_strategy='merge',path_barrnap_sum='summary.tsv',min_len_asv=0,max_len_asv=0,dada_min_boot=50,dada2_taxonomy='ASV_tax_species.silva_138_2.tsv',dada2_ref_tax_title='Silva 138.2 prokaryotic SSU',dada2_ref_tax_file='[<https://zenodo.org/records/14169026/files/silva_nr99_v138.2_toSpecies_trainset.fa.gz>, <https://zenodo.org/records/14169026/files/silva_v138.2_assignSpecies.fa.gz]',dada2_ref_tax_citation='Quast> C, Pruesse E, Yilmaz P, Gerken J, Schweer T, Yarza P, Peplies J, Glöckner FO. The SILVA ribosomal RNA gene database project: improved data processing and web-based tools. Nucleic Acids Res. 2013 Jan;41(Database issue):D590-6. doi: 10.1093/nar/gks1219. Epub 2012 Nov 28. PMID: 23193283; PMCID: PMC3531112.',val_used_taxonomy='DADA2',filter_stats_tsv='count_table_filter_stats.tsv',qiime2_filtertaxa='1986,52',exclude_taxa='mitochondria,chloroplast',min_frequency='2',min_samples='7',barplot=TRUE,abundance_tables=TRUE,phyloseq='phyloseq,dada2_phyloseq.rds',tse='tse,dada2_TreeSummarizedExperiment.rds'), envir = new.env())
  
 writeLines(c("\"NFCORE_AMPLISEQ:AMPLISEQ:SUMMARY_REPORT\":",
   paste0("  R: ", paste0(R.Version()[c("major","minor")], collapse = ".")),
   paste0("  rmarkdown: ", packageVersion("rmarkdown")),
   paste0("  knitr: ", packageVersion("knitr")) ),
   "versions.yml")

Command exit status:
 0

Command output:
 [1] TRUE
 1/158          
 2/158 [libraries]    
 3/158          
 4/158 [setup]      
 5/158          
 6/158 [unnamed-chunk-1] 
 7/158          
 8/158 [unnamed-chunk-2] 
 9/158          
 10/158 [unnamed-chunk-3] 
 11/158          
 12/158 [unnamed-chunk-4] 
 13/158          
 14/158 [unnamed-chunk-5] 

Command error:
  
  
 processing file: template.Rmd
  
 Quitting from lines 189-226 [unnamed-chunk-5] (template.Rmd)
 Error in `scan()`:
 ! line 1 did not have 4 elements
 Backtrace:
  1. utils::read.table(...)
  2. base::scan(...)
 Execution halted
Tip: you can try to figure out what's wrong by changing to the process work dir and showing the script file named `.command.sh`

 -- Check '.nextflow.log' file for details
ERROR ~ Pipeline failed. Please refer to troubleshooting docs: <https://nf-co.re/docs/usage/troubleshooting>

 -- Check '.nextflow.log' file for details
d
Hm no I think the problem we were discussing here was in the dev branch, and is solved now.
Copy code
lines 189-226
seem to be related to input samplesheet & metadata.
Copy code
! line 1 did not have 4 elements
sounds like 4 columns were expected but not found. However, I do not know if its the sample sheet or the metadata that the script complains about. Is there any unusual sign or similar in the first line? Probably the files are not tab separated? (Because that seems needed, but the sample sheet can be other formats...)
s
I see, thank you so much! I will investigate more!
That was the case, the first line of samplesheet did not have an extra tab 😄
👍 1