https://nf-co.re logo
Join Slack
Powered by
# hadge
  • n

    Nico Trummer

    06/13/2025, 9:29 AM
    The hacking started🎉
    🥳 1
    ❤️ 1
    l
    • 2
    • 12
  • n

    Nico Trummer

    06/13/2025, 2:53 PM
    I have a question about the
    raw
    and
    filtered
    matrices for the hashing mode. Currently the user should provide 4 matrices: hto/rna and raw/filtered. Then for each tool uses can select if they want to use the raw/filtered for hto and the same for rna. This is a lot of parameters and I am not sure if this actually make sense. In my imagination, users would want to use the same combination of matrices for all tools. Thus, it might not be necessary that the users provide both raw and filtered matrices in the first place, but instead we could just have one
    rna_matrix
    and one
    hto_matrix
    as input, and we could just use whatever the user provides, no matter if these are then filtered or raw Am I missing something? @Lukas Heumos @Fabiola Curion
    l
    • 2
    • 1
  • l

    Luis Heinzlmeier

    06/14/2025, 7:55 AM
    Day 2 🎉
    🙂 1
    l
    s
    • 3
    • 6
  • n

    Nico Trummer

    06/15/2025, 7:06 PM
    Quick hackathon wrap-up: Modules: • 2 modules merged • 2 modules on the brink of being merged, some CI issues left to fix • 1 module left untouched, but Luis and Seo clearly got the hang in the end, so can probably be done quickly Pipeline: • Basic structure established • Implemented all modules that were available in #CJRH30T6V before the hackathon, new ones left to be done • What is missing: ◦ The newly added modules ◦ The final summarization and donor matching How we are planning to move on: • Luis volunteered to work on the remaining module (as it is R-based, and he mostly worked on R-based modules) • Seo will look into the CI issues of the two mentioned modules • I will spend a four hours per week adding the remaining modules to the pipeline I also talked to Luis and Seo about me joining your next bi-weekly meeting (23.06, 12:00) to talk about the hackathon in general and the next steps, @Lukas Heumos let me know if you think that makes sense
    l
    l
    • 3
    • 8
  • l

    Luis Heinzlmeier

    06/30/2025, 5:35 AM
    Current state of the pipeline • All merged modules are added to our pipeline (PR) ◦ added
    htodemux
    ,
    multiseq
    , and
    hasheddrops
    to the pipeline ◦ added the preprocessing script for
    htodemux
    and
    multiseq
    in the local folder ◦ added a visualization script for
    htodemux
    in the local folder • Updated
    htodemux
    (PR),
    multiseq
    (PR),
    hasheddrops
    (PR), and
    bff
    (PR). I mainly fixed the data types so that they fit with the pipeline. • Due to the memory limit, we haven’t been able to merge bff. What can we do to finally merge this module? • What is the status of the remaining modules that haven’t been merged yet? (See progress table)
    l
    n
    • 3
    • 25
  • n

    Nico Trummer

    06/30/2025, 11:08 AM
    Hey <!subteam^S016E36N7TQ>, there is currently no branch for #C067K2P6GUV in #C02L5UB4Y9G and I can't create one due to repo permissions. Could someone create one for me?
    ✅ 1
    quick look 1
    m
    m
    • 3
    • 4
  • l

    Lukas Heumos

    07/09/2025, 8:54 PM
    On the Python scripts
    l
    n
    • 3
    • 8
  • l

    Luis Heinzlmeier

    08/04/2025, 5:54 PM
    Current state of hashing summary I have added all methods for which we already have nf-core modules to our hashing summary script (
    htodemux
    ,
    multiseq
    ,
    demuxem
    ,
    hasheddrops
    and
    gmmdemux
    ). We are currently still missing
    bff
    (PR) and
    hashsolo
    for hashing. @Nico Trummer, should I continue without these modules for now? Or do we have a solution for
    bff
    and
    hashsolo
    ?
    thankyou 1
    n
    • 2
    • 21
  • l

    Luis Heinzlmeier

    08/11/2025, 7:43 AM
    Nf-core questions @Nico Trummer, I have a basic question about
    ext.args
    inputs for nf-core, which may also be of interest to @Seo Kim .
    n
    • 2
    • 2
  • l

    Luis Heinzlmeier

    08/29/2025, 7:38 AM
    What's next? So the hash summary part is done. We just need to merge it. Apart from that, what is still missing? Donor matching and the genetic summary? Is there anything else?
    • 1
    • 1
  • l

    Luis Heinzlmeier

    11/07/2025, 6:09 PM
    Update 🥘 or party cell Hey @Nico Trummer, I need one approving review from you for the updates to
    souporcell
    . Unfortunately, I cannot allow everyone to review it. I hope you find time to take a quick look at this. It's nothing major, and the tests are already running. This is the PR.
    n
    • 2
    • 2
  • l

    Luis Heinzlmeier

    11/13/2025, 8:00 AM
    Gene summary and donor match PR The next steps to bring hadge to nf-core have been completed. However, I still need some help with the current PR: 1. A new nf-core version is available. When I run
    nf-core pipelines sync
    and then
    git merge TEMPLATE
    , I get several merge conflicts again. @Nico Trummer, last time you mentioned you could take care of that. Would you have time to do it again? If not, could you let me know who might be able to help, or should I give it a try myself? 2. I’ll also need someone to review my PR. @Lukas Heumos mentioned at the last meeting that he could take care of that. @Nico Trummer, would you also like (or need) to review it from a nf-core perspective? Thanks a lot! 🙏
    n
    l
    • 3
    • 12
  • l

    Luis Heinzlmeier

    12/15/2025, 5:40 PM
    Final steps 🏁 I'm currently adding the final features to hadge (see remaining issues with prio:high and prio:normal). As soon as I'm done with that, what are the steps to bring the pipeline to nf-core? @Nico Trummer, maybe you can help us with that?
    🥳 1
    l
    n
    • 3
    • 16
  • l

    Luis Heinzlmeier

    01/27/2026, 8:22 AM
    Flexible Input Formats In our last meeting, Lukas and I discussed supporting different input formats for the count matrices. I researched how other pipelines handle this and checked the input requirements for our modules (see this issue). Except for hashsolo and demuxem (which doesn’t work anyway), all modules require 10X Genomics input. If we want to support other formats, I could write a module to convert AnnData or CSV into a 10X Genomics-compatible format.
    l
    n
    • 3
    • 6
  • l

    Luis Heinzlmeier

    02/10/2026, 7:28 AM
    Bring hadge to nf-core Thank you for the review, @Nico Trummer and @Lukas Heumos! I have incorporated your feedback, and all tests are still passing. So what's next?
    n
    l
    m
    • 4
    • 49
  • l

    Leon B

    03/11/2026, 2:39 PM
    Hi, I have been trying the nf-core/hadge pipeline on my data but I'm running into the following error in the last step:
    Copy code
    ERROR nextflow.processor.TaskProcessor - Error executing process > 'NFCORE_HADGE:HADGE:GENETIC_DEMULTIPLEXING:GENE_SUMMARY
    (...)
    Command executed [/home/lb2336/.nextflow/assets/nf-core/hadge/modules/local/gene_summary/templates/gene_summary.py]:
    (...)
    UnicodeDecodeError: 'utf-8' codec can't decode byte 0x8b in position 1: invalid start byte
    l
    • 2
    • 10
  • l

    Leon B

    03/11/2026, 2:39 PM
    any suggestions how to change this decoding error?
  • l

    Leon B

    03/11/2026, 2:42 PM
    Generally, I found it would also be great to be able to skip some of the pre-processing steps (eg. BAM_QC, CELLSNP_MODEA) upon user choice and the memory requirements could probably be reduced
    l
    • 2
    • 1
  • l

    Leon B

    03/11/2026, 2:51 PM
    The process CREATE_ANNDATA_MUDATA seems to start even though I set:
    --generate_mudata false --generate_anndata false
    l
    • 2
    • 2
  • l

    Leon B

    03/11/2026, 2:53 PM
    As well as CELLSNP_MODEA even though I didn't select CELLSNP as a tool - this was my command:
    Copy code
    nextflow run nf-core/hadge -profile singularity -r dev -c test.config --input demux_sample_sheet_nfcore.csv --outdir test --mode genetic --genetic_tools demuxlet --match_donor false --generate_mudata false --generate_anndata false
    l
    • 2
    • 1
  • l

    Leon B

    03/11/2026, 3:00 PM
    Is CELLSNP maybe a new addition ? Its also not mentioned in the README overview image of the pipeline - would be great to know why its generally required if it is
    l
    • 2
    • 5
  • l

    Leon B

    03/11/2026, 3:04 PM
    Apologies for all the remarks - just wanted to give some feedback here
    l
    l
    • 3
    • 2
  • l

    Leon B

    03/19/2026, 1:36 AM
    One more question - if I wanted to add another HTO multiplexing tool to the hadge toolbox for example "demuxmix" , would you be open to that ?| (https://academic.oup.com/bioinformatics/article/39/8/btad481/7234612)
    l
    l
    • 3
    • 6
  • p

    Phil Ewels

    04/21/2026, 2:43 PM
    Hi folks, just linking for potential to collaborate with @Kevin RUE
    thanks 1
    gratitude thank you 1
  • l

    Luis Heinzlmeier

    08/04/2026, 2:34 PM
    Release 🚀 @Nico Trummer, is there anything else that needs to be taken care of before we can release? If not, I'd be happy to start the final steps described here: nf-co.re/docs/developing/pipelines/release-procedure
    🚀 1
    • 1
    • 2
  • f

    Full test notifications

    09/28/2026, 3:18 AM
    ✅ hadge/test_full completed successfully! 🎉 Run Name insane_kalman Duration 5h 25m 13s Status ✅ Success Tasks Completed: 28 Sep 28, 2026 at 3:18 AM
    🎉 1
  • f

    Full test notifications

    09/28/2026, 11:54 AM
    ✅ hadge/test_full completed successfully! 🎉 Run Name prickly_fourier Duration 5h 29m 24s Status ✅ Success Tasks Completed: 28 Sep 28, 2026 at 11:54 AM
  • f

    Full test notifications

    09/28/2026, 12:58 PM
    ✅ hadge/test_full completed successfully! 🎉 Run Name thirsty_magritte Duration 4h 10m 56s Status ✅ Success Tasks Completed: 28 Sep 28, 2026 at 12:58 PM
  • l

    Lukas Heumos

    09/29/2026, 10:05 AM
    @Luis Heinzlmeier just made release 1.0.0 Thanks everyone for contributing! Special thanks go to @Nico Trummer who made substantial contributions and guided @Luis Heinzlmeier where necessary.
    🚀 2
  • f

    Full test notifications

    10/07/2026, 10:44 AM
    ❌ hadge/test_full failed 😿 Run Name golden_pare Duration 21.6s Status ❌ Failed Error Message
    Copy code
    Missing process or function paramsSummaryLog([[:], repository: <https://github.com/nf-core/hadge>, projectDir: /.nextflow/assets/.repos/nf-core/hadge/clones/fedeeb3ef358fb7cf576eae6f20b97f95ef920d3, commitId: fedeeb3ef358fb7cf576eae6f20b97f95ef920d3, revision: dev, startTime: 2026-10-07T10:43:52.891922829Z, endTime: null, duration: null, container: {}, commandLine: nextflow run '<https://github.com/nf-core/hadge>' -name golden_pare -params-file '<https://api.cloud.seqera.io/ephemeral/_MVWxxHlNm97P1HSB2Zgmw.json>' -with-tower -r dev -profile test_full, nextflow: nextflow.NextflowMeta(version:26.04.6, build:12646, timestamp:09-07-2026 18:49 UTC, preview:nextflow.NextflowMeta$Preview@2778a7c3, enable:nextflow.NextflowMeta$Features@94ba90a, strictModeEnabled:false, moduleBinariesEnabled:false), success: false, workDir: /nf-core-awsmegatests/work/hadge/work-dev, launchDir: /, profile: test_full]) -- Did you mean 'paramsSummaryLog' instead?
    Command Line
    Copy code
    nextflow run '<https://github.com/nf-core/hadge>' -name golden_pare -params-file '<https://api.cloud.seqera.io/ephemeral/_MVWxxHlNm97P1HSB2Zgmw.json>' -with-tower -r dev -profile test_full
    Oct 7, 2026 at 10:44 AM