Hi all, I wrote a tool 'nfhashtools' to collect an...
# shameless-promo
p
Hi all, I wrote a tool 'nfhashtools' to collect and print the json-hashes from a .nextflow.log . When the input consists in two log files, the tool works like
comm
, printing the objects unique or shared by the files. https://jvarkit.readthedocs.io/en/latest/NFHashTools/
🚀 1
👏 2
👏🏽 1
👀 1
p
This looks nice! Do you know about Data Lineage? It's a new(ish) native Nextflow feature that prints all of this information to JSON files. It looks quite similar: https://nextflow.io/docs/latest/tutorials/data-lineage.html#compare-task-runs
Retrieve the hash of the
MULTIQC
run from the log file or work directory. Compare it to the task hash of the initial run:
```$ nextflow lineage diff lid://862df53160e07cd823c0c3960545e747 lid://9433dda73f2193491f9a26e3e23cd8a1
diff --git 862df53160e07cd823c0c3960545e747 9433dda73f2193491f9a26e3e23cd8a1
--- 862df53160e07cd823c0c3960545e747
+++ 9433dda73f2193491f9a26e3e23cd8a1
@@ -3,11 +3,11 @@
"sessionId": "065bdc6b-89b4-42ee-92c1-2a5af37f2c50",
"name": "MULTIQC",
"codeChecksum": {
- "value": "edf2e9f84cd3a18ee9259012b660f2dd",
+ "value": "9615a8da3a3f9e935cfc8e4042cdf5e0",
"algorithm": "nextflow",
"mode": "standard"
},
- "script": "\n cp multiqc/* .\n echo \"custom_logo: $PWD/nextflow_logo.png\" \u003e\u003e multiqc_config.yaml\n multiqc -n multiqc_report.html .\n ",
+ "script": "\n cp multiqc/* . # hello!\n echo \"custom_logo: $PWD/nextflow_logo.png\" \u003e\u003e multiqc_config.yaml\n multiqc -n multiqc_report.html .\n ",
"input": [
{
"type": "path",
@@ -38,5 +38,5 @@
"architecture": null,
"globalVars": {},
"binEntries": [],
- "workflowRun": "lid://16b31030474f2e96c55f4940bca3ab64"
+ "workflowRun": "lid://65044872aad36f97e42336b9ba0dee57"
}```
p
@Phil Ewels yes @Mahesh Binzer-Panchal suggested me to use it a few hours ago: https://nextflow.slack.com/archives/C02T98A23U7/p1763634039667809?thread_ts=1763605427.285879&cid=C02T98A23U7 :-)
👍🏻 1
🙂 1