Hello, can `nf-prov` plugin pipeline manifest file...
# nextflow-plugins
a
Hello, can
nf-prov
plugin pipeline manifest files be added to 'Reports' tab in Seqera Platform? Normally, only published files can be added to the 'Reports' tab.
p
I think it should work if you specify the filename in your
tower.yml
- did you try that already?
a
Yes, I have added the files to the
tower.yml
file but they are not added to the 'Reports' tab.
Quoted from the documentation you linked: "Only the published files (using the Nextflow
publishDir
directive) are candidate files for Seqera reports" Maybe that's a feature request to Seqera platform then.
The only exceptions to this are the Nextflow build-in reports and log files.
p
Huh interesting. @Ben Sherman any ideas as to how we can achieve this?
b
Not sure. The nf-tower plugin can add the built-in reports to the Reports tab, but plugins can't really talk to each other in the way that nf-prov would need to talk to nf-tower in order to get the provenance report added If we ever incorporate nf-prov into Nextflow in some way, i.e. to have an official "built-in" provenance report, it should be possible then to add it to the Reports tab
a
Ok, thanks for looking into this.
p
@Ben Sherman is there any way for a plugin to "publish" files like a regular Nextflow process? That'd be another way around it
@Arnulf Hertweck - mind if I ask what you're using nf-prov for? I'm curious about who is using the plugin and for what..
b
I don't think anyone has tried this, but it should be possible to publish from a plugin just like Nextflow by calling
session.notifyFilePublish(destination, source)
The problem is that if your report depends on the list of published files, you have to wait for the onWorkflowComplete event to make sure you received all the published file events, and at that point you can't publish anything because Nextflow will ignore it as it is shutting down
a
@Phil Ewels - thanks for asking. In fact, 'nf-prov' doesn't quite do what I need. I have previously posted what I'm looking for in this thread: https://nextflow.slack.com/archives/C02T98A23U7/p1720870558545669 Overall we are interested in keeping track of versions for datasets and pipelines to prove compliance with data management rules. In addition, it shows investors we are executing due diligence for our data generation and gives them trust we have reliable procedures in place.