Hi. We are in the process of upgrading nf-core too...
# linting
r
Hi. We are in the process of upgrading nf-core tools and pipelines from version
3.2.1
to
3.3.2
. Seeing an error when running
nf-core pipelines lint --release
command
included_configs: Pipeline config does not include custom configs. Please uncomment the includeConfig line.
We do not have any custom pipeline configs. In version
3.2.0
, above error used to be a warning and now it is an error. To test this out, did the following -- • Created a nf-core pipeline from scratch using the nf-core tools cli (
nf-core pipelines create
) and using the defaults it presented on the terminal UI (version 1.0.0dev). • Ran
nf-core pipelines lint
. It passed without issues. • Issued a
nf-core pipelines bump-version 1.0.0
• Ran the lint command again with '--release' option -->
nf-core pipelines lint --release
. It fails with the error above regarding the included_configs. It seems to me -- that it is a bug with the new
3.3.2
version. Would anyone be able to confirm the behavior so that I can request a bug fix? Our current (only) way of working around this issue is to add
included_configs: False
in the .nf-core.yml (which we don't want to do). Please help. If this is not the correct channel to ask/report this -- please let me know as well.
image.png
j
When you set up the pipeline, did you specify it was a nf-core pipeline or an external one?
r
I set it up as an nf-core pipeline.
j
I have a feeling maybe you've set the former rather than the latter? The linting should skip for the latter because custom configs are automatically made for nf-core pipelines
r
image.png
j
Yeah switch
is_nf-core
to false if this is not an accepted nf-core pipeline
r
ok. let me try that quickly
Ok. That worked. Let me try creating a custom pipeline and give it a try now.
Ok. That worked for me with custom pipeline as well. Thank you for the quick response and help.
@James Fellows Yates - what I noticed is the issue when running with '--release' flag. After I bump the version to 1.0.0 and then run the below, it fails.
nf-core pipelines lint --release
j
Yes, I don't think external pipelines are meant to use the release flag as you don't release on our infrastructure
So you can skip I guess (thinking about it)
r
Hmm. ok. We were under the impression that '--release' flag is a step to double-check things upon tagging a main branch version and creating a release in GitHub.
The .github/workflows/linting.yml file has a --release flag to use when pushing to master branch.
j
It may have changed over the years then, there defiitely used to be nf-core specific things (docker image tagging etc)
You could ask on
#CE5LG7WMB if you suspect a bug 🙂
r
Thank you. I will ask.
j
hi! Jame's suggestion of setting the pipeline as non-nf-core sounds good 👍🏻 but to clarify the error you saw, this is because in the nextflow.config we have a line which is including the pipeline configuration https://github.com/nf-core/tools/blob/main/nf_core/pipeline-template/nextflow.config#L223 and this should be uncommented for nf-core pipelines
to skip this test you can add the following to your .nf-core.yml file
Copy code
lint:
    included_configs: False
r
Thank you. We have used that workaround to skip the test for now for our production pipeline. So, is that the intended error/feature to fail upon release or bug that it should have been a warning?
j
it's expected. When you have the commented line it is a failure telling you to uncomment it, if the line is not present at all, then it is a warning
👍 1
r
Thank you, Julia for that information.
p
Note that you can ctrl+click any of the CLI linting error names and jump to the docs for that error. In this case, here: https://nf-co.re/docs/nf-core-tools/api_reference/3.3.2/pipeline_lint_tests/included_configs
👍 1
👀 1