Poll for you all <!channel> When checking the status of your tests, do you: 1️⃣ check the summary at the bottom of the 'conversation' tab of the PR 2️⃣ use the 'Run nf-test' summary page on the 'Checks' tab ???

but 2️⃣ when there is something off

OK, to give context why I'm asking: Was having a conversation with @Diego Alvarez Saravia where he said 'what is the point of the

latest-everything

if we ignore it because see it always 'passing' - heating the planet 😅 '

it helps us debug if we see something going wrong

Because I have a feeling mkost people don't use 2️⃣ so are not even using those tests for anything

(plus it gives a nice festive pattern 🎄)

in theory we (the bot) were posting a comment to the PR when the latest everything failed

I don't thik so: https://github.com/nf-core/mag/pull/909

also we now have the nightly builds which tell us when something fails, so I agree we can remove this from the tests

nightly != latest everything. but we test latest everything in the tools CI, and that should hopefully capture most things.

I agree that it makes more sense to test this only on PRs from dev to master/main. However it might also be a good idea to have them fail, but not be required to merge the PR. That way we have a visual indicator that something is wrong

I am leaning towards Nicolas proposal. I get to keep test minimal for the 🐻‍❄️ . On the other hand nothing more annoying then finally getting a release PR approved only for all tests to start failing due to some stupid syntax error that is not supported anymore in nextflow.