Anyone know how the 'Quality Score' is calculated.
# forge-modules
r
Anyone know how the 'Quality Score' is calculated.
s
@binford2k you should create a document for this 🙂 @RyChannel not sure I understand this completely, but there's some parameters e.g. puppet-lint which are evaluated on every module upload (Github) It then posts the output to a internal Forge endpoint where based on weights for each of these, a score is derived. Based on what I have collected, we used to have detailed breakdown of the quality score, but it was too overwhelming for majority of the visitors, hence we removed that Ben would do a way better job at explaining this 🙇‍♂️
v
I know that if you don't declare support of puppet 6.24, you lose half a point 🙂
🙉 2
r
Ahhh, that may be why I loss .3 points. I forked a module that wasn't being developed anymore and updated it so it'd work in Puppet 8. But I did kill support for everything < 7 since I wasn't sure if any of it would still work. Score went from 5 to 4.7
😉 1
b
we did have an effort to revamp the puppet lint warnings to explain more of why a certain check mattered (or didn't)
every now and then I look at it and want to pick it back up
r
Thanks @vchepkov, I put my min version of Puppet down to 5.5 and now I'm back at a 5 for score :D
s
yeah, this is definitely not good, we shouldn't be asking publishers to support versions we don't support, thanks for the test on this🙇‍♂️
b
I just ran into the very same, updated an old module, linter and spec checks all green, but still only Quality Score was 3.1, which made me sad 😞 Then found this threat here, bumping min supported version of Puppet down to 5.5 and then Quality Score went up to 5.0 🎉
👍 1
t
this is just sad
s
Hi @buzzdee @TheMeier thanks for the test and feedback, quality score update is long pending item, at Forge, we have been focused on the new areas for some time now, I have planned to chalk out the details of the work in the next couple of months, will probably talk about expectations in one of the vox sync and the EAB while doing that, would love to hear your thoughts. You can also slack me directly 🙂