Puppet Community

Hi all! Can anyone point me to docs on unit testing custom resource types and providers? Specifically to old-style low-level development method.

I don't know if there's any documentation, most people just go digging through puppetlabs and voxpupuli modules for good examples

Yes, I tried reading some ready code, but got a lot of errors and can't understand what's up...
I ping'ed <#C0W1Y5VL0|>. Let's see.

is anyone attending <http://fossy.us|fossy.us> here in Portland?

Unfortunately not, it looked super cool but our travel budget is still gone

The agent is attempting to download localized translations (not to be confused with the `translate` module). This behavior can be controlled on the agent by setting `puppet config set disable_i18n true --section main`. As of puppet 7 and up, the `disable_i18n` defaults to true, so this should only be an issue with older agents.

I'm surprised to hear that this one of the largest sources of load on puppetserver, because in theory almost no modules provide module translations. Is it possible you're grouping all `/puppet/v3/file_metadatas` requests (including file metadata for pluginsync)?

This request, verbatim, is ~30% of all of our requests
`request.raw: /puppet/v3/file_metadatas/locales?environment=production&amp;links=follow&amp;recurse=true&amp;source_permissions=ignore&amp;ignore=.svn&amp;ignore=CVS&amp;ignore=.git&amp;ignore=.hg&amp;ignore=%2A.pot&amp;ignore=config.yaml&amp;checksum_type=md5`
I tried isolating this by monitoring the requeststs from one single agent, and then running puppet with `puppet agent -t --disable_i18n=true` and it still made the same request.

I will note that this is puppet 5, and we are actively moving to puppet 7, so things may be improved there. I only noticed this because I went on a `file {source =&gt;}` crusade and got rid of all the others. It may be something that is less of a problem on puppet 7.

<@U04JVPE0S31> Try `puppet agent -t --disable_i18n`

I'm looking through our puppet 7 logs, and it is not there, so I will indeed write this off as puppet5 noise

This is basically tho only thing I could find `<https://www.puppet.com/docs/puppet/8/configuration.html#localesource>`

`From where to retrieve translation files.`
What "translation files" does puppet need exactly?

maybe related to translate module. afaik this is deprecated. on some older puppetlabs module versions you might still find some locale files. usually for asian langauges.

I guess that means the only way to stop the madness is to upgrade to newer puppet, and advance all modules past the point of needing puppetlabs-translate, at which point those queries won't be made?

See the `puppetlabs-translate` module at <https://forge.puppet.com/puppetlabs/translate?src=slack&amp;channel=puppet>

It now has a snazzier cover thanks to Puppet design and just to highlight the physical copy comes with a free pdf download.

Final review furiously ongoing :sweat_smile:

Hey yeah we had Ben Jerald Edwin and a Packt person on technical review as well as their slew of copyeditors.... Will sleep for a week once its finalised :sleeping:

unluckily no preorder button on amazon. happy to support as reviewer as well.

uk did not show the button. many thanks for pointing to us.

<@U020LK7D0JU> you get a free pdf copy if you buy a physical with Packt

Hmm well this is very old and I need to confirm but <https://hub.packtpub.com/packt-make-epub-downloads-available-its-website/>

ooh, that I will definitely look into (and then figure out how to get Adobe Digital Editions working to actually sideload it onto my kobo)

`reportdir` is the location used by `store`. Are your agents configured to send reports with `report = true` in the `[agent]` section of the config?

yes and no.
report = true is the default, so I never specified that in the config.
BUT - since it's a problem, I did try putting that in a node's config (puppet.conf) and it didn't help.

I don't use `store` normally but I just enabled it now and it did write reports for me. What do you get from `puppet config --section server print reportdir` run from the Puppet server? For me that returns a different path compared to without "`--section server`" for some reason.

Yea, mine is different too
~/.puppetlabs/opt/puppet/cache/reports
Which also doesn't exist, my ~/.puppetlabs/opt/puppet/ dir is empty.
What even puts that .puppetlabs/ dir in there?  I'm on freebsd, there's not any 'puppetlabs' anywhere, everything is /usr/local/etc/puppet...

that said, I'm creating those dirs now.  :smile:

def don't want that being in my home dir but...

Not familiar with freebsd at all..... you might have to wait for someone smarter to answer :smirk:

You may want to run puppet agent with —trace option to see if it does even try to store any report

Thanks for your timely reply!
Here's my output, grep'd for 'report'

so, not trying to store any report?  It seems to be populating puppetdb and my puppet-summary dashboard...

Cannot check it now.. but maybe later or maybe someone will share some ideas

<https://www.puppet.com/docs/puppet/7/configuration.html#reportdir>

Thanks - yeah, that was the first thing I went to.  It's just not creating them.
My hunch is, the puppetDB and/or the puppet-summary dashboard is involved.  My 'reports' config is 'store, puppetdb, http' - and 'store' ain't working no more.

Mine is more extensive, as I send reports to "other" places:

```reports = store, http, foreman, puppetdb, prometheus, tagmail```
My hunch is that *as long as* `store` is specified, that should be all that you need.

Hello, question here : i want to have a key in hiera that is available to every nodes and merged when passed to a lookup() function. My problem here is that test it break my tests as the key needs to be prefixed with the module name. How could i solve that ?

hiera data placed inside a module can only contain keys prefixed with that module.

Ok, how do i create an alias. Is that a puppet or hiera thing  ?

A hiera thing - `my_common_key: "%{alias("module::key")}`

see "interpolation syntax" and "alias" in the puppet documentation for hiera.

Ok, By my understanding, i still need to use the full name ( module::key )in the puppet recipe , correct ?

If you do this aliasing then you can lookup the key `my_common_key` in the example I showed.

If that is what you want to do - i.e. have an alias and thereby hiding the fact that the value comes from a particular module to make all the logic where you want to look up this value unaware of that it is actually defined in a module.

Otherwise, if the direct dependency on your module holding the data is ok, then just lookup that key. Some frown on such a design.

Other prefer to use a class, and have automatic lookup. Then, instead of doing lookups where the value is needed a simple reference to a variable is used.

Ok, i see what you mean : my problem here is more like : the module does not bring any data at all, and i dont want it to. What i want is that at every level of hiera (node, role, common etc) the data in this key is  append to the key. In the end , my module simply grab the key with a lookup and use all the values in this key. My problem is that without this value, my tests are failing. I am trying to stub this.

The 'dirty way' would be something like this : lookup('mykey',Hash,deep,lookup('mymodule:mykey'))

Sorry, can’t help you with how to stub this in a test.

No worries, thanks for your time anyway !

There should be people online later to help you with how to stub/mock hiera data.

However, if your modules referred to a variable instead of doing an explicit lookup, I think it would be easier to mock.

merge options can be configured in hiera IIRC

so no need to to explicit `lookup()` call

then, you can always use another hiera config for tests with `let(:hiera_config) { 'path/to/hiera.yaml' }` IIRC

what’s nice with APL - you don’t need to stub this.. just pass some example params with `let(:params) { { mykey =&gt; { ... } } }`

another crazy idea is to use lookup() as a default value for the parameter.. though it’s almost the same as APL (except you don’t need to configure merge behaviour in Hiera)

<@UNNE9882X> having a lookup of a different key as the default is meaningfull, but not if trying to lookup the key that APL will lookup - APL will win in that case.

Hello everyone :slightly_smiling_face:
Nice to meet you :slightly_smiling_face:
May I kindly ask for your help?
I want to install the latest puppet8 on ubuntu 22.04.
After following the docs: <https://www.puppet.com/docs/puppet/8/server/install_from_packages.html>
I added the dpkg file:
```sudo dpkg -i puppet8-release-jammy.deb
apt update
apt install puppetserver```
Resulted in E: Unable to locate package puppetserver.

 Can you please help me out here ?
Kind regards
AK :slightly_smiling_face:

PS: I know very basic question :wink:

I believe puppet server isn't released for ubuntu 22.04 yet

per <http://apt.puppetlabs.com/pool/jammy/puppet8/p/index.html>

focal does have it however <http://apt.puppetlabs.com/pool/focal/puppet8/p/index.html> (so just waiting for release)

I know puppetlabs is working on el9 as well