g'day mates! 🙂
I'm wondering what your thoughts are about a situation where puppet nodes are running in a highly secure environment, only reachable via puppet. No ssh, no access at all, to the node once it's at a customers site.
What might I want to consider from a puppet perspective?
Case in point - a puppet node was in the middle of installing packages and the nodes internet dropped. Now there is hung 'pkg' process and the puppet client will keep failing forever until a carbon based life form gets in there to do something. I could make a script to just reboot the machine as a cure for one-offs like this I guess. Or make specific scripts for every scenario imaginable.