Thanks @vchepkov, I was already looking into a local repository. I have found a rubygems proxy on our Nexus that I can set-up. And with

gems sources --add <local repo>

I can add that local repo...that should work! 👍