This message was deleted.

False alarm, I need sleep. The plugin in question is being pulled in as part of a composite build which has a dynamic version number that's changing every build (a timestamp). That causes the plugin jar to change every build, which means the action I'm adding is in fact "changing".