By default puppetserver caches the code. So you can edit the filesystem like you want, puppetserver will ignore it. Code manager basically flushes the cache