Is there a way to force pinot-server to load plugins without restarting? If I understand correctly, I think right now pinot only loads plugins at startup?

thats right.. it needs a restart

we have an issue tracking this: https://github.com/apache/incubator-pinot/issues/6377