Hey all. Are there any examples or ideas for how to serve models built in other languages like R, Julia, or STAN?

Hey Jack, we’ve seen architecture like this, essentially spin up an RPC server for R in the BentoML service init method, and communicate with it via RPC calls internally.

Thanks! I’ll keep an eye out for the TRT-LLM example project.