Hi community,
In case of not deploying at the moment to kubernetes but on an AWS GPU instance, is it better to pack multiple endpoints and API servers into on docker container or is it better to run multiple docker containers for each service? How many API servers are optimal too? (number of CPU cores?)