Join Slack
Powered by
Hi, is there a documentation for having multiple e...
# ask-for-help
j
James
03/19/2024, 6:16 PM
Hi, is there a documentation for having multiple endpoints using different models in one bento service?
c
Chaoyu
03/19/2024, 9:56 PM
Hey James, it’s been a while! There isn’t a specific doc for it but it’s pretty straightforward to do this in BentoML. Perhaps this example can help?
https://github.com/bentoml/BentoCLIP/blob/main/service.py
j
James
03/20/2024, 3:47 AM
Hi
@Chaoyu
thanks for this. Would also want to ask if you can do two separate service and two endpoint as well?
c
Chaoyu
03/20/2024, 7:43 AM
yes!
https://docs.bentoml.com/en/latest/guides/distributed-services.html
Open in Slack
Previous
Next