Both BentoML and OpenLLM can be deployed in BentoCloud, our serverless deployment platform
Chaoyu
07/31/2023, 2:31 AM
BentoCloud as the provider can still have access to your data but we will never use those data besides serving the data to our users and users have full control - e.g. users can specify our platform to ship logs to users’ own data warehouse for analytics or training.
Chaoyu
07/31/2023, 2:31 AM
We also provide solution for deploying to customers’ own VPC, in which case we have no access to the queries and responses data. Although this requires an enterprise contract with us. Happy to share more if you are interested