Gwen Shapira
09/25/2023, 7:21 PMColt McNealy
09/25/2023, 8:06 PMThe economics, elasticity and reliability of large-scale multi-tenant (serverless) systemsThis heading helped me put something into words which I had thought for a long time but failed to express: Multi-Tenancy is arguably synonymous with Serverless; or, in other words, "you can't provide a truly serverless service without multi-tenancy"
Colt McNealy
09/25/2023, 8:19 PMIt seems reasonable that a vendor could offer both a SaaS and a BYOC deployment model - simply architect it so the data plane can be placed in any VPC (customer or vendor owned) and the control plane stays in the vendor account. However, this is the same on-premise architecture thinking.Well, this was my thinking exactly as CEO/CTO of LittleHorse... I have a question for the expert opiners (is that a word, derivative of "to opine"?)... is selling a subscription to a kubernetes operator considered an on-premise distribution, or a BYOC distribution, or both?
Colt McNealy
09/25/2023, 8:21 PMThe vendor that wants to offer a fully managed SaaS service and BYOC has two choices; opt for the single stack and stay the course with the traditional ST architecture, or choose to support both ST BYOC and MT SaaS.I don't fully agree with this. That is true if your
Foo software is truly single-tenant, but if it supports multi-tenancy, then can't you just deploy the whole shebang in the BYOC model (and the customer creates accounts on the server), and for the SaaS model, you deploy the same exact stack and create the accounts (and pass credentials to the customer)?Colt McNealy
09/25/2023, 8:26 PMDaniel Chaffelson
09/26/2023, 9:09 AMis selling a subscription to a kubernetes operator considered an on-premise distribution, or a BYOC distribution, or both?I dunno if I'm any expert, but I'd look at it in terms of support integration - if the supplied operator is shipping you telemetry and you can signal it to take action, then it's more BYOC as it's bi-directional management. However most of the operators I have used are more likely to export logs on error and we'll ship a new build with fixes, which is the on-prem approach. If you had a break-glass approach where you could jump in via a bastion or reverse-ssh tunnel or something, then it's MSP or something weird I wouldn't know how to label.
Daniel Chaffelson
09/26/2023, 9:15 AMbut if it supports multi-tenancy, then can't you just deploy the whole shebang in the BYOC modelI'm making some assumptions about your thoughts here, but it's not actually about the actual MT or ST software being used , it's about the tooling which surrounds it that makes it a manageable service. You're not only shipping the bits of the application the customer can see, you're also shipping the shitty scripts and monitoring services and infra scaling and everything else that won't be as idiot-proof as the frontend because you expect your internal people to be better at it, and it also won't exactly match the customer infra so it needs variants, etc. etc. That leads to the decision on whether you make a separate management stack designed for customers to operate, or you harden your internal management stack to be customer-usable. I have the possibly unpopular opinion that the latter is probably how you end up with the Azure interface, and the former is how you end up with AWS. Anyway, basically I think moving from Serverless to BYOC involves exposing a bunch of your stuff that was written as internal-only to customers who will break it, and you have to decide to let them break your toys and give them separate ones.