Has anyone here done sort of a A/B testing for Api...
# sst
l
Has anyone here done sort of a A/B testing for ApiGwV2 -> Lambda routes? I know gwV1 can do this in the form of canary deploys (kinda) but V2 is limited in options and so far I don't have any ideas for an easy workarounds. My planned usecase is to run A/B with different configurations on real workloads but maybe I'm better off running Lambda Power Tuning once...
d
I'd just handle this through a header on the backend, and let your frontend handle this through whatever method deemed appropriate. If you mean actual canary testing, that would be harder.
s
Does gateway V2 support lambda version weighting? I know SAM has direct support for the Canary deploy stuff, but I don't know if that is for HTTP APIs, or only Rest APIs. If you are using lambda it looks like you could set up a weighting by alias/version. I think if you would just be configuring memory size it's worth seeing how far power tuning gets you https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-lambda-alias-versionweight.html
d
Good find @Simon Reilly, I believe you would need something in place to handle the full shift (as in, something to turn this off), but I see no reason that couldnt be used with any lambda (apig be damned)
l
Great find @Simon Reilly! And thanks for the further docs @Derek Kershner. I'll follow up on this line of though tomorrow. Need to find out if SST supports selecting aliases first tho 😄