Doing some profiling and curious what latencies ot...
# randomt
thdxr
08/04/2021, 3:30 PMDoing some profiling and curious what latencies other people are seeing. If you have a second can you hit this endpoint: https://2270mgssc9.execute-api.us-east-2.amazonaws.com/debug/scrap
Let me know how fast it loads + where you're located. I'm seeing 50-60ms from NY
a
Ashishkumar Pandey
08/04/2021, 3:42 PMFrom Mumbai, India
Ashishkumar Pandey
08/04/2021, 3:49 PM@Ross Coundon what’s this tool that analyses the request process?
r
Ross Coundon
08/04/2021, 3:49 PMJust postman
Ross Coundon
08/04/2021, 3:49 PMJust hover over the response time
a
Ashishkumar Pandey
08/04/2021, 3:49 PMoh, okay. Haven’t checked postman in a while. 😅
s
Simon Reilly
08/04/2021, 4:14 PMFrom UK London:
t
thdxr
08/04/2021, 4:17 PMwoah what's that tool
s
Simon Reilly
08/04/2021, 4:18 PMhttps://github.com/nakabonne/ali
It seems super good, been using for around 1 month
t
thdxr
08/04/2021, 4:18 PMnice ty
o
Omi Chowdhury
08/04/2021, 4:29 PMFrom Palo Alto, CA
t
thdxr
08/04/2021, 4:31 PMConfirming through this that API gateway is slower than I want 😞
s
Simon Reilly
08/04/2021, 4:31 PMIs this a HTTP API or an edge optimized rest API?
t
thdxr
08/04/2021, 4:32 PMHTTP Api
s
Simon Reilly
08/04/2021, 4:33 PMWould be curious to see how a REST edge compares. Though, I think latency might be the same, you just get better bandwidth by hopping on the AWS network at the nearest point of presence 🤔
t
thdxr
08/04/2021, 4:36 PMFrom NYC I'm getting 45ms on average. Which isn't terrible but for something simple like this I'd love to see sub 20ms. Also recently learned DynamoDB reads are an order of magnitude slower than I expected so that's adding a lot
s
Sam Hulick
08/04/2021, 4:59 PMfrom Chicago
t
thdxr
08/04/2021, 5:00 PMdamn I'd think chicago to ohio would be faster
s
Sam Hulick
08/04/2021, 5:01 PMsubsequent calls are in the range of 23-32ms
Sam Hulick
08/04/2021, 5:02 PM42ms, 26ms, 28ms, 40ms, 27ms, 105ms(!)
t
thdxr
08/04/2021, 5:02 PMgot it, more reasonable
a
Ashishkumar Pandey
08/04/2021, 5:16 PMThe problem is TCP and SSL handshake. This is one of the primary reasons why I’m looking into ECS with Fargate. It might be more expensive but that’s a price I’m ready to pay for uber performance.
t
thdxr
08/04/2021, 5:18 PMWhat would your setup be exactly? Fargate invoking lambdas? Or just doing everything in a fargate container
thdxr
08/04/2021, 5:26 PMBeen thinking about experimenting with this as well: https://github.com/markusahlstrand/cloudworker-proxy#lambda
a
Ashishkumar Pandey
08/04/2021, 5:26 PMEverything in a ecs + fargate container triggered by ELB + AppMesh. I might even replicate the architecture in multiple regions and add Cloudfront in front of the ELB to proxy requests to the nearest region.
Ashishkumar Pandey
08/04/2021, 5:27 PMYes, I remember you or someone sharing this here. It’s an interesting way to replace the API Gateway.
t
thdxr
08/04/2021, 5:29 PMI was seeing < 20ms with ECS talking to postgres for a basic query
thdxr
08/04/2021, 5:29 PMSeems impossible to get close to that with apig + lambda + dynamo
a
Ashishkumar Pandey
08/04/2021, 5:39 PMyeah, the connection needs to be created every time, that’s the problem.
m
Michael Wolfenden
08/04/2021, 9:18 PMFrom Brisbane, Australia
o
Omi Chowdhury
08/04/2021, 9:25 PMYeah I started experimenting with serving graphql over websockets with APIG last year to see if that would fix it, came across this blog post and library for it this morning
t
thdxr
08/04/2021, 9:34 PMI just moved away from doing everything over ws back to rest to use apigateway 😅
thdxr
08/04/2021, 9:35 PMBut I use jsonapi which I can convert to ws reqs fairly easily, interesting workaround
g
gligor
08/04/2021, 9:36 PMFrom Auckland, New Zealand
2 Views