and aggregate results
# helpt
thdxr
06/10/2021, 3:05 PMand aggregate results
f
Frank
06/10/2021, 3:43 PM
I don’t think it’s antipattern. Do you need to konw when all the parallel lambdas are done their job?
Frank
06/10/2021, 3:44 PM
If yes, I think step functions can really simplifies this.
t
thdxr
06/10/2021, 3:45 PMYeah I had a feeling step functions was the way to go but I've been shy about jumping into learning them
thdxr
06/10/2021, 3:45 PMI do need to know when they're all done
f
Frank
06/10/2021, 3:46 PM
without step function, each of the parallel function needs to check if all other functions are done. And you might need too store all function’s “running/done” state in a DB?
Frank
06/10/2021, 3:47 PM
With step functions, you can do fan out / fan in easily, and it has an internal state, so most likely you don’t need a db.
Frank
06/10/2021, 3:49 PM
Here’re some code snippet for Step Functions in CDK - https://docs.aws.amazon.com/cdk/api/latest/docs/aws-stepfunctions-readme.html#parallel
Frank
06/10/2021, 3:49 PM
The “Parallel” state does the fan-out/fan-in
t
thdxr
06/10/2021, 3:54 PMsweet thanks I'll check it out
thdxr
06/10/2021, 4:05 PMwow this is powerful, I kept hearing everyone say it was powerful but now it's clicking for me
f
Frank
06/10/2021, 4:36 PM
Yeah I usually go for step functions whenever I need to do smth and wait
t
thdxr
06/10/2021, 4:49 PMGot it working with the
Mapthdxr
06/10/2021, 4:49 PMit's beautiful!