Question on Kinesis: if data ordering is critical,...
# awst
Thomas Hoefkens
02/10/2021, 10:39 AMQuestion on Kinesis: if data ordering is critical, can we only have one lambda consuming the data - or is there an elegant way of writing the data in the correct order to Dynamo for example..?
a
Alex Jurkiewicz
02/10/2021, 11:07 AMyes. read the docs on kinesis shards and data partitioning
t
Thomas Hoefkens
02/10/2021, 11:08 AMI read the docs... just wanted to find out whether e.g. the lambda event trigger will assure that there will be no parallel processing of a single shard...
Thomas Hoefkens
02/10/2021, 11:09 AMbasically does AWS make sure when a lambda is triggered that this will always be a single lambda invocation... but as I understand it, a batch of records will always be passed into the lambda.. @Alex Jurkiewicz just wanted to make sure no 2 batches ever get fed to 2 different lambda instances so that records being written may overtake each other...
a
Alex Jurkiewicz
02/10/2021, 11:13 AMyes, the docs are a little ambiguous. We have a similar requirement and confirmed with AWS support that things work the expected way. I think there is some risk when resharding a stream but not in normal operation
👍 1
t
Thomas Hoefkens
02/10/2021, 11:14 AMok, great, thanks for the info 👍