Hi, Everyone. I would like to implement Flink as o...
# troubleshooting
h
Hi, Everyone. I would like to implement Flink as our data flow infra, which would consume data from AWS Kinesis and sink to AWS Timestream TSDB. Especially, because our data have many categories, I want to sink to corresponding table in DB based on data categories and schema. Could I implement it to achieve more performance and efficiency? If you any ideas or suggestions, please share to me. I will be appreciated it, thank you.
a
Hi @hueiyuan su
Hi, Everyone. I would like to implement Flink as our data flow infra, which would consume data from AWS Kinesis and sink to AWS Timestream TSDB.
yes, while there is no native support for AWS Timestream connector I believe you could use one of the shelf implementations.
Especially, because our data have many categories, I want to sink to corresponding table in DB based on data categories and schema.
Could I implement it to achieve more performance and efficiency?
yeah If I understand your use case correctly this seems a use case for Flink, I am not sure though what concerns you have regarding performance?
h
@Ahmed Hamdy Indeed, we have plan to self implementation in this connector. About performance, because currently we use for-loop to generate different table sink to write table. But I am afraid that have performance or side-effect. So we would like to ask whether have a better method to implement it.