hello, i am trying to sink to kinesis data firehou...
# troubleshooting
t
hello, i am trying to sink to kinesis data firehouse from KDA flink app but i was getting 100% busy for only ~330 data at the sink park 😦. is there any explanation for for this ?
a
Hey, have you looked at flamegraph to determine what operation is taking most of the resources?
t
i did looked and it say something related to firehouse async but i checked the firehouse and it say they support 5k record put per sec
as per the doc it says
Copy code
Each PutRecordBatch request supports up to 500 records. Each record in the request can be as large as 1,000 KB (before base64 encoding), up to a limit of 4 MB for the entire request. These limits cannot be changed.
but mine records are not even 500 yet nd got busy 100% at ~330 records
a
Hi Tsering, sorry for late reply. are you still facing the issue? if yes could you share the sink configs? "maxBatchSize, MaxInflightRequest,...etc"