Hey guys, I’m probably lacking understanding regar...
# troubleshootingm
Max Dubinin
04/20/2023, 3:57 PMHey guys, I’m probably lacking understanding regarding some fundamental Flink functionalities.
I’m reading from a Kinesis source (from a TRIM_HORIZON initial position). Every time I cancel and start the same job, I see an X amount of records being pulled at the first checkpoint, while there are no records in the Kinesis shard I’m consuming from.
Can someone please help me understand where those records might be coming from? I’m not restoring from a savepoint or anything
d
Daniel Craig
04/24/2023, 3:49 PM🤔
Daniel Craig
04/24/2023, 3:54 PMI know you said you're sure there are no records in the kinesis shard; can that really be true? otherwise you have a mystery on your hands. Maybe find a way to log the records , to get an idea of what they are?
m
Max Dubinin
04/24/2023, 5:55 PMThanks for your reply. You were right. I got help here: https://apache-flink.slack.com/archives/C03G7LJTS2G/p1682009588281429
👍 1