Hello :wave::skin-tone-4:.
I have a strange issue...
# troubleshootingi
Ikvir Singh
01/20/2023, 12:52 AMHello 👋🏽.
I have a strange issue I’m only seeing in Flink 1.15+. I have an exactly-once Kafka sink that is set up. Once the checkpointing interval has elapsed, I’m seeing the following error in my logs show up repeatedly:
Copy code
ERROR org.apache.flink.connector.kafka.sink.KafkaCommitter - Unable to commit transaction (org.apache.flink.streaming.runtime.operators.sink.committables.CommitRequestImpl@f2f21e9) because it's in an invalid state. Most likely the transaction has been aborted for some reason. Please check the Kafka logs for more details.
org.apache.kafka.common.errors.InvalidTxnStateException: The producer attempted a transactional operation in an invalid stateIkvir Singh
01/20/2023, 12:54 AMI connected to a remote Kafka broker that is running Kafka 3.2. I also tried on a local Kafka broker from my machine with Kafka 3.3 and I still get the same error on Flink. I don’t see any corresponding error logs on the Kafka broker so I’m a bit perplexed as to why this is only happening on Flink 1.15 or greater. Any help would be appreciated. Thanks 🙏🏽
m
Martijn Visser
01/20/2023, 2:05 PMAre you using the
FlinkKafkaProducerKafkaSinkMartijn Visser
01/20/2023, 2:08 PMI'm sure I have this seen before but I can't actually find it at the moment...
i
Ikvir Singh
01/23/2023, 4:54 PMI’m using the
KafkaSinkIkvir Singh
01/23/2023, 4:55 PMMy
KafkaSinko
Or Keren
06/08/2023, 11:22 AMDid you manage to fix that one?
2 Views