Tudor Plugaru
02/27/2025, 4:24 PMKafkaSink exceptions like Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to send data to Kafka <topic-name>--1@-1 with FlinkKafkaInternalProducer{transactionalId='null', inTransaction=false, closed=false} which means that the topic doesn't exist.
Is there a way I can add a callback/hook to the sink such that it get's called when the sink raises an exception?
Or, what would be the best way to prevent a record reach the sink if the destination topic doesn't exists?
Open to any idea. ThanksPedro Mázala
02/28/2025, 9:32 AMOr, what would be the best way to prevent a record reach the sink if the destination topic doesn't exists?Do you mean having a mapping of available topics or such? I think a different exception would also happen when the sink has no permission to write to the destination topic.
Tudor Plugaru
02/28/2025, 10:08 AMPedro Mázala
02/28/2025, 10:29 AMTudor Plugaru
02/28/2025, 10:49 AMPedro Mázala
02/28/2025, 10:49 AMTudor Plugaru
02/28/2025, 12:07 PMPedro Mázala
02/28/2025, 2:07 PM