Hey guys, when creating a Kafka Sink, when a topic...
# random
j
Hey guys, when creating a Kafka Sink, when a topic does not exist (but could be something else wrong), there is no message/warning in the task manager. Basically, from the Flink WebUI, all looks good and it looks like many messages are being produced when actually nothing is arriving an actual topic. Is there a way to control this behavior ? I would like my Flink job to fail in this case. I tried to set 'properties.delivery.timeout.ms' = '5000','properties.request.timeout.ms' = '5000', 'properties.retries' = '1', 'properties.log_level' = '0' but it did not help. I also tried to set
queue.buffering.max.messages
to some low number but it did not help. For example, in the case below, I am seeing hundred to thousands of records being received by received by the sink but I know for a fact that the topic does not exist