Hi all! I'm working on developing a new version of...
# troubleshooting
s
Hi all! I'm working on developing a new version of the Delta-Flink Sink connector and have a question about the guarantees provided by Flink's Unified Sink V2 APIs. For the following question, you can assume I'm forcing a single global committer using the
org.apache.flink.streaming.api.connector.sink2.SupportsPreCommitTopology::addPreCommitTopology
API and mapping the incoming Committable DataStream to
.global()
. Question: For a given checkpointId, will the
org.apache.flink.api.connector.sink2.Committer::commit
API always be called with all committables for that checkpointId? Is there any chance of only some of the committables for that checkpointId being delivered, perhaps due to a network delay, RPC delay, or even a lost end-of-interval RPC call? (This is a re-post from #dev, let me know if that's not allowed)