Poorvank Bhatia
07/29/2025, 8:14 AMRosa Seohwa Kang
07/29/2025, 7:28 PMRocMarshal
07/31/2025, 9:10 AMVinod Sherikar
08/05/2025, 6:03 AMRocMarshal
08/06/2025, 11:08 AMJakub Stejskal
08/07/2025, 9:14 AMRocMarshal
08/11/2025, 9:20 AMPeter Huang
08/20/2025, 11:53 PMMarco Scalerandi
08/23/2025, 5:35 PMJakub Stejskal
08/28/2025, 4:35 PMRyan van Huuksloot
09/02/2025, 5:55 PMNicholas Erasmus
09/05/2025, 8:46 AMThomas Cooper
09/16/2025, 2:24 PMTamir Sagi
09/16/2025, 4:45 PMDiljeet Singh
09/23/2025, 4:32 PMLuca Occhipinti
09/25/2025, 8:55 AMHang Ruan
09/26/2025, 8:29 AMRosa Seohwa Kang
10/14/2025, 12:05 PMBarak Ben-Nathan
10/19/2025, 7:24 AMJohn Watson
10/20/2025, 1:26 PMK Nunes
10/28/2025, 12:16 PMDeltaSinkInternal implements Sink<IN> and has these methods:
public Optional<Committer<T>> createCommitter() throws IOException
public Optional<SimpleVersionedSerializer<T>> getCommittableSerializer()
The framework discovers and invokes createWriter() perfectly, but createCommitter() is never called. When I tried adding @Override, I got a compilation error saying these methods aren't part of the Sink<IN> interface.
The Question:
How does a Sink expose its Committer in Flink 2.0? Is there a marker interface I'm missing? How does FileSink do it?
I suspect there's a specific pattern or interface (maybe something that replaced TwoPhaseCommittingSink from 1.x) that I need to implement, but I can't find documentation about it.
Related:
• Delta Lake issue: https://github.com/delta-io/delta/issues/5228
• My implementation branch: https://github.com/kdsnunes/delta/tree/flink/add-flink-2.0-support
• (I'm also trying to get access to Flink's Jira to create an issue there, but it's pending approval)
Any pointers would be super appreciated! Has anyone migrated a connector with Committer support to 2.0?
Thanks in advance! 🙏Alex Nitavsky
10/28/2025, 12:38 PMpranav tiwari
10/31/2025, 12:37 AMHang Ruan
10/31/2025, 9:33 AMHang Ruan
11/07/2025, 9:04 AMHang Ruan
11/10/2025, 4:04 AMRion Williams
11/13/2025, 8:50 PMAvi Sanwal
11/15/2025, 7:45 AMHang Ruan
11/17/2025, 3:31 AMRion Williams
11/17/2025, 6:03 PM