Hey all! I thought I'd chime in here related to s...
# show-and-tell
r
Hey all! I thought I'd chime in here related to some recent work that I've been doing related to dynamic, runtime sink creation that I'd love to get some thoughts on. The effort originated in working with dynamic Elasticsearch-based index routing and I've since generalized it into what a few folks recommended calling a
DemultiplexingSink
which is detailed a bit more in FLINK-24493. Since it introduces a new interface (for the sink and related router), it would require the introduction of a new FLIP related to the effort, which I'd be happy to help assist with. I've written a blog post linked below summarizing a bit more about it, including a GitHub repository complete with various examples (e.g, Elasticsearch, Kafka, File Sinks, and JDBC/Postgres) as well as link to the proposed PR that would introduce the changes. https://rion.io/2025/11/05/exploring-dynamic-sink-routing-in-apache-flink-via-demultiplexingsink/
πŸ‘€ 1
πŸ™Œ 1