Flink connector releases seem to be out of sync wi...
# random
s
Flink connector releases seem to be out of sync with Flink releases - how to deal with that? Example: • Apache Flink 1.20.0 was released on 2024-08-02 (23 days ago as of now) • flink-connector-kafka has released JARs built for Apache Flink 1.19 (see https://central.sonatype.com/artifact/org.apache.flink/flink-connector-kafka/versions) My working assumption based on this is that, wanting to use Kafka, I am blocked from using Apache Flink 1.20.0 for now - is that correct? Is there any release synchronization going on between Apache Flink and, effectively, critically dependent connectors? I would have hoped that with Apache Flink releases, the "top" components of the ecosystem are updated, too? How do organizations deploying Apache Flink deal with that? "Roll your own from source", all the time? FWIW, I appreciate that this all is Open Source and all that this entails, so there is no sense of entitlement here!
d
I think the way most organizations deal with this is they don’t upgrade until the compatible connectors are available. I would stay with 1.19.1 for now
Having said that you can also check the snapshot builds for connectors which might achieve a satisfactory level prior to release but you would need to extensively test for your environment.