Learn how to leverage the new Flink 2.1 with Iceberg 1.11.0 and Variant support.
I’ll show a very simple Flink SQL pipeline where we read data from Kafka and write it into an Iceberg target table using Variant columns.
Variant allows you to store semi-structured data without constantly worrying about schema evolution.
I’ll also show how to query the same Iceberg table from Spark — everything works seamlessly end-to-end just the way you would expect.
Code
https://github.com/soumilshah1995/flink-iceberg-varient-demo