Learn how to leverage the new Flink 2.1 with Icebe...
# show-and-tell
s
Learn how to leverage the new Flink 2.1 with Iceberg 1.11.0 and Variant support. I’ll show a very simple Flink SQL pipeline where we read data from Kafka and write it into an Iceberg target table using Variant columns. Variant allows you to store semi-structured data without constantly worrying about schema evolution. I’ll also show how to query the same Iceberg table from Spark — everything works seamlessly end-to-end just the way you would expect. Code https://github.com/soumilshah1995/flink-iceberg-varient-demo
🙌 7
n
great video...thanks. You can try this light weight web studio for building, monitoring and managing your flink pipelines. great UI and performance monitoring: coded-streams/strlabstudio