Hi I have a use case where I get json message from kafka and it dosnt have fixed schema Json can have nested fields or an array Is there any way/suggestions to handle dynamic json and then save it as iceberg table

I guess you would just use your favorite JSON library/parser and implement all the logic yourself?

Yeah that should be the only option I feel

That's what you get when you get garbage data in 😉

Actually we are building a datalake which injest data through rest api kafka So it's a common rest api used by different teams to ingest different data and not every payload will have common structure

Schematize the data. It will save you from lot of issues in future