By default you can map top level columns to Pinot schema. Or as you mentioned either use transform functions or json objects to store them in Pinot.
m
Mohit Singh
05/21/2021, 2:43 PM
ok.. as per my understanding we have to use the combination of top level column and for nested object we have to use transform functions.
What about message key do we store Kafka message key also?
m
Mayank
05/21/2021, 3:15 PM
We don’t atm, there was a thread yesterday on #CDRCA57FC , check it out
m
Mohit Singh
05/21/2021, 3:29 PM
Thanks.. @User
In my scenario I want to use the Kafka message key as unique key and want data to be updated in pinot whenever there is a new message in Kafka topic with existing key, like upsert in pinot using Kafka message key