Hi folks, we are using KafkaJsonSchemaSerializer i...
# troubleshooting
c
Hi folks, we are using KafkaJsonSchemaSerializer in the Kafka producer side, but we aren’t being able to decode the payload using Pinot ingestion. There are some unreadable chars at the beginning of the payload. I’ve tried different configurations without any success. BTW we are using Confluent Schema Registry.
j
Seems Pinot does not have the confluent schema registry json format support yet. Adding @Elon who contributed the
KafkaConfluentSchemaRegistryAvroMessageDecoder
❤️ 1
e
Good timing, we are also talking about that:) To use it we need to upgrade to a more recent version of confluent schema registry libraries, then it can be used
Thanks, please tag me in any github issue, I can push a pr for it also
👍 1
c
@Elon But what if we don’t use Avro?
Our producers are using KafkaJsonSchemaSerializer
+ Schema Registry
e
Yep, the pr would add support for json
🙌 1