Hello, does pinot have support for ingesting avro ...
# generalp
Pedro Silva
07/16/2021, 10:54 AMHello, does pinot have support for ingesting avro kafka messages? Is it in the roadmap?
b
Bruce Ritchie
07/16/2021, 1:41 PMThere seems to be two Kafka Avro message decoders in the codebase that I think you can use "org.apache.pinot.plugin.inputformat.avro.KafkaAvroMessageDecoder"
and "org.apache.pinot.plugin.inputformat.avro.confluent.KafkaConfluentSchemaRegistryAvroMessageDecoder"
✅ 1
Bruce Ritchie
07/16/2021, 1:41 PMThe only docs I could find related to kafka avro can be seen @ https://docs.pinot.apache.org/basics/data-import/pinot-stream-ingestion/import-from-apache-kafka#use-kafka-partition-low-level-consumer-with-ssl
p
Pedro Silva
07/16/2021, 1:42 PMThis is enough to try out, thank you Bruce!
m
Mayank
07/16/2021, 5:14 PM
Yes, Pinot supports KafkaAvro (including confluent version), as well as SimpleAvro ingestion
c
Carlos Domínguez
07/23/2021, 1:51 PMHi folks, what is the proper way of configuring confluent schema registry using avro and basic auth?
Carlos Domínguez
07/23/2021, 1:51 PMThanks in advance