I added some data to a kafka topic named topic8. T...
# ingestion
e
I added some data to a kafka topic named topic8. Then ran the ingestion script. I see the topic8 show up in datahub but I don't see any properties associated with it. Can someone please tell me what I'm doing wrong? I've attached screenshots of reading data from topic8 and my ingestion yaml.
b
the topic schema shows up in the schema tab. Properties is usually empty unless you populate it yourself.
e
The schema tab is empty as well. Do I need to add data to Kafka with some schema registry for it to show up in schema tab?
l
@elegant-machine-39016 What format do you use for schemas in Kafka topics? We currently only support Avro and don't support protobuf, JSON etc.
That is probably why you're not seeing anything in the schema tab. We are going to make two improvements: 1) Show raw schema even if we don't support the format yet 2) Add support for protobuf and JSON
e
@loud-island-88694 That makes sense why it is not being picked up. I am not using any format. I am simply doing
Copy code
➜  datahubproject kcat -P -b localhost:9092 -t topic6 -K :
message1:value1
message2:value2
Any way to try adding JSON schema through kafkacat? to try out if datahub picks it up
l
try the
kafka-avro-console-producer