Hi, everyone! I'm trying to ingest schema from Kafka but if fails

Can you please share the recipe files that you are using?

Of course

source:

type: "kafka"

config:

connection:

bootstrap: "localhost:9092"

consumer_config:

security.protocol: "PLAINTEXT"

sasl.username: "confluent"

sasl.password: "confluent"

sasl.mechanism: "PLAIN"

schema_registry_url: "<http://localhost:8081>"

sink:

type: "datahub-rest"

config:

server: "<http://localhost:8080>"

But problem not in file. I fixed this with adding "-value" to schema name in registry. Error gone away but there are no schema for topic in DataHub UI. I'll debug this later

Confluent’s Schema Registry will suffix topic names with

-value

. This is what they call subjects, you can read more about it here: https://docs.confluent.io/platform/current/schema-registry/develop/api.html#subjects

@incalculable-ocean-74010 I did some code research and fixed this problem but there are no topic schema in UI and this is a problem i guess

How did you fix the problem @curved-truck-53235?

@incalculable-ocean-74010 This problem is not solved yet

I meant the “-value” discrepancy:

@Pedro Silva I did some code research and fixed this problem

I told about this: "Confluent’s Schema Registry will suffix topic names with `-value`"

You shouldn’t have to change anything, the kafka ingestion source should be able to handle this specific confluent schema registry aspect. Let me see if I can find someone who knows more about the kafka schema ingestion to help you.

Yes, it's handle. But there no schema in UI