Hello. We already have debezium to CDC from differ...
# ingestion
m
Hello. We already have debezium to CDC from different datasources (mysql, postgres, mssql,...) Can we reuse kafka schema-registry or
dbhistory
topics for datahub?
m
Hi @mysterious-monkey-71931: yes you can reuse the same kafka schema-registry for datahub as well. Was that your question?
m
@mammoth-bear-12532 I mean can I ingest metadata from kafka schema-registry or
dbhistory
topics to datahub instead direct access to datasources?
m
@mysterious-monkey-71931 that’s an interesting idea. I guess it could be done. Technically you are inferring the schema of the upstream table by looking at the replication system.
Does debezium log the schema of the upstream table somewhere (is that the dbhistory)
m
@mammoth-bear-12532,
schema-registry
is store full table schema in format of Avro, Protobuf or JSONSchema. The datatype will not exact match in db (because of conversion), but it's acceptable.
dbhistory
 topics store DDL change log, e.g
CREATE TABLE
or
ALTER TABLE