Hey guys I'm getting the error during kafka ingest...
# troubleshoot
l
Hey guys I'm getting the error during kafka ingestion with schema-registry
Copy code
File "/Users/dseredenko/.conda/envs/dataCatalog/lib/python3.9/site-packages/datahub/ingestion/extractor/schema_util.py", line 408, in _to_mce_fields
    yield from self._avro_type_to_mce_converter_map[type(avro_schema)](avro_schema)
File "/Users/dseredenko/.conda/envs/dataCatalog/lib/python3.9/site-packages/datahub/ingestion/extractor/schema_util.py", line 328, in _gen_nested_schema_from_field
    yield from self._to_mce_fields(sub_schema)
File "/Users/dseredenko/.conda/envs/dataCatalog/lib/python3.9/site-packages/datahub/ingestion/extractor/schema_util.py", line 408, in _to_mce_fields
    yield from self._avro_type_to_mce_converter_map[type(avro_schema)](avro_schema)

KeyError: <class 'avro.schema.TimestampMillisSchema'>
tried to parse field from schema-registry like
Copy code
{
  "name": "event_ts",
  "type": {
    "type": "long",
    "logicalType": "timestamp-millis"
  },
  "tags": [
    "business-timestamp"
  ]
}
seems like there is no TimestampMillisSchema key in dict AvroToMceSchemaConverter._avro_type_to_mce_converter_map
b
Hey there! Looks like you're correct, I don't believe we have support for "logical types" in our connector. I think we should be attempting to convert the logical type into a physical type prior to hitting this map check
I will go ahead and create a ticket for this, and we can follow up there