Hey guys, I was updating the ingestion library from 0.8.15.4 to 0.8.16.4 and suddenly some schemas can't be ingested by the kafka source with the error:

File "/usr/local/lib/python3.10/site-packages/datahub/ingestion/run/pipeline.py", line 141, in run
    for wu in self.source.get_workunits():
  File "/usr/local/lib/python3.10/site-packages/datahub/ingestion/source/kafka.py", line 84, in get_workunits
    mce = self._extract_record(t)
  File "/usr/local/lib/python3.10/site-packages/datahub/ingestion/source/kafka.py", line 115, in _extract_record
    fields = schema_util.avro_schema_to_mce_fields(schema.schema_str)
  File "/usr/local/lib/python3.10/site-packages/datahub/ingestion/extractor/schema_util.py", line 443, in avro_schema_to_mce_fields
    return list(
  File "/usr/local/lib/python3.10/site-packages/datahub/ingestion/extractor/schema_util.py", line 427, in to_mce_fields
    yield from converter._to_mce_fields(avro_schema)
  File "/usr/local/lib/python3.10/site-packages/datahub/ingestion/extractor/schema_util.py", line 408, in _to_mce_fields
    yield from self._avro_type_to_mce_converter_map[type(avro_schema)](avro_schema)
  File "/usr/local/lib/python3.10/site-packages/datahub/ingestion/extractor/schema_util.py", line 393, in _gen_from_non_field_nested_schemas
    yield from self._to_mce_fields(sub_schema)
  File "/usr/local/lib/python3.10/site-packages/datahub/ingestion/extractor/schema_util.py", line 408, in _to_mce_fields
    yield from self._avro_type_to_mce_converter_map[type(avro_schema)](avro_schema)
  File "/usr/local/lib/python3.10/site-packages/datahub/ingestion/extractor/schema_util.py", line 328, in _gen_nested_schema_from_field
    yield from self._to_mce_fields(sub_schema)
  File "/usr/local/lib/python3.10/site-packages/datahub/ingestion/extractor/schema_util.py", line 408, in _to_mce_fields
    yield from self._avro_type_to_mce_converter_map[type(avro_schema)](avro_schema)
KeyError: <class 'avro.schema.UUIDSchema'>

The schemas in question indeed have fields with the logicalType uuid and this case doesn't seem to be handled in schema_util.

Hi @little-france-72098, I am taking a look at this issue and will respond back on this thread.

Hi there! Thanks for reporting. We've recently opened an issue for this https://github.com/linkedin/datahub/issues/3532

Thanks for looking into this @miniature-tiger-96062

Hi @little-france-72098, thanks for reporting. We are aware of this issue and will ship the support for logical AVRO types soon.