A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

image.png

Bug in the UI on dataset schema page v0.8.11.
Any field which has another field as prefix or suffix is being show as part of the field with shorter name. These are 2 different fields and should shown separately as this is misleading.

I thought that was a feature :sweat_smile:

It would a feature if they were actually nested structs in database. It is not working for nested structs. At least not for schema taken from AWS glue sources

This should indeed be 2 top-level fields. Thanks for reporting!

This was `date` and `created_date`. But there were many other such fields in `glue` metadata which showed this behaviour. Sometimes prefix, sometimes suffix. The shorter one was shown as top-level and everything else was nested in it.

This is bizarre. Let us take a look at the glue ingestion source also cc <@U0293U046FP>

The `glue` source is not ingesting any field which is a partition key either.

Hi <@U027B7R23J4>, could you share the fieldPaths for these two fields?

Hi <@U027B7R23J4>, we have been able to root-cause this and working on a fix. Thanks for brining this to our attention.

having same issue even though I’m getting metadata from Kafka/schema-registry.

This is a UI issue as opposed to a data issue. Working to resolve!