Hey team, I’ve seen some issues while rendering n...
# ui
p
Hey team, I’ve seen some issues while rendering nested record in Avro schema. There are inner
Record
type like
buyable
field . They are rendered as
Struct
in the UI, however their fields are not seen. Maybe, we can show the nested record fields with foldable/unfoldable format. I think this feature is supposed to be handled with https://github.com/linkedin/datahub/pull/3079 but it seems that there are some missing parts. Schema in raw format:
Copy code
{
  "type": "record",
  "name": "BuyNowEvent",
  "namespace": "com.xx.yy.events.BuyNowEvent",
  "doc": "This event is fired when a user clicks the \"Buy Now\" button",
  "fields": [
    {
      "name": "buyable",
      "type": {
        "type": "record",
        "name": "Buyable",
        "namespace": "com.xx.yy.events.common",
        "fields": [
          {
            "name": "type",
            "type": "string",
            "doc": "Type of buyable item; e.g. car, home"
          },
          {
            "name": "id",
            "type": "int",
            "doc": "ID of buyable item"
          }
        ]
      }
    },
    {
      "name": "createTime",
      "type": {
        "type": "long",
        "logicalType": "timestamp-millis"
      },
      "doc": "UNIX time of the event producer client when event occurred",
      "client_enrich": true
    },
    {
      "name": "sendTime",
      "type": {
        "type": "long",
        "logicalType": "timestamp-millis"
      },
      "doc": "UNIX time of the event producer client when event was sent",
      "client_enrich": true
    },
    {
      "name": "eventId",
      "type": "string",
      "doc": "Event id is a UUID generated by an event producer. Should be unique per event.",
      "client_enrich": true
    }
  ]
}
1
b
Cc @green-football-43791 - I think this is unexpected behavior
p
@some-lighter-73922 @brainy-battery-94512 we are waiting this response from @green-football-43791 :)
g
Hey @polite-flower-25924 - have you re-ingested data since upgrading your python client to the latest version?
🎉 1
The feature had changed to the UI + the ingestion client to enable nested Avro parsing
🎉 1
p
Hey @green-football-43791 , I have done the ingestion through latest docker image
let me share the config
after 20 minutes
@green-football-43791 here is the docker image values:
Copy code
Image:         linkedin/datahub-ingestion
    Image ID:      <docker-pullable://linkedin/datahub-ingestion@sha256:fadf4efd9e6d92e96d0a2acd8d8dcb88ac4a3befabfbd1f3df17c14e00ced064>
Works like a charm!!!!!!
I think :latest image tag doesn’t show the latest image or whatever 🙂
Thank you @green-football-43791 @big-carpet-38439 ! I appreciate that
b
Glad to hear things worked!! 🙂
g
nice!