Hi Everyone, Is there a way to indicate the actual data field for records read from kafka ? For example if I had records in Kafka like in below, would it be possible for Pinot to extract actual records from "employee" nested field?

{
  "data": {
    "employee": {
      "name": "ali",
      "salary": 56000,
      "married": true,
      "messageTime": 1639652167
    }
  }
}

Example schema:

{
  "schemaName": "employee",
  "dimensionFieldSpecs": [
    {
      "name": "name",
      "dataType": "STRING"
    },
    {
      "name": "salary",
      "dataType": "DOUBLE"
    },
    {
      "name": "married",
      "dataType": "BOOLEAN"
    }
  ],
  "metricFieldSpecs": [],
  "dateTimeFieldSpecs": [
    {
      "name": "messageTime",
      "dataType": "LONG",
      "format": "1:MILLISECONDS:EPOCH",
      "granularity": "1:MILLISECONDS"
    }
  ]
}

Hi @Ali Atıl you can use json path transforms to extract the values

@Richard Startin Do you mean that I can apply column tranformations for each column?

take a look at transformConfigs in the first link

@Richard Startin wow, i will try it asap. Thank you a lot))