Hi everyone! I am trying to store the ‘metrics’ in timeseries format into pinot real-time table. I am not sure how to design the table config to transform the incoming json from the kafka topic to Pinot table as shown in the picture. Basically, I need to match the ‘label-name’ to pinot columns and insert ‘label-value’ to column value from a json array. I would have put entire labels into a single column but I want to allow user to query like “select … from mytable where ZosSystem=‘Blah’“.

Hi @Machhindra You can refer to json transform functions https://docs.pinot.apache.org/developers/advanced/ingestion-level-transformations#json-functions

I failed to get it working. I tried to simply the source data by flattening it further.

{
  "startTimestamp": "2022-09-30T01:09:00-04:00",
  "endTimestamp": "2022-09-30T01:10:00-04:00",
  "metric": "TRANUSE",
  "value": "3",
  "labels": {
    "ZosSystem": "Blah",
    "CicsRegion": "QACX560"
  }
}