Hello TEAM, We are planning to use the `UNNEST` fe...
# general
s
Hello TEAM, We are planning to use the
UNNEST
feature in our large Pinot table to store some extra key-value pairs in JSON format. When we filter data on particular values using the
UNNEST
feature, will we face any performance issues? If yes, how can we enable indexing on
UNNEST
features to improve performance?
n
We didn't do much read performance testing, but unnesting as part of the ingestion drastically increased ingestion load time on an already congested minion for us. A better way would be to unnest the data in advance of pinot ingestion, in our case it was a bigquery table so we had bigquery unnest the data before exporting the table into files for pinot ingestion.