Hi, I have a tricky question. “NAN” values are stored in my realtime type table. My table config is like below. And the value in Kafka message is like {“key”{“price value”“NAN”}}. Is there some way I can use to filter this NAN messages in the ingestion phrase or in the query phrase? “metricFieldSpecs”: [ { “name”: “price_value”, “dataType”: “DOUBLE” } ]

Hi You can use

filterConfigs

in the table for this https://docs.pinot.apache.org/developers/advanced/ingestion-level-transformations#filtering