Neeraja Sridharan
11/20/2025, 4:49 AMoffline tables.
Appreciate any help in confirming if the same applies to real-time tables as well 🙇♀️ Here is the associated reference for Kafka stream, but it doesn't explicitly mention if partition-based segment pruning can be set up for multiple columns in the corresponding Pinot table config: https://docs.pinot.apache.org/basics/getting-started/frequent-questions/ingestion-faq#how-do-i-enable-partitioning-in-pinot-when-using-kafka-stream
I guess the pre-requisite is: Input Kafka stream needs to be configured with a custom partitioner to match the partition column(s), partition function and number of partitions set up in the Pinot table config.Neeraja Sridharan
11/20/2025, 4:50 AMMayank
Neeraja Sridharan
11/20/2025, 5:21 AMNeeraja Sridharan
11/20/2025, 5:26 AM"tableIndexConfig": {
..
"segmentPartitionConfig": {
"columnPartitionMap": {
"memberId": {
"functionName": "Modulo",
"numPartitions": 3
},
"caseNumber": {
"functionName": "Murmur",
"numPartitions": 12
}
}
}