Hello I am Raounak, a software engineer in a Delhi...
# general
r
Hello I am Raounak, a software engineer in a Delhi, based company. We decided to use Pinot for our OLAP and facing the following issues regarding `routing/partitioning`: What we have done: We have implemented partitioning using
Murmur
on a dimensionField of STRING type and set
numPartitions
to 3. Issues: (context: After the table receives data from Kafka) 1. If I select all data I can see the new incoming data, but if I filter it out using
where
clause on partition column then it says no data found. Is it because the recent data is not being flushed now? But then why it comes when I select all data without where clause. 2. On another table(same context) there was data already. Then on top, we added partitioning. Now the partitioning is not working when we are filtering out data based on the partition column. Is it because the previous data is not partitioned? I have searched the documentation thoroughly but couldn’t find answers to these questions. Maybe I missed something. Please help as it is critical to our operations. Thank you
đź‘‹ 1
p
I had a similar issue where the mapping in the config was out of sync with how it was working on kafka. Check you have the same key configured as the kafka partition key and same hash function and num of partitions. If you remove the routing config your queries will probably work again.