sunny
09/22/2022, 6:30 AM1. Create Pinot Partitioned Table (kafka topic partition = 3)
- Query Successed.
2. Add kafka partition to a topic (3->4)
- New consuming segment(3__0) is created in pinot.
3. Add kafka topic data to a new partition.
- Query Successed (select * from)
- But, the row is not shown in the query ( select * from where in)
- The row is visible only when the segment is completed. However, the data coming into the new consuming segment(3__1) doesn't look the same as before.
It may happen that kafka partitions are increased during operation. So Please check the issue. 😊Mayank
Subbu Subramaniam
09/22/2022, 5:26 PMMayank
Subbu Subramaniam
09/22/2022, 9:20 PMMayank
sunny
09/23/2022, 12:15 AMMayank
sunny
09/23/2022, 12:17 AMMayank
sunny
09/29/2022, 7:30 AMcurl -u admin:verysecret -H "Content-Type: application/json" -X POST <http://pay-poc-pinot-b2.ay1.krane.9rum.cc:7001/query/sql|http://pay-poc-pinot-b2.ay1.krane.9rum.cc:7001/query/sql> -d @pinot.json | python -m json.tool
However, numSegmentsQueried is equal to the total number of segments. In other words, it seems that broker pruning does not work in the Pinot partition table.Subbu Subramaniam
09/30/2022, 2:27 AMsunny
10/04/2022, 1:41 AMSubbu Subramaniam
10/04/2022, 2:43 AMMayank
sunny
10/04/2022, 6:57 AMMayank