Hi All, we are trying to pull all distinct records from our Pinot table along with pagination, but are unable to do so . Below are the details of our use case :
In our Pinot table we have a "field_a" and "field_b" and every value in "field_a" is associated with multiple values in "field_b"
field_a field_b
aa 12
aa 13
aa 13
bb 45
bb 67
bb 78
We want all the unique or distinct combinations of field A and field B.
That would be :
field_a field_b
aa 12
aa 13
bb 45
bb 67
bb 78
Also we have to run our query in batch of 1000 records at a time which we are trying to achieve through pagination, but it is not giving distinct records every time.
Below is the sample query
select field _a, field_b from table_name group by field_a, field_b limit 0,1000.
Note:I was going through the Pinot docs and I found out that pagination does not work on Group By queries.
Any suggestions on how we can achieve above use case ?