Hello we will be evaluating Apache Pinot for a realtime analytics use case but one of the requirements is to be able to retrieve large result sets of ids (1 million+) for a particular query. We have seen that query result pagination is a requested feature but hasn't been implemented yet. Is this a use case that Pinot is used for?

How do you plan to use those id’s

The use case is segmentation of customers for a marketing platform. We need to serve near realtime dashboards that display metrics of the segments, but we also need to provide a service for downstream systems to be able to retrieve the set of customer ids that represent the segment at any given time.

Yeah. There is a design for pagination but you can break down the query into multiple queries using timestamp. This is a more scalable solution compared to pagination since pagination will compute entire query result but only return part of it every time