Hey Team, Need some advice to solve following use case. Need to pass integer values as filter in IN clause. Number of values can range upto 5-20k. How can we apply such filter in Pinot Query? This filter values cannot be persisted in pinot table since this Dimension table can change and cannot be queried on Old state. So values are passed on by request itself. Came across, filter ID_SET. but required data in table. Thanks

You could try building your own

RoaringBitmapIdSet.java

from your set of integer values, then Base64 encode the byte[] returned by ``RoaringBitmapIdSet.toBytes()` I think you could then use that for the

IN_ID_SET

’s

base64EncodedIdSet

parameter.

thanks @Ken Krugler will check this out