Hello everyone 🙂
https://github.com/apache/pinot/issues/6921
I was wondering if there is any update on this issue? Is there any work done on it or are you planning on implementing this feature in the near future?
Wish everybody a great day!
m
Mayank
02/23/2022, 3:07 AM
@User ^^. May I ask what’s your use case that needs this @User ?
a
Ali Atıl
02/23/2022, 10:57 AM
We don't use Apache Arrow in our project actually. But when the resultset returned from broker to client is too large (>=1m), transfering and extracting the data from ResultSet object is taking time. If you wonder why i would fetch that many records is that i want to feed the records in Pinot to another components at a later time as if they were flowing in realtime. You can call it a replay.
m
Mayank
02/23/2022, 2:54 PM
I see, we could return Pinot’s data table format (internal), and have the client be able to iterate on it. Sounds like a good starter project, perhaps file a GH issue