We are using Pinot for near realtime analytics, and we would also like to support the ability to export query results to CSV and upload to GCS. Is anyone doing something similar? What might be the current recommended approach for this? Happy to provide more details about our current usecase.

one time, or as part of an ongoing process?

It would be ongoing. We currently allow users to schedule data exports, say on the hour or once per day, up to 14000 per day total at the moment but we can spread out the load if necessary. Also the 50th percent in size of these reports is < 1 KiB, and 99th percentile is < 5 MiB. We do have some outliers around 1 GiB.

i see, so it is something that is data driven and user configured. that feels more like ksqldb+connect in my head, but the configuration and logic could be tricky