Hello, we are planning to use Pinot with Snowflake. This is the use case: We have a service that is intensively querying Snowflake, to get similar data in near real time, which is costing, and we would like to Add Pinot, to avoid those intensives queries. Is Pinot the proper solution to do that ? Is there any Snowflake connector to start playing with it ? Thank you

How is the data reaching snowflake? Could that data be sent in tandem to Pinot? Ex if data was being sunk into snowflake by reading from Kafka, you’d be able to reuse a lot of your existing infra to sink the same data to Pinot

Hi Evan, data comes from multiple sources, and it's aggregated in Snowflake. I was thinking about writing Snowflake tables on s3, deploy a Pinot cluster on s3 and ingest s3 files to Pinot, what do you think about this approach ?

sorry @Driss, I don’t feel I’m experienced enough with Snowflake + Pinot to answer definitively. On the surface it certainly seems reasonable assuming that Snowflake can export to s3 in a format that Pinot “speaks”, as Pinot does have a way to connect to s3: https://docs.pinot.apache.org/basics/data-import/pinot-file-system/amazon-s3

thanks for your feedback. Indeed I have chosen this approach, and I am experiencing Pinot cluster on EKS.