Hi there, Checking community reviews. We are in process of setting up Kubernetes-based deployment of Pinot Cluster. Has anyone seen significant performance gains from using SSDs with instance store instead of EBS for server PODs?
04/07/2022, 5:45 PM
Afaik, most folks end up using EBS and works well. Personally I am unaware of a case where some use case had to move from EBS to SSD for perf.
04/07/2022, 5:49 PM
04/07/2022, 5:53 PM
right, i am not saying we must use instance store for our use case. i am asking to compare ssd on ebs v/s instance store for our query pattern. we saw considerable improvement in performance with our adhoc queries with instance store during poc
04/07/2022, 6:24 PM
yes, instance local storage will always be faster than the remote ebs. My suggestion is to have the helm chart have both profiles. Start with ebs but if you need even better performance, you can can chose to dynamically shift between the two modes..
For e.g. you can have some tables on local and other tables on ebs
04/08/2022, 2:00 AM
Gotcha ! Thanks @User for the reco. We will give this a try 🙂
04/08/2022, 3:49 AM
We had tested EBS eq on Azure for high throughput low latency use cases and we found them to hold well for the load we were testing on. But yeah for ad hoc queries ymmv.