https://pinot.apache.org/ logo
#general
Title
# general
a

abhinav wagle

04/07/2022, 5:18 PM
Hi there, Checking community reviews. We are in process of setting up Kubernetes-based deployment of Pinot Cluster. Has anyone seen significant performance gains from using SSDs with instance store instead of EBS for server PODs?
m

Mayank

04/07/2022, 5:45 PM
Afaik, most folks end up using EBS and works well. Personally I am unaware of a case where some use case had to move from EBS to SSD for perf.
a

abhinav wagle

04/07/2022, 5:49 PM
@User: FYI
Thanks @User!
p

Priyank Bagrecha

04/07/2022, 5:53 PM
right, i am not saying we must use instance store for our use case. i am asking to compare ssd on ebs v/s instance store for our query pattern. we saw considerable improvement in performance with our adhoc queries with instance store during poc
👍 1
k

Kishore G

04/07/2022, 6:24 PM
yes, instance local storage will always be faster than the remote ebs. My suggestion is to have the helm chart have both profiles. Start with ebs but if you need even better performance, you can can chose to dynamically shift between the two modes..
For e.g. you can have some tables on local and other tables on ebs
👍 1
a

abhinav wagle

04/08/2022, 2:00 AM
Gotcha ! Thanks @User for the reco. We will give this a try 🙂
m

Mayank

04/08/2022, 3:49 AM
We had tested EBS eq on Azure for high throughput low latency use cases and we found them to hold well for the load we were testing on. But yeah for ad hoc queries ymmv.
👍 1