Hi Pinot Team smile wine glass I m looking to use NVMe SSD s Apache Pinot #general

Hi Pinot Team!! :smile::wine_glass: I'm looking t...

Hubert

04/19/2024, 4:55 PM

Hi Pinot Team!! 😄🍷 I'm looking to use NVMe SSD's in my pinot helm chart for my Pinot Servers to test latency sensitive use cases. I have i4i instances launched (which support NVMe SSD in AWS) and so i'm wondering what storage class/extra configuration I would need to add to test these SSD's: (Picture attached) As I understand, AWS does not have a ssd storage class so I can't put ssd in my values.yml helm chart 😕 https://github.com/orgs/kubernetes-sigs/repositories?language=&q=aws&sort=&type=all So- would anyone know how to change my helm chart to use these SSD's through AWS? 😅 Thank you so so much in advance!!

➕ 1

Hubert Dulay

04/23/2024, 3:17 PM

Hi @Hubert I'm @Hubert Dulay . It's nice to meet another Hubert!! I believe it should be

gp2

You should be able to find more info here. https://docs.pinot.apache.org/basics/getting-started/frequent-questions/pinot-on-kubernetes-faq#id-1.-update-storage-class

Hubert Dulay

04/23/2024, 3:18 PM

For other CSPs, find them here https://docs.pinot.apache.org/basics/getting-started/frequent-questions/pinot-on-kubernetes-faq#id-1.-update-storage-class

Hubert Dulay

04/23/2024, 3:19 PM

Copy code

Note: Specify StorageClass based on your cloud vendor. Don't mount a blob store (such as AzureFile, GoogleCloudStorage, or S3) as the data serving file system. Use only Amazon EBS/GCP Persistent Disk/Azure Disk-style disks.

For AWS: "gp2"

For GCP: "pd-ssd" or "standard"

For Azure: "AzureDisk"

For Docker-Desktop: "hostpath"

Priyank Bagrecha

04/23/2024, 5:50 PM

AWS also has gp3 now which if i remember correctly is faster and cheaper.

Hubert Dulay

04/23/2024, 5:51 PM

I would try it for GCP. This doc might be out of date in that regard. Thanks

Hubert

04/24/2024, 2:45 PM

Hej Hubert! Thanks so much! 😄 Will take a look! 🙂

Open in Slack

Previous Next