Hello. I'm looking for installing pinot components separately. I tried with the helm package that's available in the documentation. That was pinot-quickstart. It's just for small data. However, it does not cater to large dataset. So I want to try installing pinot components separately on AWS EKS. Are there any deployment files available for it? I did not find any suitable ones that I can use (unless I missed something). Any help here would be really great. Thanks.

Have you tried the helm chart on eks? It should work

Yes, I did and it did work. The configuration is for small datasets and works fine. But as the data increases to GB's then it starts to fail. I did change the configuration to add additional storage but there were limitations with that as well. Right now I'm tasked to configure it separately and also it should scale quite well over a period of time. I have been able to do it. I'm working on certain configurations that can scale and also resilient....... Thanks for reply @Hubert Dulay

Have you tried increasing the number of servers to accommodate the extra data?

Yes tried that but then after some time started noticing the issues in pinot and ran out of space and resources.

are you able to provide any logs or errors you are encountering? the nodes in Pinot can be independently scaled depending one which one is suffering from limited resources

it's all decommissioned now. don't have any screenshots of it now. however, i'm able to deploy the pinot components separately and its running now. Had some issues in deploying but was able to get it up and running.

that's good news. you should be able to do the same using the helm charts. let us know when you try it again

yes sure. will do