Can anyone suggest a link or an online document de...
# generald
deepuak01
09/24/2022, 3:59 PMCan anyone suggest a link or an online document describing how to set up apache pinot in AWS?
g
Ganesh
09/24/2022, 4:00 PMd
deepuak01
09/24/2022, 4:01 PMThanks Ganesh. But here in this link, it talks about installing Pinot in Kubernetes
deepuak01
09/24/2022, 4:01 PMIs there a doc or guide on setting up a cluster using AWS EC2?
m
Mayank
09/24/2022, 4:01 PM
What specifically are you looking for beyond that
Mayank
09/24/2022, 4:02 PM
Any reason you don’t want to use k8s?
d
deepuak01
09/24/2022, 4:02 PMWe dont have much expertise on running or maintaining k8s
deepuak01
09/24/2022, 4:03 PMIs there a reason why K8s used for deployement and not EC2?
m
Mayank
09/24/2022, 4:05 PM
Vendor agnostic
d
deepuak01
09/24/2022, 4:06 PMok. But do you have steps for creating cluster in EC2?
deepuak01
09/24/2022, 4:07 PMAlso if i use EKS in AWS, can i continue to host AWS S3 as my deep storage for segments?
g
Ganesh
09/24/2022, 4:10 PMMost of the organizations has adopted containers to run the services and Kubernetes is the goto container orchestration and management system at scale. hence K8S is the preferred system to deploy and operate Pinot.
Ganesh
09/24/2022, 4:12 PMyes you can use S3 as the deep store. https://docs.pinot.apache.org/users/tutorials/use-s3-as-deep-store-for-pinot
d
deepuak01
09/24/2022, 4:14 PMthank you @Ganesh
👍 1
deepuak01
09/24/2022, 4:15 PMAlso it would be really great if you could send steps to install cluster using AWS EC2 without k8s
g
Ganesh
09/24/2022, 4:21 PMIf you wanted to try out in EC2, then you can just download the binary build from here https://downloads.apache.org/pinot/apache-pinot-0.11.0/apache-pinot-0.11.0-bin.tar.gz
and follow the steps in https://docs.pinot.apache.org/basics/getting-started/running-pinot-locally#quick-start
👋 1
d
deepuak01
09/24/2022, 4:26 PMthank you very much
deepuak01
09/24/2022, 4:27 PMand just one more question. Is there a real difference between Pinot and Druid as i can see both are OLAP engines?
g
Ganesh
09/24/2022, 4:33 PMYes. There are many. Pinot is realtime, meaning that you can query the data as you ingest it and Pinot can serve end user facing analytics query at scale (100K QPS) with millisecond latency, which is not possible with many other OLAP systems.
👍 1
Ganesh
09/24/2022, 4:35 PMYou can read more about the performance here https://www.startree.ai/blog/what-makes-apache-pinot-fast-chapter-1
👍 2
d
deepuak01
09/25/2022, 2:17 PMHi @Ganesh Pinot support table joins?
m
Mayank
09/25/2022, 8:00 PM
The v2 engine does, however, it is early and still under development and testing
👍 1
g
Ganesh
09/26/2022, 9:35 AM@deepuak01 also you can try it out in the latest binary build or use latest docker image and share your feedback.
Doc:
https://docs.pinot.apache.org/developers/advanced/v2-multi-stage-query-engine
Docker image: https://hub.docker.com/r/apachepinot/pinot/tags
d
deepuak01
09/27/2022, 12:32 PMsure Ganesh will check this out