https://pinot.apache.org/ logo
e

Elon

06/09/2020, 12:41 AM
And another question: does the controller need to have a lot of cpu and memory, or just brokers and servers (i.e. servers have relatively small jvm heap size but a lot of extra memory for mmap'ed segments).
x

Xiang Fu

06/09/2020, 2:54 AM
Not necessarily
e

Elon

06/09/2020, 2:55 AM
That's good to know:) We use gcs to back up the segments, but in general it can be on a smaller node, no heavy network, cpu requirements?
x

Xiang Fu

06/09/2020, 3:47 AM
if you are using uri based push, then technically the only load is for zk read/write and some small operational related tasks like retention, validation, segment assignment etc
e

Elon

06/09/2020, 3:48 AM
Since we use gcs as the data directory that would mean we're using uri based push, right?
x

Xiang Fu

06/09/2020, 3:49 AM
for your segment push job , is job type segmetpush or segmentUriPush
our typical recommend size are
Copy code
vcore	ram(GB)
	
4	16
8	32
16	64
depends on the workload
you can start with smallest
e

Elon

06/09/2020, 3:50 AM
sounds good, thanks!