And another question: does the controller need to have a lot of cpu and memory, or just brokers and servers (i.e. servers have relatively small jvm heap size but a lot of extra memory for mmap'ed segments).
x
Xiang Fu
06/09/2020, 2:54 AM
Not necessarily
e
Elon
06/09/2020, 2:55 AM
That's good to know:) We use gcs to back up the segments, but in general it can be on a smaller node, no heavy network, cpu requirements?
x
Xiang Fu
06/09/2020, 3:47 AM
if you are using uri based push, then technically the only load is for zk read/write and some small operational related tasks like retention, validation, segment assignment etc
e
Elon
06/09/2020, 3:48 AM
Since we use gcs as the data directory that would mean we're using uri based push, right?
x
Xiang Fu
06/09/2020, 3:49 AM
for your segment push job , is job type segmetpush or segmentUriPush