Hi All , We are trying load the segments (SegmentMetadataPush) onto the pinot cluster but scaling is not working as expected What would be the recommended number of controllers , servers , zookeepers and brokers configuration to load about 460 gb of data ? also recommend memory for each if possible Thanks in advance 😃

how do you push ? are you using multi-threads for pushing or just single thread/sequential push? MetadataPush is kind of client-side heavy, client side will download the segments, uncompress and extract the metadta property file then compile the metadata to push. Ideally you can have as many as the number of segments parallelism for you push job, which should be the fastest .