Question about

SegmentCreationAndMetadataPush

(Recommended for production environments where Pinot deep store is configured): Use this job to bypass the controller, and send the segment payload directly to the data store. Could you please explain in more detail? I want to know why this is to bypass the controller. When this job is finished, segment file (tar.gz) is stored in outputDir not stored in controller.data.dir. Can I understand the controller is bypassed because it is not saved in controller.data.dir ?