hello One question like in controller we define

controller.data.dir

to s3 location there is no need to define this type of property in server config? like how server know where to push the segment to deepstore? in this page server properties doesn’t have s3 location https://docs.pinot.apache.org/users/tutorials/use-s3-as-deep-store-for-pinot

Servers don’t push segments to deep store, they pull segments from deep store. When the controller assigns segments to servers, part of this context is the segment location (in S3, in your case). The server config (as described on the page you reference) does need to contain information required to read from the S3 filesystem (e.g.

pinot.server.storage.factory.class.s3

).

Hi Ken, server don’t push segments to deep store even when split commit is enabled?

Great question! Not sure, I've never used the split command. @Mayank any insight here?

It should be possible, however I’ve been trying to get it to work without much luck . According to to decoupling controller from the data path: “When this is enabled, the Pinot servers will attempt to upload the completed segment to the segment store directly, thus by-passing the controller.“, which makes sense if you want to prevent a bottleneck

Let me review your configs agains, I’ll ping shortly