Hi all, i had setup an pinot cluster and minio s3 as a deep storage to store my data. but it is not uploading any segments to minio s3. please help if anyone worked on deepstorage with s3.

ok

HI mayank

hi mayank i have tried the above but it is storing the tmp segments to minio

Is it real-time table?

yes

How often are segments committed? Are you sure you are checking after segment commit?

for every 3 seconds the file is creating in minio

That seems odd

segments flush time is 24h

Deepstore only stores permanently committed segments. I am unsure what tmp you are seeing. May be you configured the tmp dir to also be on deepstore? That should be local

this we need to configure in server.conf or controller.conf

Both

can u please share an small video or an example of the configuration of controler.conf and server.conf files

We have it for S3, but not minio https://docs.pinot.apache.org/basics/components/deep-store#configuring-the-deep-store