Hi Folks, I am experimenting with pinot merge and ...
# troubleshooting
a
Hi Folks, I am experimenting with pinot merge and rollup task It failed to download the segments from s3. Couldn't find and config reference for minions similar to server
pinot.server.segment.fetcher.protocols
Is it possible to use s3 deep store with minions? What is the config for this?
r
what's your configuration?
n
It's on this page, scroll all the way to the bottom https://docs.pinot.apache.org/basics/data-import/pinot-file-system/amazon-s3
a
Thank you! The task was able to download from s3
The merge and rollup worked but got another err
Copy code
2022/02/21 16:40:26.018 ERROR [PinotSegmentUploadDownloadRestletResource] [grizzly-http-server-0] Any segments from 'segmentsTo' should not be available in the table at this point
data returned by brokers is as expected, rows reduced after rollup but older segments still showed up in ideal state Tried deleting all segments and re pushing old segments from s3, but deleting all segments didn't cleared the segment lineage 2 of the old segments are effectively hidden from brokers point of view I'll now try deleting the segment lineage from zk