Hi All. If We build a pinot cluster without deep ...
# troubleshooting
c
Hi All. If We build a pinot cluster without deep storage , The controller will store all the segments in controller disk configured in
controller.data.dir
, If there have some methods to delete controller segments with retention times, since we don’t have enough disk space to store in controller?
n
In the table config, you can set retentionTimeValue and retentionTimeUnit. Check out the table config documentation
c
Thx for your replay, But I am confused that, if we keep table retentionTimeValue very long like 1 year , all the segments still need stored in controller, which will make controller node full quickly
n
Typically, you would attach an NFS to the contollers for this.
@Xiang Fu any other suggestions from your experience ? ^^
x
right, all segments are kept in segment tar gz format in controller for backup purpose. If you don’t keep that copy in controller, then once you lost a server, you may not have that segment recovered.
c
Thx @Xiang Fu