Using Pinot 1.4.0 Since Apache Pinot real-time Up...
# troubleshooting
b
Using Pinot 1.4.0 Since Apache Pinot real-time Upsert tables do not support storage tiering, what is the recommended production approach to handle storage growth instead of simply adding larger disks? Specifically, can we use LVM or ZFS pools to combine multiple disks? If so, will introducing these changes impact ingestion performance or query processing latency ..? Any noticeable increase cc: @Mayank, @Xiang Fu
x
technically yes, as long as they are mounted using POSIX
also if the upsert key won't be updated after X days, then you could actually use hybrid table, segment relocator etc
b
In pinot 1.4.0 > then you could actually use hybrid table Upsert table does not support this flow (RealtimeToOfflineSegmentsTask) > segment relocator Tiering does not support So our only option for now is to go with ZFS / LVM etc . So just wanted to know, Does it bring a noticeable latency ..? Or Is it better to stick with one single disk ..?
x
shouldn't be
I think we do support multiple directories for tiering
👍 1
you could actually mount different paths with different disk
ack 1
b
If tiering supported in 1.4.0 , Then we will go with that, Thank you ,...