We're running into deep storage as a limitation for growing our cluster. Has anyone else run into this and/or have some solutions? Our deep storage is a 17 TB mount and our turnover is ~ 3 TB / day.

all segments have to go through deep storage, so a big installation leads to massive amounts of traffic. What exactly is the limitation you run into?

Our limitation is on disk growth subject to iops limitations. As mentioned we do ~ 3 TB / day but we also peak around 500MBw/s. As such we have opted for file storage as opposed to, say, S3. We are considering Hadoop. But I'm interested to hear what others have faced/used in the community .

File storage? you mean

druid.storage.type=local

? Our deep storage is more than 100TB and (assuming that 3TB/day is segment size) are in the same range... how does that even work with local storage? Anyhow, over the years we have used HDFS, minio, and right now switched to a managed S3-compatible object store from our ISP (we run on bare metals)