This message was deleted.
# generals
Slackbot
08/21/2023, 9:09 AMThis message was deleted.
s
Saurav Chirania
08/21/2023, 9:10 AMI am using HDFS as deep storage, wanted to check if I can specify two HDFS clusters instead of one
j
John Kowtko
08/21/2023, 4:06 PMI don't know that you can specify multiple HDFS storage locations.
In the commercial (Imply) version of Druid you can specify AWS S3 file locations, in which case S3 should take care of the high availability for you: https://docs.imply.io/latest/druid/development/extensions-core/hdfs/#configuration-for-cloud-storage
Not sure if this is available in OSS Druid though.
e
El Hakan
08/21/2023, 4:16 PMThat is a great question. am also curious to know that 🙂
d
Didip Kerabat
08/21/2023, 9:19 PMHow much money do you have?
If you have the budget, you can design your entire redundant S3 story using Alluxio. But they are pricy.