We are planning to migrate from Azure to S3 for de...
# general
d
We are planning to migrate from Azure to S3 for deep storage. After transferring the data from Azure to S3, will Druid be able to load the data from S3 if we configure
druid.storage.type
to
s3
?
m
i think the location of the segments are also stored in metadata store. Those would still points to s3 so existing ingested data will still be pull from s3
d
Do you mean the location of segments in the metadata store is currently pointing to azure? The deep storage is currently set to azure. But we want to move it to s3.
m
I got that mixed/swaped. Yep, the location of segments in the metadata store right now would be pointing to azure
even if you change
druid.storage.type
to
s3
, those existing metadata would still points to azure
new ingested data after the change (
druid.storage.type
to
s3)
, would be s3
b
We need to update the segment location in druid_segments tables from Azure location to S3 bucket location. Take the dump of the table and run a query to update the segment location in druid_segments table.
d
that makes sense, thank you! @Maytas Monsereenusorn @Bibek Sahoo