I have recently switched from local storage to s3 ...
# general
a
I have recently switched from local storage to s3 deep storage. First I have changed the configs for controller pod and updated segments. But it seems they are stuck in updating. Can you help me or tell if there's any other step involved while migrating from local to s3 deep storage?
h
Hi @Adarsh Saxena. Can you provide the controller and server configs with security creds obfuscated?
a
Controller config
@Hubert Dulay
h
Try testing with the aws cli to see if the creds and accessibility work.
a
yes, they are working, for the new tables added, content is going to s3. But for the existing table (before changing config from local to s3), they are giving error as follows: Error Code: 305 null: 3 segments unavailable: [events__0__0__20240610T1441Z, events__0__2__20240610T1741Z, events__0__1__20240610T1541Z]
Do I manually need to move the segments as they were previously present in the server pod but now it's searching them in S3 because of config change? If so, is there any script to do or some ingestion job or something already present/documented?
h
I haven't tried deepstore migration to S3 yet. cc @Mayank
s
hello .We donot have cloudstorage and we want configure local storage of virtual machine disk partition as deep storage .How can we do.Can anyone provide me configuration
m
If you have more than one controllers (which you should in production), you'd need some mount that these controllers can share, so local disk is not an option. You can try NFS or similar solutions.