Hey, quick question regarding storage expansion. W...
# generalr
Rohit Anilkumar
01/17/2023, 3:22 PMHey, quick question regarding storage expansion. We have a pinot cluster on EC2 instance(each component on a different instance). Lets say we have provisioned X GB EBS on the server instances. If a situation arises where 90% of X gets utilised, instead of adding more EC2 instances as servers, can one possibly extend the EBS alone- probably having a lambda to run an ebs expansion on that particular instance rather than adding more compute? Is this possible in pinot without any downtime?
Rohit Anilkumar
01/17/2023, 3:24 PMAlso if we have to add an ec2 instance, do we run a rebalance or will the cluster picks up the new server without running a rebalance?
Rohit Anilkumar
01/17/2023, 6:26 PMRealtime ingestion btw
Rohit Anilkumar
01/17/2023, 6:26 PM@Mayank @Xiang Fu @Kishore G
x
Xiang Fu
01/17/2023, 6:29 PM
Yes
Xiang Fu
01/17/2023, 6:31 PM
If you use EC2 + EBS directly, try to increase EBS storage directly. If ebs supports runtime expansion, technically you don’t have to do anything, just ssh to ensure the disk expansion is there.
Xiang Fu
01/17/2023, 6:31 PM
Or expand ebs then restart ec2 instance
r
Rohit Anilkumar
01/17/2023, 6:33 PMSo in case we reach a capacity limit, triggering a lambda which in turn adds an EBS and mounts it should not lead to a downtime in RT ingestion. Everything should work just fine
x
Xiang Fu
01/17/2023, 6:35 PM
Yes, as long as they are mounted at same directory
Xiang Fu
01/17/2023, 6:35 PM
Would suggest to try it out once and confirm the procedure
Xiang Fu
01/17/2023, 6:35 PM
Should be very straightforward
r
Rohit Anilkumar
01/17/2023, 6:36 PMYes i can configure the lambda to do that. Yes. Let me try it out. Just wanted to check before i go ahead with it
👍 1