Hello Team, I'm encountering an issue with rebalan...
# general
k
Hello Team, I'm encountering an issue with rebalancing data across servers in Apache Pinot and would appreciate your guidance. Previously, I learned that the "rebalance server tenant" is used to rebalance data when a new server is added. However, when I navigate to the Pinot UI, the rebalancing option appears to be disabled. Could you please clarify why this option might be grayed out? Is there a specific configuration or prerequisite I need to enable for this functionality to become active? Any insights or steps I should take to resolve this would be greatly appreciated. I'm attaching a picture for reference. Thank you!
n
@Kavan - Can you try the Tenant rebalance API via Swagger API?
We never had an option to do tenant rebalance from UI.
k
I haven't tried by using rebalance API through Swagger API, as it was showing option of Tenant rebalance, so may be it would be possible through UI. Maybe this option is available in pinot 1.3+ versions. Can you enlighten me how it is possible through Swagger API.
n
Here is an API. You need to pass on the tenant's name.
a
Is it possible that you might have only 1 server in your deployment?
k
Thank You @Nitin Garg for response.
@Aleksandrs Vedernikovs I have 2 servers currently and if scaling happens then how the data handled by 2 servers will be distributed to 3rd server so that new server(3rd server) can also handle the data, to reduce load on 2 servers. So, my question is how do we handle that?
a
You would need to change replication in table config and run a rebalance, given new server is part of an existing tenant and has appropriate tags https://docs.pinot.apache.org/operators/operating-pinot/rebalance/rebalance-servers
ahh looks like Nitin already shared the Doc
k
@Aleksandrs Vedernikovs My concern is if it gets scaled at night for instance, than how manually rebalancing would be feasible. Isn't there any alternative or any other option for this which we can apply? Or make it automatic process? Or is there is any gap in my understanding for servers? Please enlight me. As currently I'm using Elastic Kubernetes Service(EKS AWS) so the servers running inside may get scaled according to traffic coming.
a
Yea, I hear you. This is currently not possible! We do not yet support auto scale in/out.
k
Okay @Aleksandrs Vedernikovs got it, Thank you for your response.
🫡 1