Hello i'd like to update `segment.realtime.downloa...
# troubleshooting
m
Hello i'd like to update
segment.realtime.download.url
field i can get with the API endpoint /segments/{tableName}/{segmentName}/metadata. I can't find a documented method to do it, any ideas plz ?
m
What’s the use case for this? It would be dangerous to simply allow overwriting this metadata.
m
data migration for testing purpose
m
I’d suggest to use higher level constructs like segment metadata push and build your scriptware using those apis. Mucking around with metadata directly is prone to issues that may put systems in unrecoverable state
m
Hello i've followed your idea and it's ok, thks :) I'm stuck to adapt tableConfigs for realtime tables i've duplicated in an other pinot.
Copy code
Failed to read table size for test_REALTIME
shaded.com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: Failed to find instance config for: Server_pinot-server-0.pinot-server-headless.test.svc.cluster.local_8098
I can't find where this information is stored in zookeeper or with which API endpoint i could update it.
m
Why do you need to read the size? If I understand correctly, you are trying to copy one pinot cluster to another location? If so, you can simply create the new table and push the data. Is there a realtime component as well, or this is a offline only?
m
i'm not the data owner, i managed the infrastructure. What i've done : • copy segments from server • restore IDEALSTATES/PROPERTYSTORE from zookeeper • update tables/segments metadata via api • rebalance we can query datas but the tables button from webUI is not working due to the error mentionned above
what would be the ideal procedure in your opinion ?
• copy segments from pinot-server • import tables via api from source api exports • import segment metadatas via api from source api exports
m
Need to understand the requirements a bit, let me dm