https://pinot.apache.org/ logo
Join Slack
Powered by
Hello team :wave: Is there any way to remove field...
# troubleshooting
l
Hello team 👋 Is there any way to remove fields from a schema? I know that this is counted as a breaking change, but it would be nice to be able to do it anyway if it was explicitly intentional. I have a field right now which is set to null, and which we've decided to not include. The only way right now to get rid of that field would be to delete the entire table, recreate the schema and start ingesting the data again, but this isn't a very friendly solution. Any suggestions?
I don't see any technical reason for why it shouldn't be possible to remove a field from the schema
The current segments are immutable. It would simply mean the segments would contain the data, and they would no longer be included in queries.
I guess it's possible that such a change could interfere with minion tasks.. But perhaps there would be a way to implement this in a synchronized way
m
I think you could delete the schema without needing to delete the table
and then add the schema back again
1. Delete schema 2. Add new schema 3. Go to existing segments and re-load them
l
You can't delete a schema that is in use unfortunately, @Mark Needham. At least that's how I remember it
m
I tried it out on a table that I had locally and it let me do it somehow
that was on v 1.9.3
0.9.3
maybe it got disabled on later versions
l
I'll give it another go
Did you call the schema deletion API to do it, or through the UI @Mark Needham?
m
I did it in the UI
so when I first deleted it the query was still showing the fields
even with no schema
and even with a schema with the field removed
2 Views
Open in Slack
PreviousNext
Powered by