We have a offline table field truncating texts as ...
# general
c
We have a offline table field truncating texts as it exceed the default 512 length. Is it possible to change the default maxlength without having to reingest all the records to Pinot?
s
schema can be updated with configured default length and it will be picked up for new segments. However, it won't change anything for existing segments since the extra text was thrown away
c
Thanks, I tried to add maxLength to the field by editing schema in controller UI, but it retired as “backward incompatible schema, only allow adding new columns”. Do we have to recreate the schema and table?
Is there currently a configuration in Pinot to override the maxlength to bigger value than 512?
m
Yes, you can specify that in the field spec in the schema
c
Yes but I mean is there a cluster wide configuration to bump up the default maxlength?
m
You should be able to bump up the max length on a per table basis. Not sure why you got the error (perhaps you had backward incompatible change other than the max length change?) this is a per column setting and cannot be applied across columns or tables in the cluster
c
I am only adding “maxLength”:5120 or “maxLenth”:”5120” to one string column from the controller web UI “edit schema”. Would other Pinot API like CLI have less restrictions to edit schema?