Is there a string length limitation for a string column I m

Question

Is there a string length limitation for a string column I m seeing my data being truncated to 575 characters

Tim Chan · Answer

Am I supposed explicitly set a larger limit here

Mayank · Answer

Yes

Mayank · Answer

Can you also describe what operations you want to do on this column

Mayank · Answer

For example if you would like to perform regex search then perhaps text column type is better than string

Tim Chan · Answer

this column is to store a json blob

Tim Chan · Answer

we most likely won t need to query the contents of the json either

Mayank · Answer

Ok in that case you should make this no dict column as I guess the cardinality will be high

Tim Chan · Answer

where in the documentation can i read about this

Tim Chan · Answer

``` name annotations json str dataType STRING maxLength 250000 ```

Tim Chan · Answer

the maxLength is something i m going to add

Neha Pawar · Answer

noDictionary can be set in the table config s indexing config <https docs pinot apache org configuration reference table table index config>

Mayank · Answer

Perhaps we should also think about default to no dictionary in such cases