https://pinot.apache.org/ logo
t

Tim Chan

09/11/2020, 3:18 PM
Is there a string length limitation for a string column. I’m seeing my data being truncated to 575 characters.
Am I supposed explicitly set a larger limit here?
message has been deleted
m

Mayank

09/11/2020, 3:26 PM
Yes
Can you also describe what operations you want to do on this column?
For example, if you would like to perform regex search, then perhaps text column type is better than string
t

Tim Chan

09/11/2020, 3:32 PM
this column is to store a json blob
we most likely won’t need to query the contents of the json either
m

Mayank

09/11/2020, 4:07 PM
Ok, in that case you should make this no-dict column, as I guess the cardinality will be high
t

Tim Chan

09/11/2020, 4:10 PM
where in the documentation can i read about this?
Copy code
{
  "name": "annotations_json_str",
  "dataType": "STRING",
  "maxLength": 250000
}
the maxLength is something i’m going to add
n

Neha Pawar

09/11/2020, 6:49 PM
noDictionary can be set in the table config’s indexing config: https://docs.pinot.apache.org/configuration-reference/table#table-index-config
m

Mayank

09/11/2020, 6:49 PM
Perhaps we should also think about default to no-dictionary in such cases
👍 1