Hello, I want to know the maximum length limit of...
# general
s
Hello, I want to know the maximum length limit of the string type in Druid, but I didn't find the limitation in the docs. Is there a limitation to that? We want to store long text like a database execution plan (max size could be 1MB). Is this a good use case for Druid?
j
This is not a specific strength of Druid, but Druid should be able to handle fairly large strings. I personally have seen 400k long strings in fields. If you try this you may also want to test it out with disabling the indexes (
createBitmapIndex
) on that column during ingestion, to compare the differences in storage and query performance.
s
Thank you for the reply! In this case, is the reason for turning off the bitmap about the concern of high cardinality?
j
Yes that's the general idea ... dictionary indexing benefits you when there is lots of repetition of values, but if there isn't then the dictionary isn't necessarily helping.
👍 1