Hello,
I want to know the maximum length limit of the string type in Druid, but I didn't find the limitation in the docs. Is there a limitation to that? We want to store long text like a database execution plan (max size could be 1MB). Is this a good use case for Druid?
j
John Kowtko
01/10/2025, 5:09 PM
This is not a specific strength of Druid, but Druid should be able to handle fairly large strings. I personally have seen 400k long strings in fields.
If you try this you may also want to test it out with disabling the indexes (
createBitmapIndex
) on that column during ingestion, to compare the differences in storage and query performance.
s
Sam
01/13/2025, 7:06 PM
Thank you for the reply! In this case, is the reason for turning off the bitmap about the concern of high cardinality?
j
John Kowtko
01/13/2025, 11:59 PM
Yes that's the general idea ... dictionary indexing benefits you when there is lots of repetition of values, but if there isn't then the dictionary isn't necessarily helping.