This message was deleted.
# troubleshooting
s
This message was deleted.
g
what do you mean by "problem"? they certainly pose challenges for any distributed DB, although druid's always been good at handling them relative to other options — esp. with features like bitmap indexes and pruning for fast filtering, & various approximate algorithms for ranking, counting, etc
d
oh? Maybe my knowledge is old then? I thought the bitmap index for string type could get really big on high cardinality columns?
g
I suppose it depends on what you mean by "really big" and whether you think it's worth it
IMO, if you do a lot of
=
or
in
on this column, it's worth whatever storage space it takes up in terms of performance improvement
if you never do filters like that, and you don't find the index useful, you can disable it on a column by column basis
createBitmapIndex: false
in the dimension definition in ingestion spec
d
Related question, in the old days, circa v0.15.x, broker/historical used to crash if you have very high cardinality string columns, does it no longer happen on groupBy v2 (since groupBy v2 can offload to disk)?
g
yeah, these days, worst you will get is ResourceLimitExceeded error
🙌 1