Hi All,
Is there any way to not index a String fie...
# generala
AR
04/08/2025, 4:45 AMHi All,
Is there any way to not index a String field when ingesting using MSQ? We have a few fields which have long string values but they will not be used for filtering. They are only needed in the query response. For such fields, is there a way to specify that they should only be stored but not indexed?
Thanks,
AR.
g
Gian Merlino
04/08/2025, 3:16 PMnot currently, although my hope is that this and any other dimension / indexing parameters can be specified in the future using the catalog (a nascent feature)
Gian Merlino
04/08/2025, 3:16 PMthe idea would be you would specify this at a table level rather than in each job
a
AR
04/08/2025, 4:35 PMA setting at table level would be perfect. But since Druid doesn't have the concept of a CREATE TABLE, I am not sure how to specify this if it is not included in the ingestion spec.
Thanks,
AR.
g
Gian Merlino
04/08/2025, 4:52 PMthere isn't a way to do it today, but as the catalog feature is developed, you'd be able to specify it at the catalog (which is table-level)
Gian Merlino
04/08/2025, 4:52 PMso, this is more of a stay-tuned thing
a
AR
04/09/2025, 4:34 PMI was just wondering aloud how/when the catalog would be created for a table since there is no DDL to create a table. But I will watch out for this. Definitely something that will help with data size management.
Thank you.