This message was deleted.
# generals
Slackbot
08/14/2023, 12:22 PMThis message was deleted.
a
Abhishek Agarwal
08/14/2023, 12:53 PMwhat do you mean by "as it now can be queried as well"? Brokers don't query unused segments when building table schema
r
Renato Santos
08/14/2023, 12:54 PMI meant how it will handle with segments queried from https://druid.apache.org/docs/latest/querying/query-deep-storage/
Renato Santos
08/14/2023, 12:55 PMas those could also have a different schema
a
Abhishek Agarwal
08/14/2023, 12:56 PMI see what you mean now.
r
Renato Santos
08/14/2023, 12:57 PMmaybe this feature just still load the segment info in the ZK/historicals, but do not load the data on the historicals, so it already handle leastRestrictive perfectly
a
Abhishek Agarwal
08/14/2023, 12:58 PMthat drift/difference between off-historical/unused segments and used segments can indeed become an issue. Right now, the assumption is that the schema is the same. Though in future druid releases, some of us are thinking of devising a different mechanism for building table schema. A mechanism that doesn't rely on a segment being used.
Abhishek Agarwal
08/14/2023, 1:00 PMonce that materializes, a column that is only in the unused segment, can be queried from deep storage
3 Views