This message was deleted.
# generals
Slackbot
11/27/2022, 6:45 PMThis message was deleted.
a
Amatya Avadhanula
11/28/2022, 5:56 AMHi
https://github.com/apache/druid/pull/13287 helps with this duty and is supposed to be in Druid 25.0.0
r
ruan hui
11/28/2022, 6:01 AMThanks a lot. 😄
ruan hui
12/05/2022, 3:38 AMHi @Amatya Avadhanula
This patch really did great help. Thanks for the amazing work. But it didn’t solve all out problems, the snapshot building is still a little slow. So we used a thread pool with size 20 instead of a single thread do build it. Now the time of building is about 100 seconds. 😄
a
Amatya Avadhanula
12/05/2022, 3:51 AMHi @ruan hui, that's great to know.
It may be possible to optimize the snapshot creation as you say, but there may be another route you could explore..
How many rows do your segments have on average? 1.5 million segments is a lot, and there may be scope for reduction using rollup / compaction with range-partitioning etc if you haven't already enabled those.
r
ruan hui
12/05/2022, 4:54 AMThanks for pointing it out @Amatya Avadhanula I’ll discuss this with my team. Thanks a lot.😀