Does Pinot provide any tool to merge small segments into bigger segments? We have mis-configuration creating a lot of small segments. This is problematic. I am wondering if we can mitigate it by merging the small segments.

There is a tool -

Note this merge task is for non realtime tables, i.e. offline.

@User Does it work if we relocate our realtime segments to offline servers by the SegmentRelocator periodic task? May be it’s already covered in the video, I am yet to watch it.

There is also the Real-Time to Offline Job that takes data from real-time tables and writes it to offline-tables. It creates the new segments based on time boundaries as well, which I think means that you could configure it to create offline segments that contained more rows than the real-time segments.