Hi I want to start a discussion about removing `createInvert Apache Pinot #pinot-dev

Hi, I want to start a discussion about removing `c...

Jackie

02/26/2026, 8:38 PM

Hi, I want to start a discussion about removing

createInvertedIndexDuringSegmentGeneration

field so that inverted index behavior aligns with all other index types. Currently inverted index is not created by default (see this section) during segment creation, but all other indices are created. The proposal is to remove this flag and always create inverted index during segment creation as well. The side effect is larger deep store footprint, but reduced segment load time and consistent behavior across all indices. Please chime in if you have concern on this proposal.

➕ 4

thanks 1

Mayank

02/26/2026, 8:40 PM

Mayank

02/26/2026, 9:00 PM

Agree @Jackie. I think it was mostly for historical reasons where we wanted to optimize for segment size being sent over the wire via the controller. Now that we bypass the payload from being sent to the controller, it is better to have consistent behavior across all indices. Dev team, if you see any issues with this, lets bring it up.

👍 1

Johan Adami

02/27/2026, 3:05 AM

I’m not opposed. I don’t think we ever set this to false.

but all other indices are created

this isn’t quite true, right? • sorted index will only be done for new segments • startree indices have

enableDynamicStarTreeCreation

Jackie

02/27/2026, 3:18 AM

What I meant is that whenever an index is configured, it is created during segment creation, except for inverted index. All indices can be dynamic changed on server except for sorted index, which requires reordering records

👍 1

Open in Slack

Previous Next