So, I just created a table with >40k rows, but with daily segments, 318 segments in total - not good, I want to rollup to monthly segments later -, and defined a JSON index for my main columns which contain dynamic data (data that just can't be defined as static columns). Even trying to brutalize this thing by querying all the data with a limit that surpasses the amount of rows I still get ~600ms queries! Geez, this thing is fast! 🙂

Yes, it it fast 🙂. In your case, the data size seems small as well.

It's quite small, yes. 1 year of data, ~215 MB total size. It could easily fit a month of data for each segment - for larger regions of data for us this will be a good size.

Man we had like 19k segments in Pinot once 😄

Wow, that's quite a lot 😄 Did you end up using some partitioning for pruning segments?

We just used the default time based pruning on a column.

Cool. Sounds good enough 🙂