Hi folks! The <documentation about Sorted Inverted...
# troubleshooting
d
Hi folks! The documentation about Sorted Inverted Index doesn't tell how to configure that; How can that be done?
d
I'm already creating inverted indexes and I understood that if a column is sorted Pinot will create a sorted index for it, but what about "sorted inverted" ones? I just have to define a column that is sorted before ingestion that it should have an inverted index then? There's no specific configuration for "sorted inverted", at least I didn't find it there
m
That is just saying that sorted forward index also duals as inverted index. There isn’t and additional sorted inverted index. It is a bit confusing, could we make it more readable @Mark Needham
d
Ah, ok then. So if the column is already sorted I don't need to do anything, just ingest it, right?
m
For real-time I recommend specifying it as sorted in table config
d
It's for offline ingestion
m
Ok, then if data is already sorted, that is enough
d
Ah, cool. Thanks man!
m
will edit the docs
but while I was understanding sorted indexes I wrote this - https://www.markhneedham.com/blog/2022/01/20/apache-pinot-sorted-indexes-realtime-tables/
d
I'll take a look, thanks man. I'll use for offline tables though.
m
the way sorted indexes work is slightly different than with real-time but I worked through it in the post
lemme know if it doesn't make sense
d
I'll take a look, thanks for the heads up 🙂
It does, yeah... so basically I just need to make sure the column I want as a sorted index is, to start with, sorted in the source.