Hi team I am currently looking into the indexes av...
# pinot-dev
s
Hi team I am currently looking into the indexes available in Pinot. While i have understood most of the parts of Forward indexes, I am not able to find the internal working of forward indexes.Internally are they implemented using B-trees or any other method?
👍 1
g
Hi there. Most (if not all) indexes are documented in https://docs.pinot.apache.org/basics/indexing/forward-index and sibling pages. That specific page explains the layout of the forward index. The TL;DR is that they are not btree indexes. The forward index is the way we store data and they are either an offheap array when the data type is fixed size (like ints, floats, but also strings where all entries have the same size) or a little bit more complex structure in other cases
we also have other indexes like inverted indexes which we use to improve performance on queries that look for a specific value.
s
ok thank you.I have checked the above docs but I could not find the exact backend implementation.Thanks for the clarification.