Hi team, question regarding MultiValueFixedByteRaw...
# pinot-dev
j
Hi team, question regarding MultiValueFixedByteRawIndexCreator. For
put*MV
, is there any particular reasons for storing
value.length
as am integer on line 112-113? It is redundant as
indexWriter.putBytes
already record the payload length and the # of elements can be derived from the
len(byte[]) / sizeof(int|float|long|double)
. The motivation for asking this question is because removing the redundant length here sometimes improves the compression ratio by as much as 2-3x.
x
cc: @Jackie