Hi Team, I see a setting like this in table definition under streamConfigMaps section.

realtime.segment.direct.realtime.offheap.allocation : true

Does this setting really exist ? If not why do pinot allow it to create the table in the first place?

Short answer: No,

realtime.segment.direct.realtime.offheap.allocation

is not a real/recognized Pinot setting. Everything under

streamConfigMaps

is just a free-form

Map<String, String>

that gets wrapped into an

org.apache.pinot.spi.stream.StreamConfig

. Validation of that map only enforces a small set of required keys — stream type, topic name, consumer factory class, and decoder class. Plans are to have more detailed guard rails in the future.