Sorry I am facing another issue while querying the table, after fixing the above issue with this code-change (https://github.com/apache/incubator-pinot/pull/5758). KafkaConsumer seems to be working fine now based on the logs on server node.

Caught exception while processing instance request
java.lang.NoSuchMethodError: java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer;
        at org.apache.pinot.core.common.datatable.DataTableBuilder.setColumn(DataTableBuilder.java:157) ~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
        at org.apache.pinot.core.query.selection.SelectionOperatorUtils.getDataTableFromRows(SelectionOperatorUtils.java:261) ~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
        at org.apache.pinot.core.operator.blocks.IntermediateResultsBlock.getSelectionResultDataTable(IntermediateResultsBlock.java:348) ~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
        at org.apache.pinot.core.operator.blocks.IntermediateResultsBlock.getDataTable(IntermediateResultsBlock.java:262) ~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
        at org.apache.pinot.core.operator.blocks.InstanceResponseBlock.<init>(InstanceResponseBlock.java:43) ~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
        at org.apache.pinot.core.operator.InstanceResponseOperator.getNextBlock(InstanceResponseOperator.java:37) ~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
        at org.apache.pinot.core.operator.InstanceResponseOperator.getNextBlock(InstanceResponseOperator.java:26) ~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
        at org.apache.pinot.core.operator.BaseOperator.nextBlock(BaseOperator.java:49) ~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]
        at org.apache.pinot.core.plan.GlobalPlanImplV0.execute(GlobalPlanImplV0.java:48) ~[pinot-all-0.5.0-SNAPSHOT-jar-with-dependencies.jar:0.5.0-SNAPSHOT-39a78f3df43ac613663975844e598f07b18bf623]

Which JDK version are you running?

java8

You are running a custom built pinot right? You sure maven picked up the proper JAVA_HOME?

yeah sorry forgot to mention this, running latest pinot code (+ my MR above). I have had a different setup where this was working with same jdk version and command.

I have the feeling your

mvn install

command to build pinot picked up a Java 11 or Java 14. You can try to explicitely set

export JAVA_HOME=<path-to-JDK8>

before running your maven build?

ah yeah i built it locally which has a different java version

Well, thanks to you for your contribution!