hi everyone looks at the error when adding the re...
# general
l
hi everyone looks at the error when adding the realtime table, the error 500 (ClassNotFoundException: org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory) INFO [AddTableCommand] [main] {"code": 500, "error": "org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory"}
x
did you override the
JAVA_OPTS
env variable when you start pinot?
basically this error means that the kafka2.0 plugins is not loaded
l
tks @Xiang Fu I have it fixed
hi @Xiang Fu plugin ParquetRecordReader batch ingestion parquetfile can be extracted and decoded in parallel??
x
Can you elaborate more? For batch ingestion, if you have multiple segments, then each segment creation is independent.
for kafka ingestion, each consuming thread will decode the message separately in their own thread.