hi everyone looks at the error when adding the realtime table, the error 500 (ClassNotFoundException: org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory)
INFO [AddTableCommand] [main] {"code": 500, "error": "org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory"}
x
Xiang Fu
10/27/2020, 10:49 PM
did you override the
JAVA_OPTS
env variable when you start pinot?
Xiang Fu
10/27/2020, 10:50 PM
basically this error means that the kafka2.0 plugins is not loaded
l
lâm nguyễn hoàng
10/28/2020, 12:43 PM
tks @Xiang Fu I have it fixed
lâm nguyễn hoàng
10/28/2020, 12:49 PM
hi @Xiang Fu plugin ParquetRecordReader batch ingestion parquetfile can be extracted and decoded in parallel??
x
Xiang Fu
10/28/2020, 8:44 PM
Can you elaborate more? For batch ingestion, if you have multiple segments, then each segment creation is independent.
Xiang Fu
10/28/2020, 8:45 PM
for kafka ingestion, each consuming thread will decode the message separately in their own thread.