Pradeep
02/09/2021, 7:07 PMSegmentMessageHandlerFactory
is not getting registered for some reason.
When I restart the server I don’t see Logs from this function beyond this point.
(https://sourcegraph.com/github.com/apache/incubator-pinot/-/blob/pinot-server/src/ma[…]org/apache/pinot/server/starter/helix/HelixServerStarter.java)
Subscribing changes listener to path: /PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES, type: CALLBACK, listener: org.apache.helix.messaging.handling.HelixTaskExecutor@4b9419ff
Subscribing child change listener to path:/PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES
Subscribing to path:/PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES took:0
21 START:INVOKE /PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES listener:org.apache.helix.messaging.handling.HelixTaskExecutor@4b9419ff type: CALLBACK
Resubscribe change listener to path: /PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES, for listener: org.apache.helix.messaging.handling.HelixTaskExecutor@4b9419ff, watchChild: false
Subscribing changes listener to path: /PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES, type: CALLBACK, listener: org.apache.helix.messaging.handling.HelixTaskExecutor@4b9419ff
Subscribing child change listener to path:/PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES
Subscribing to path:/PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES took:1
The latency of message dbb39d17-cece-4f3c-bd88-29fb61a93863 is 922470 ms
Fail to find message handler factory for type: USER_DEFINE_MSG msgId: dbb39d17-cece-4f3c-bd88-29fb61a93863
The latency of message 4c8dffc3-68cf-417e-8cd2-a572ce4cdcb4 is 42 ms
Fail to find message handler factory for type: USER_DEFINE_MSG msgId: 4c8dffc3-68cf-417e-8cd2-a572ce4cdcb4
21 END:INVOKE /PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES listener:org.apache.helix.messaging.handling.HelixTaskExecutor@4b9419ff type: CALLBACK Took: 7ms
Xiang Fu
Pradeep
02/09/2021, 8:57 PMXiang Fu
Pradeep
02/09/2021, 8:59 PMXiang Fu
pinot.set.instance.id.to.hostname=true
Pradeep
02/09/2021, 9:08 PMpinot.set.instance.id.to.hostname=true
Xiang Fu
Pradeep
02/09/2021, 9:24 PMXiang Fu
/opt/pinot/conf/pinot-server-log4j2.xml
Pradeep
02/09/2021, 9:27 PMXiang Fu
-Dlog4j2.configurationFile=/opt/pinot/conf/pinot-server-log4j2.xml
to the existing JAVA_OPTS
(I think you must already configured it ) when you start up pinot serverPradeep
02/09/2021, 9:31 PM-Dlog4j2.configurationFile=conf/pinot-admin-log4j2.xml
yup it’s setupXiang Fu
conf/pinot-admin-log4j2.xml
should tell where the log files are locatedPradeep
02/09/2021, 9:42 PMsudo docker logs <container_id>
Xiang Fu
Pradeep
02/09/2021, 9:52 PMXiang Fu
Pradeep
02/09/2021, 9:56 PMXiang Fu
Pradeep
02/09/2021, 9:57 PMXiang Fu
Pradeep
02/09/2021, 9:58 PMXiang Fu
Pradeep
02/09/2021, 10:05 PM/segments/{tablename}/{segment}/reload
Subscribing changes listener to path: /PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES, type: CALLBACK, listener: org.apache.helix.messaging.handling.HelixTaskExecutor@4b9419ff
Subscribing child change listener to path:/PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES
Subscribing to path:/PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES took:7
21 START:INVOKE /PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES listener:org.apache.helix.messaging.handling.HelixTaskExecutor@4b9419ff type: CALLBACK
Resubscribe change listener to path: /PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES, for listener: org.apache.helix.messaging.handling.HelixTaskExecutor@4b9419ff, watchChild:
false
Subscribing changes listener to path: /PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES, type: CALLBACK, listener: org.apache.helix.messaging.handling.HelixTaskExecutor@4b9419ff
Subscribing child change listener to path:/PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES
Consumed 0 events from (rate:0.0/s), currentOffset=4037, numRowsConsumedSoFar=0, numRowsIndexedSoFar=0
Subscribing to path:/PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES took:3
The latency of message 2334f0d8-e251-4f75-85f0-c4db72623b31 is 136141 ms
Fail to find message handler factory for type: USER_DEFINE_MSG msgId: 2334f0d8-e251-4f75-85f0-c4db72623b31
The latency of message f41b6769-5f43-4982-bd40-5c8e43dbd9ac is 60 ms
Fail to find message handler factory for type: USER_DEFINE_MSG msgId: f41b6769-5f43-4982-bd40-5c8e43dbd9ac
21 END:INVOKE /PinotCluster/INSTANCES/Server_10.0.101.11_8069/MESSAGES listener:org.apache.helix.messaging.handling.HelixTaskExecutor@4b9419ff type: CALLBACK Took: 9ms
Xiang Fu
Pradeep
02/09/2021, 10:09 PMXiang Fu
Pradeep
02/09/2021, 10:10 PMXiang Fu
// Register message handler factory
SegmentMessageHandlerFactory messageHandlerFactory =
new SegmentMessageHandlerFactory(fetcherAndLoader, instanceDataManager, serverMetrics);
_helixManager.getMessagingService()
.registerMessageHandlerFactory(Message.MessageType.USER_DEFINE_MSG.toString(), messageHandlerFactory);
Pradeep
02/09/2021, 10:15 PMXiang Fu
Pradeep
02/09/2021, 10:19 PMXiang Fu