average-autumn-35845
06/06/2021, 11:42 AMaverage-autumn-35845
06/06/2021, 11:49 AMCaused by: java.lang.ClassCastException: com.linkedin.metadata.key.CorpUserKey cannot be cast to com.linkedin.identity.CorpUserInfo
at java.util.Optional.ifPresent(Optional.java:159)
at com.linkedin.metadata.kafka.hydrator.CorpUserHydrator.getHydratedEntity(CorpUserHydrator.java:42)
at com.linkedin.metadata.kafka.hydrator.HydratorFactory.getHydratedEntity(HydratorFactory.java:32)
at com.linkedin.metadata.kafka.transformer.DataHubUsageEventTransformer.setFieldsForEntity(DataHubUsageEventTransformer.java:106)
at com.linkedin.metadata.kafka.transformer.DataHubUsageEventTransformer.transformDataHubUsageEvent(DataHubUsageEventTransformer.java:71)
at com.linkedin.metadata.kafka.DataHubUsageEventsProcessor.consume(DataHubUsageEventsProcessor.java:44)
at sun.reflect.GeneratedMethodAccessor51.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.messaging.handler.invocation.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:171)
at org.springframework.messaging.handler.invocation.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:120)
at org.springframework.kafka.listener.adapter.HandlerAdapter.invoke(HandlerAdapter.java:48)
at org.springframework.kafka.listener.adapter.MessagingMessageListenerAdapter.invokeHandler(MessagingMessageListenerAdapter.java:283)
at org.springframework.kafka.listener.adapter.RecordMessagingMessageListenerAdapter.onMessage(RecordMessagingMessageListenerAdapter.java:79)
at org.springframework.kafka.listener.adapter.RecordMessagingMessageListenerAdapter.onMessage(RecordMessagingMessageListenerAdapter.java:50)
at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.doInvokeOnMessage(KafkaMessageListenerContainer.java:1327)
at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.invokeOnMessage(KafkaMessageListenerContainer.java:1307)
at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.doInvokeRecordListener(KafkaMessageListenerContainer.java:1267)
... 8 common frames omitted
Seems that MAE-consumer got some bugsloud-island-88694
green-football-43791
06/06/2021, 6:52 PMgreen-football-43791
06/06/2021, 6:53 PMDataHubUsageEventTransformer
which Datahub uses to power usage analyticsgreen-football-43791
06/06/2021, 6:55 PMgreen-football-43791
06/06/2021, 6:58 PMdatahub check
? It's possible if you are not running with enough RAM (8gb is sufficient- less may cause problems) then elasticsearch may encounter difficulties.
3. have you tried running ./docker/ingestion/ingestion.sh
? this ingests sample data. I'm curious to see if that sample data is browsable- if so, the issue may be related to the data you are ingesting at the momentbig-carpet-38439
06/06/2021, 10:24 PMaverage-autumn-35845
06/07/2021, 2:07 AMbig-carpet-38439
06/07/2021, 3:48 AM