I m having some trouble running pinot locally in debug mode Apache Pinot #pinot-dev

I’m having some trouble running pinot locally in d...

Evan Galpin

06/01/2023, 11:44 PM

I’m having some trouble running pinot locally in debug mode launched via intelliJ. When I start up the server, I get the following message:

Copy code

java.lang.reflect.InvocationTargetException: null
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
	at org.apache.helix.messaging.handling.HelixStateTransitionHandler.invoke(HelixStateTransitionHandler.java:350) ~[helix-core-1.0.4.jar:1.0.4]
	at org.apache.helix.messaging.handling.HelixStateTransitionHandler.handleMessage(HelixStateTransitionHandler.java:278) [helix-core-1.0.4.jar:1.0.4]
	at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:97) [helix-core-1.0.4.jar:1.0.4]
	at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:49) [helix-core-1.0.4.jar:1.0.4]
	at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:264) [?:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java) [?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]

Caused by: java.lang.ClassNotFoundException: org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory

I can see clearly that the class in question does in fact exist. I’ve built fresh from source using:

Copy code

mvn clean install package -DskipTests -Pbin-dist

I’ve reimported maven projects in intelliJ. I’ve invalidated caches and restarted any and everything. Any thoughts on how or why this would be happening? What am I missing?

Mayank

06/02/2023, 2:11 PM

Which module are you running it from? Not all modules may include the plug-in packages

Evan Galpin

06/02/2023, 4:25 PM

@Mayank I’m running via HelixServerStarter as mentioned by the docs example: https://github.com/apache/pinot/commit/83fc63720cdf2a5470073d43183ae8710d0ecc51

Evan Galpin

06/02/2023, 4:32 PM

this is a great tip though, I hadn’t thought of local modules not including others individually, Vs running the shaded jar that’s produced by the build process. I’ll play with deps in the pom of pinot-server

Evan Galpin

06/02/2023, 6:16 PM

yep, adding this to the pinot-server pom worked:

Copy code

<dependency>
      <groupId>org.apache.pinot</groupId>
      <artifactId>pinot-kafka-2.0</artifactId>
      <version>${project.version}</version>
      <scope>runtime</scope>
    </dependency>

Thanks Mayank!

🙏 1

Open in Slack

Previous Next