https://linen.dev logo
Join Slack
Powered by
This message was deleted.
# general
s
This message was deleted.
👋 1
s
Hi Jamie, this sounds cool! I will try poking around in your branch to see if I can spot something. The error message makes it sound like the module is not loaded correctly
You might also get better help posting this in #C030CMF6B70
j
Thanks, I will try that. The have solved that error, it was caused by the capitalisation on rabbitStream. I've got a new error to work through:
Copy code
2023-03-08T16:21:37,693 WARN [qtp107279519-181] org.eclipse.jetty.server.HttpChannel - /druid/indexer/v1/task
java.lang.NoClassDefFoundError: com/rabbitmq/stream/MessageHandler
        at java.lang.ClassLoader.defineClass1(Native Method) ~[?:?]
        at java.lang.ClassLoader.defineClass(ClassLoader.java:1017) ~[?:?]
s
when you copy the dependencies over you might want to use the pull-deps tool to do that - https://druid.apache.org/docs/latest/operations/pull-deps.html
The error makes me think that the extension needs some rabbitmq dependency that wasn't copied over to the class path
Alternatively, you can update the dist profile in your branch so that when you build druid, it bundles the extension for you.
j
I was having trouble getting the druid tag to build, hence the alternate strategy of moving the jars over. I'm only copying over the one jar, I assumed at some point it would complain about missing rabbitmq among others
s
Add the extension to this list here https://github.com/Agilicus/druid/blob/feature-add-rabbit-stream-indexing-service/distribution/pom.xml#L262
Copy code
<argument>-c</argument>              <argument>org.apache.druid.extensions.contrib:druid-rabbit-indexing-service</argument>
Then when you build druid with
Copy code
mvn -T1.0C -DskipTests -Dforbiddenapis.skip=true -Dcheckstyle.skip=true -Dpmd.skip=true -Dmaven.javadoc.skip=true -Danimal.sniffer.skip=true -Denforcer.skip=true -Dspotbugs.skip=true clean install -Pdist
It should correctly add the extension to the bundle that is created at 
$CODEBASE/distribution/target/apache-druid-26.0.0-SNAPSHOT-bin.tar.gz
I made one small change to the extension's pom here to reference the druid version 26.0.0-SNAPSHOT instead of 25.0.0 https://github.com/Agilicus/druid/blob/feature-add-rabbit-stream-indexing-service/extensions-contrib/rabbit-stream-indexing-service/pom.xml#L32
hopefully this unblocks your testing of the extension!
if it helps, here's all the dependencies it put in the rabbitmq extension directory
Copy code
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/netty-common-4.1.86.Final.jar
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/netty-transport-4.1.86.Final.jar
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/druid-rabbit-indexing-service-26.0.0-SNAPSHOT.jar
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/slf4j-api-1.7.36.jar
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/snappy-java-1.1.8.4.jar
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/lz4-java-1.8.0.jar
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/netty-codec-4.1.86.Final.jar
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/zstd-jni-1.5.2-3.jar
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/stream-client-0.9.0.jar
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/netty-buffer-4.1.86.Final.jar
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/netty-transport-native-unix-common-4.1.86.Final.jar
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/netty-handler-4.1.86.Final.jar
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/netty-resolver-4.1.86.Final.jar
apache-druid-26.0.0-SNAPSHOT/extensions/druid-rabbit-indexing-service/proton-j-0.34.0.jar
j
Okay thanks, that helps! We'll see what it does next
👍 1
Open in Slack
PreviousNext
Powered by