Hi Everyone, Looking for help/suggestions to tack...
# troubleshoot
p
Hi Everyone, Looking for help/suggestions to tackle an error that I'm encountering. I'm new to datahub. I deployed datahub on my mac M1 using the docker instructions. I was able to ingest sample data and also run a Kafka ingestion job. Now I'm looking to explore the Metadata Audit Event Consumer. I'm following the instructions documented here. I cloned the datahub project on my mac, after fixing all the basic environment related errors - I've hit this exception. I looked around in the slack channels to see if this problem has been discussed before. I could not find something close to this one. Command :
./gradlew :metadata-jobs:mae-consumer-job:bootRun
Error :
Copy code
> Task :metadata-jobs:mae-consumer-job:bootRun FAILED
ERROR StatusLogger Log4j2 could not find a logging implementation. Please add log4j-core to the classpath. Using SimpleLogger to log to the console...

  .   ____          _            __ _ _
 /\\ / ___'_ __ _ _(_)_ __  __ _ \ \ \ \
( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
 \\/  ___)| |_)| | | | | || (_| |  ) ) ) )
  '  |____| .__|_| |_|_| |_\__, | / / / /
 =========|_|==============|___/=/_/_/_/
 :: Spring Boot ::               (v2.5.12)

2023-02-10 12:15:53,225 [main] INFO  org.eclipse.jetty.util.log - Logging initialized @1412ms to org.eclipse.jetty.util.log.Slf4jLog
2023-02-10 12:15:53,306 [main] INFO  org.eclipse.jetty.server.Server - jetty-9.4.45.v20220203; built: 2022-02-03T09:14:34.105Z; git: 4a0c91c0be53805e3fcffdcdcc9587d5301863db; jvm 11.0.18+0
2023-02-10 12:15:53,319 [main] INFO  o.e.j.s.h.ContextHandler.application - Initializing Spring embedded WebApplicationContext
2023-02-10 12:15:53,411 [main] INFO  org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0
2023-02-10 12:15:53,411 [main] INFO  org.eclipse.jetty.server.session - No SessionScavenger set, using defaults
2023-02-10 12:15:53,412 [main] INFO  org.eclipse.jetty.server.session - node0 Scavenging every 660000ms
2023-02-10 12:15:53,415 [main] INFO  o.e.j.server.handler.ContextHandler - Started o.s.b.w.e.j.JettyEmbeddedWebAppContext@16c8e9b8{application,/,[file:///private/var/folders/gm/8g6pqmz169j1p9mzzfkz9k1w0000gn/T/jetty-docbase.9091.3795745778604343479/],AVAILABLE}
2023-02-10 12:15:53,415 [main] INFO  org.eclipse.jetty.server.Server - Started @1603ms
2023-02-10 12:15:53,482 [main] INFO  org.eclipse.jetty.server.session - node0 Stopped scavenging
2023-02-10 12:15:53,483 [main] INFO  o.e.j.server.handler.ContextHandler - Stopped o.s.b.w.e.j.JettyEmbeddedWebAppContext@16c8e9b8{application,/,[file:///private/var/folders/gm/8g6pqmz169j1p9mzzfkz9k1w0000gn/T/jetty-docbase.9091.3795745778604343479/],STOPPED}
ERROR LoggingFailureAnalysisReporter 

***************************
APPLICATION FAILED TO START
***************************

Description:

Parameter 0 of constructor in com.linkedin.metadata.kafka.boot.DataHubUpgradeKafkaListener required a bean of type 'org.springframework.kafka.core.DefaultKafkaConsumerFactory' that could not be found.


Action:

Consider defining a bean of type 'org.springframework.kafka.core.DefaultKafkaConsumerFactory' in your configuration.


FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':metadata-jobs:mae-consumer-job:bootRun'.
✅ 1
b
This will work if the environment flag to enable the consumer is active. I will make a correction to the code to run once more without needing this extra environment variable, however as a workaround for now. Please execute the command like so
Copy code
MAE_CONSUMER_ENABLED=true ./gradlew :metadata-jobs:mae-consumer-job:bootRun
p
@brainy-tent-14503 This worked. ☝️ Thanks for the response.