This message was deleted.
# troubleshootings
Slackbot
06/14/2023, 9:31 AMThis message was deleted.
h
Hung Thanh
06/14/2023, 9:34 AMCheck your logs ERROR in coordinator
a
Anant Sharma
06/14/2023, 9:39 AM2023-06-14T09:37:53+00:00 startup service coordinatorAnant Sharma
06/14/2023, 9:39 AMin the last i can see few WARNING
h
Hung Thanh
06/14/2023, 9:42 AMTerminating due to java.lang.OutOfMemoryError: Java heap spaceAnant SharmaHung Thanh
06/14/2023, 9:42 AMIt seem be your RAM is full
a
Anant Sharma
06/14/2023, 9:45 AMconfig:
DRUID_XMX: 512m
DRUID_XMS: 512m
should we increase this in this case
Anant Sharma
06/14/2023, 9:51 AM Copy code
2023-06-14T09:50:32+00:00 startup service coordinator
Setting druid.host=10.101.57.60 in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.s3.secretKey=45Olx53YqDshGDqvqxjWiiyA7L5KOJhzY6whUUnh in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.indexer.logs.type=s3 in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.extensions.loadList=["druid-histogram", "druid-datasketches", "druid-lookups-cached-global", "postgresql-metadata-storage","druid-s3-extensions","druid-kafka-indexing-service"] in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.storage.baseKey=dev/segments in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.s3.endpoint.url=<http://s3.amazonaws.com|s3.amazonaws.com> in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.indexer.logs.s3Bucket=nebulastaging-druid in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.emitter.http.recipientBaseUrl=<http://druid_exporter_url>:druid_exporter_port/druid in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.metadata.storage.type=postgresql in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.storage.bucket=nebulastaging-druid in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.metadata.storage.connector.connectURI=jdbc:<postgresql://dev-druid-postgresql:5432/druid> in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.s3.endpoint.signingRegion=eu-north-1 in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.s3.accessKey=AKIAWLVNMFA7M2EVDFMS in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.storage.type=s3 in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.storage.disableAcl=true in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.metadata.storage.connector.user=druid in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.indexer.logs.directory=/opt/data/indexing-logs in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.s3.endpoint.serviceName=s3 in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.zk.service.host=dev-druid-zookeeper-headless:2181 in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.emitter=noop in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.indexer.logs.s3Prefix=dev/druid-logs in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.storage.storageDirectory=/mnt/druid/druid/var/druid/segments in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.cache.sizeInBytes=1000000000 in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.metadata.storage.connector.password=druid in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.emitter.logging.logLevel=error in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.broker.cache.populateCache=true in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
Setting druid.broker.cache.useCache=true in /tmp/conf/druid/cluster/master/coordinator-overlord/runtime.properties
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by com.google.inject.internal.cglib.core.$ReflectUtils$1 (file:/opt/druid/lib/guice-4.1.0.jar) to method java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
WARNING: Please consider reporting this to the maintainers of com.google.inject.internal.cglib.core.$ReflectUtils$1
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future releaseAnant Sharma
06/14/2023, 9:52 AMnot getting that error anymore but the situation is same
h
Hung Thanh
06/14/2023, 9:52 AMPlease waiting for another service starting and double check
a
Anant Sharma
06/14/2023, 10:26 AMthanks for your help it was the same issue @Hung Thanh
h
Hung Thanh
06/14/2023, 10:29 AMHow about another logs?
Hung Thanh
06/14/2023, 10:30 AMMaybe u can using doctor Druid for troubleshooting problem
a
Anant Sharma
06/14/2023, 12:37 PMyeah i think i need to figure them out , Those looks to suspicious
Anant Sharma
06/14/2023, 12:39 PMBtw do you have any idea what could be the reason if compaction stuck on Running from a log time
4 Views