This message was deleted.
# troubleshooting
s
This message was deleted.
g
it's possible there is some issue loading the lookup — maybe it's available on the query server
:38888
but not the ingest task. i would suggest checking the ingest task log for clues
(web console -> Ingestion tab -> view log for task)
a
This is what appears in the ingestion wizard, however if I remove that and just edit the spec, then the 'submit' works and fails afterwards
The log of the failed task states
2023-03-10T164115,608 INFO [task-runner-0-priority-0] org.apache.druid.server.coordination.BatchDataSegmentAnnouncer - Announcing segment[druid-agent-states_2023-03-10T150000.000Z_2023-03-10T160000.000Z_2023-03-10T163708.286Z] at new path[/druid/segments/172.18.0.118100/172.18.0.118100_indexer-executor__default_tier_2023-03-10T164115.607Z_19858ac271b64299b8d15f133b7809650] 2023-03-10T164115,657 ERROR [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Encountered exception in run() before persisting. org.apache.druid.java.util.common.ISE: Lookup [departments] not found at org.apache.druid.query.lookup.RegisteredLookupExtractionFn.lambda$ensureDelegate$0(RegisteredLookupExtractionFn.java:151) ~[druid-processing-0.23.0.jar:0.23.0] at java.util.Optional.orElseThrow(Optional.java:290) ~[?:1.8.0_275] at org.apache.druid.query.lookup.RegisteredLookupExtractionFn.ensureDelegate(RegisteredLookupExtractionFn.java:151) ~[druid-processing-0.23.0.jar:0.23.0] at org.apache.druid.query.lookup.RegisteredLookupExtractionFn.apply(RegisteredLookupExtractionFn.java:122) ~[druid-processing-0.23.0.jar:0.23.0] at org.apache.druid.query.expression.LookupExprMacro$1LookupExpr.eval(LookupExprMacro.java:91) ~[druid-processing-0.23.0.jar:0.23.0] at org.apache.druid.segment.transform.ExpressionTransform$ExpressionRowFunction.eval(ExpressionTransform.java:103) ~[druid-processing-0.23.0.jar:0.23.0] at org.apache.druid.segment.transform.Transformer$TransformedInputRow.getRaw(Transformer.java:207) ~[druid-processing-0.23.0.jar:0.23.0] at org.apache.druid.segment.incremental.IncrementalIndex.toIncrementalIndexRow(IncrementalIndex.java:580) ~[druid-processing-0.23.0.jar:0.23.0] at org.apache.druid.segment.incremental.IncrementalIndex.add(IncrementalIndex.java:515) ~[druid-processing-0.23.0.jar:0.23.0] at org.apache.druid.segment.realtime.plumber.Sink.add(Sink.java:184) ~[druid-server-0.23.0.jar:0.23.0] at org.apache.druid.segment.realtime.appenderator.StreamAppenderator.add(StreamAppenderator.java:276) ~[druid-server-0.23.0.jar:0.23.0] at org.apache.druid.segment.realtime.appenderator.BaseAppenderatorDriver.append(BaseAppenderatorDriver.java:411) ~[druid-server-0.23.0.jar:0.23.0] at org.apache.druid.segment.realtime.appenderator.StreamAppenderatorDriver.add(StreamAppenderatorDriver.java:189) ~[druid-server-0.23.0.jar:0.23.0] at org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner.runInternal(SeekableStreamIndexTaskRunner.java:652) [druid-indexing-service-0.23.0.jar:0.23.0] at org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner.run(SeekableStreamIndexTaskRunner.java:265) [druid-indexing-service-0.23.0.jar:0.23.0] at org.apache.druid.indexing.seekablestream.SeekableStreamIndexTask.run(SeekableStreamIndexTask.java:149) [druid-indexing-service-0.23.0.jar:0.23.0] at org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:477) [druid-indexing-service-0.23.0.jar:0.23.0] at org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner$SingleTaskBackgroundRunnerCallable.call(SingleTaskBackgroundRunner.java:449) [druid-indexing-service-0.23.0.jar:0.23.0]
However, the lookup exists, and is query-able, as you can see in my printscreen
g
hmm do you have
druid.lookup.enableLookupSyncOnStartup
set in your configs? The default is
true
, which is good for making sure they're available
If it's overridden to
false
for some reason you'd want to change that
I am guessing that for some reason the task didn't load the lookup straight away