https://linen.dev logo
Join Slack
Powered by
This message was deleted.
# troubleshooting
s
This message was deleted.
j
if I use any of other registered lookups it just works, no errors, but obviously 
unknown sig
is displayed
the lookup itself:
Copy code
{
  "type": "cachedNamespace",
  "extractionNamespace": {
    "type": "jdbc",
    "connectorConfig": {
      "connectURI": "jdbc:<postgresql://analytics-test.1234.us-east-2.rds.amazonaws.com:5432/analytics>",
      "user": "user",
      "password": "1234"
    },
    "table": "ref_signatures",
    "keyColumn": "hex",
    "valueColumn": "text",
    "pollPeriod": "P1D"
  },
  "firstCacheTimeout": 0,
  "injective": false
}
v
that is very strange that this one lookup in particular would not work
j
yeah, and I have changed its name just in case there is a conflict but still not working
v
what if you write your native query as SQL does that work? 
SELECT to_addr AS address,  network, LOOKUP(signature, 'sig_test') FROM "test" WHERE ... GROUP BY 1, 2, 3
etc
... if it does work, can you "Explain" it and see the generated native query? Does that one work?
(I am not sure what is up, just suggesting the poking I would do in this case)
j
same exception as before
the exception in the broker log:
Copy code
2022-10-20T21:13:32,575 WARN [qtp1288230669-126[groupBy_[test]_9b70da4f-7a6f-4945-928d-623049aa065d]] org.apache.druid.client.JsonParserIterator - Query [9b70da4f-7a6f-4945-928d-623049aa065d] to host [10.3.101.254:8083] interrupted       │
│ org.apache.druid.query.QueryException: Lookup [sig_test] not found                                                                                                                                                                       │
│     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_275]
v
Same exception on the sql query?
j
similar
Copy code
2022-10-20T21:17:23,673 WARN [sql[dd51753a-9f3a-4479-8227-9ab14ed6bd7c]] org.apache.druid.server.QueryLifecycle - Exception while processing queryId [638ebd41-7866-4671-83c1-3aed00fe67fa] (QueryInterruptedException{msg=Lookup [sig_test │
│ ame] not found, code=Unknown exception, class=org.apache.druid.java.util.common.ISE, host=10.3.101.254:8083})                                                                                                                                     │
│     at org.apache.druid.java.util.common.guava.MergeSequence.toYielder(MergeSequence.java:63) ~[druid-core-24.0.0.jar:24.0.0]                                                                                                                     │
│     at org.apache.druid.query.RetryQueryRunner$1.toYielder(RetryQueryRunner.java:133) ~[druid-server-24.0.0.jar:24.0.0]                                                                                                                           │
│     at org.apache.druid.common.guava.CombiningSequence.toYielder(CombiningSequence.java:78) ~[druid-core-24.0.0.jar:24.0.0]                                                                                                                       │
│     at org.apache.druid.java.util.common.guava.LimitedSequence.toYielder(LimitedSequence.java:51) ~[druid-core-24.0.0.jar:24.0.0]                                                                                                                 │
│     at org.apache.druid.java.util.common.guava.WrappingSequence$2.get(WrappingSequence.java:88) ~[druid-core-24.0.0.jar:24.0.0]                                                                                                                   │
│     at org.apache.druid.java.util.common.guava.WrappingSequence$2.get(WrappingSequence.java:84) ~[druid-core-24.0.0.jar:24.0.0]                                                                                                                   │
│     at org.apache.druid.java.util.common.guava.SequenceWrapper.wrap(SequenceWrapper.java:55) ~[druid-core-24.0.0.jar:24.0.0]                                                                                                                      │
│     at org.apache.druid.java.util.common.guava.WrappingSequence.toYielder(WrappingSequence.java:83) ~[druid-core-24.0.0.jar:24.0.0]
I do not know but I think it might be related to the actual values in the lookup and somehow druid can parse them
l
Since this 
SELECT * FROM lookup.sig_test
works but the SQL query for the original native query suggested by Vad doesn’t, can you check which dimension in the group by is causing the error? I think I have encountered a vaguely similar error earlier (however that was purely in the SQL layer). Also, are there any other suspicious errors in the logs?
j
I do not see any other errors in logs. I got it working by pulling all data from the DB into a CSV file that I put in S3. The new lookup is now pulling data from S3 and the native query works
3 Views
Open in Slack
PreviousNext
Powered by