Hi Druid team, can custom lookup extension be used...
# generalk
Krishna
10/28/2024, 10:41 PMHi Druid team, can custom lookup extension be used for Druid deep storage querying ? when we are testing getting below error
Copy code
Error: UNCATEGORIZED (DEVELOPER)
org.apache.druid.rpc.HttpResponseException: Server error [400 Bad Request]; body: {"error":"Cannot construct instance of `org.apache.druid.segment.VirtualColumns`, problem: function 'maha_lookup' is not defined.\n at [Source: (org.eclipse.jetty.server.HttpInputOverHTTP); line: 1, column: 1042] (through reference chain: org.apache.druid.msq.indexing.MSQControllerTask[\"spec\"]->org.apache.druid.msq.indexing.MSQSpec[\"query\"]->org.apache.druid.query.groupby.GroupByQuery[\"virtualColumns\"])"}Krishna
10/28/2024, 10:44 PM@Pranav please provide your inputs . Thank you
p
Pranav
10/28/2024, 10:51 PMWe need to load custom ext on msq workers
k
Krishna
10/28/2024, 10:53 PMI have enabled maha-Druid-lookups extension similar to real time MM
Krishna
10/28/2024, 10:53 PMBut still getting this error
Krishna
10/30/2024, 9:13 PM@Pranav do you think we need to enable look ups on Overlord for Deep storage query ? i am seeing this error now
Copy code
Error: UNCATEGORIZED (DEVELOPER)
org.apache.druid.rpc.HttpResponseException: Server error [400 Bad Request]; first 1KB of body: {"error":"Cannot construct instance of `com.yahoo.maha.maha_druid_lookups.query.lookup.MahaRegisteredLookupExtractionFn`, problem: Guice configuration errors:\n\n1) Could not find a suitable constructor in org.apache.druid.query.lookup.LookupListeningAnnouncerConfig. Classes must have either one (and only one) constructor annotated with @Inject or a zero-argument constructor that is not private.\n at org.apache.druid.query.lookup.LookupListeningAnnouncerConfig.class(LookupListeningAnnouncerConfig.java:33)\n while locating org.apache.druid.query.lookup.LookupListeningAnnouncerConfig\n for the 4th parameter of org.apache.druid.query.lookup.LookupReferencesManager.<init>(LookupReferencesManager.java:131)\n while locating org.apache.druid.query.lookup.LookupReferencesManager\n\n1 error\n at [Source: (org.eclipse.jetty.server.HttpInputOverHTTP); line: 1, column: 1038] (through reference chain: org.apache.druid.msq.indexing.MSQControllerTask[\"spec\"]->org.apache.druid.msq.indexing.MSQp
Pranav
10/31/2024, 5:30 PMWhat is the druid version in the maha-lookup library that you are using ?
k
Krishna
10/31/2024, 5:31 PMdruid 29