Hi, I want to query data stored in in local disk w...
# troubleshooting
r
Hi, I want to query data stored in in local disk which is downloaded from s3. i am getting this error which i am not able to understand possible resolution for the same. i am attaching middlemanager logs here as well. any leads please for resolution?
Copy code
org.apache.druid.indexing.common.tasklogs.FileTaskLogs - Wrote task log to: var/druid/indexing-logs/query-c33e98f2-e1b0-437b-8970-0d94f528775c.log
2023-03-20T12:13:04,725 ERROR [forking-task-runner-0] org.apache.druid.indexing.overlord.ForkingTaskRunner - Process exited with code[1] for task: query-c33e98f2-e1b0-437b-8970-0d94f528775c
2023-03-20T12:13:04,736 INFO [forking-task-runner-0] org.apache.druid.indexing.overlord.ForkingTaskRunner - Removing task directory: var/druid/task/query-c33e98f2-e1b0-437b-8970-0d94f528775c
2023-03-20T12:13:04,805 INFO [WorkerTaskManager-NoticeHandler] org.apache.druid.indexing.worker.WorkerTaskManager - Task [query-c33e98f2-e1b0-437b-8970-0d94f528775c] completed with status [FAILED].
l
Can you please click on the “get query detail archive” and share the query report. That would have a more concise error as to why the task might have failed. The failing tasks’s logs might be required later
v
I am not sure I understand.....you are trying to query data downloaded from s3? You mean the data that was ingested? Can you check your middle manager log for errors?
r
Yes, data was ingested to s3. then i downloaded locally and trying to query from druid installed locally. Have attached middlemanager.log here, but haven't been able to infer exact root cause for it. not sure if it has anything to do with log -
Copy code
ClientCnxn - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
l
The exact error should be present in the controllers and/or the worker’s logs. Can you check the peon’s logs if there’s an error present.
v
So deep storage is s3 and druid is running locally?
r
yes. s3 file type downloaded locally ias well. checking logs further
v
I am not sure what you mean by downloading the file? You are manually downloading?
r
yes i have manually downloaded in local and trying it out on druid installed locally
v
Ok. This is unlikely to work as reindexing druid data needs to happen from deep storage or you need to add to the metadata in your local cluster after downloading the segments. What are you trying to do? Why download the segments?
r
instead of downloading, this time i tried connecting to s3 by providing file path of my s3 file index.zip which has meta.smoosh and XXXXX.smoosh files as mentioned in https://druid.apache.org/docs/latest/design/segments.html i am trying to connect to s3 segment to build and query table in my localhost druid instance by giving s3 path of index.zip , accessKey and secretKey. in coordinator log i see an error
Copy code
org.jboss.netty.channel.SimpleChannelUpstreamHandler - EXCEPTION, please implement org.jboss.netty.handler.codec.http.HttpContentDecompressor.exceptionCaught() for proper handling.
java.net.ConnectException: Connection refused: localhost/127.0.0.1:8100
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[?:?]
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:779) ~[?:?]
	at org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) ~[netty-3.10.6.Final.jar:?]
	at org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) ~[netty-3.10.6.Final.jar:?]
	at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) ~[netty-3.10.6.Final.jar:?]
	at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) ~[netty-3.10.6.Final.jar:?]
	at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) ~[netty-3.10.6.Final.jar:?]
v
r
Thanks