This message was deleted.
# troubleshooting
s
This message was deleted.
a
hmm. it should pick up the credentials in the properties. are you sure those credentials have access?
y
Yes the credentials have full s3 access. Looks like error says the problem is in the wrong key
InvalidAccessKeyId
, not
AccessDenied
part of my config
I’ve tried setup the cluster from scratch and noticed the credentials from tasks work correctly when the deep storage is local
Copy code
druid.storage.type=local
druid.storage.storageDirectory=var/druid/segments
g
I tried this locally and it works fine for me: • S3 deep storage configured with
druid.storage.type=s3
,
druid.storage.bucket
,
druid.storage.baseKey
,
druid.s3.accessKey
, and
druid.s3.secretKey
• S3 input source accessing a bucket in a different account using
properties
and
accessKeyId
+
secretKeyId
maybe there is an issue with the endpoint: it's possible the s3 input source is contacting minio due to server-wide config (such as
druid.s3.endpoint.url
) and the error is actually from minio
if that's it: try using
endpointConfig
in your s3 input source too
y
thank you for support yes, you are correct the problem is in an endpoint
looks like there is not a workaround how to use multiply endpoints
I’ve even tried to setup separate MM with different endpoint, but without success as well
p
Hey @Yurii I I just had a quick check in Druid Forum as I seemed to remember someone else having a similar issue re: Min.IO / S3 – I really thought someone found a solution (!) but I don’t think one was found… however maybe you could DM some people in the conversation on there and see if they worked anything out? https://www.druidforum.org/t/fail-to-configure-data-ingestion-from-minio-object-storage/6783
y
if that’s it: try using
endpointConfig
in your s3 input source too (edited)
I didn’t understand correctly this note I see, there is that parameter in the task configuration
Copy code
"endpointConfig": {
             "url" : "<http://s3-store.aws.com|s3-store.aws.com>",
             "signingRegion" : "us-west-2"
         },
let me check this point
p
Cool thank you 🙂. In fact @Mark Herrera and @Sergio Ferragut and I were talking about this ourselves last week (!!!) as we’re building out a template POC environment with @Steve Halladay that uses Min.IO… so we will like to know, as well!
y
It works as expected!🎉 Thank you guys!
g
great to hear!