https://pinot.apache.org/ logo
m

Mohamed Sultan

04/27/2021, 11:03 AM
Hi team. I'm facing some issue when i tried to connect with GCS deep store Here are the logs. Please take a look and help me on this.
message has been deleted
message has been deleted
these are the configurations added. and mounted the gcs key in /tmp/gcs/keys/gcs-keys.json
job spec for gcs
message has been deleted
d
My bad, you already have the config
Can you try with a trailling slash on
controller.data.dir
?
Oh wait, found the issue
It fails when building your credential json
Copy code
at com.google.auth.oauth2.GoogleCredentials.fromStream(GoogleCredentials.java:150) ~[pinot-gcs-0.8.0-SNAPSHOT-shaded.jar:0.8.0-SNAPSHOT-6d34505ad9dcc25c2f48f9aa1b0985171fb0351c]
Your JSON credential is a directory apparently. Not sure how you are running Pinot but if you are using volumes, your credential mount is probably bad
m

Mohamed Sultan

04/27/2021, 12:29 PM
i used configmap to mount. But its file 😐
ok got it! let me try with the changes
d

Daniel Lavoie

04/27/2021, 12:30 PM
Check inside the container, I’m pretty sure you mounted
gcs.key.json
as a folder and that there’s a nested file for your configmap key inside
m

Mohamed Sultan

04/27/2021, 12:30 PM
yeah. you are right
the path is like /var/gcs/keys/gcs-key.json/
my bad