Hi team. I'm facing some issue when i tried to con...
# troubleshootingm
Mohamed Sultan
04/27/2021, 11:03 AMHi team. I'm facing some issue when i tried to connect with GCS deep store Here are the logs. Please take a look and help me on this.
Mohamed Sultan
04/27/2021, 11:05 AMcontoller.log,broker.log
Mohamed Sultan
04/27/2021, 11:05 AMserver.log
Mohamed Sultan
04/27/2021, 11:15 AMimage.png
Mohamed Sultan
04/27/2021, 11:15 AMimage.png
Mohamed Sultan
04/27/2021, 11:18 AMthese are the configurations added. and mounted the gcs key in /tmp/gcs/keys/gcs-keys.json
Mohamed Sultan
04/27/2021, 11:23 AMjob spec for gcs
Mohamed Sultan
04/27/2021, 11:59 AMimage.png
d
Daniel Lavoie
04/27/2021, 12:21 PMThe configs are referenced here: https://docs.pinot.apache.org/basics/data-import/pinot-file-system/import-from-gcp#controller-config
Daniel Lavoie
04/27/2021, 12:22 PMMy bad, you already have the config
Daniel Lavoie
04/27/2021, 12:22 PMCan you try with a trailling slash on
controller.data.dirDaniel Lavoie
04/27/2021, 12:26 PMOh wait, found the issue
Daniel Lavoie
04/27/2021, 12:26 PMIt fails when building your credential json
Daniel Lavoie
04/27/2021, 12:26 PM Copy code
at com.google.auth.oauth2.GoogleCredentials.fromStream(GoogleCredentials.java:150) ~[pinot-gcs-0.8.0-SNAPSHOT-shaded.jar:0.8.0-SNAPSHOT-6d34505ad9dcc25c2f48f9aa1b0985171fb0351c]Daniel Lavoie
04/27/2021, 12:27 PMYour JSON credential is a directory apparently. Not sure how you are running Pinot but if you are using volumes, your credential mount is probably bad
m
Mohamed Sultan
04/27/2021, 12:29 PMi used configmap to mount. But its file 😐
Mohamed Sultan
04/27/2021, 12:30 PMok got it! let me try with the changes
d
Daniel Lavoie
04/27/2021, 12:30 PMCheck inside the container, I’m pretty sure you mounted
gcs.key.jsonm
Mohamed Sultan
04/27/2021, 12:30 PMyeah. you are right
Mohamed Sultan
04/27/2021, 12:31 PMthe path is like /var/gcs/keys/gcs-key.json/
Mohamed Sultan
04/27/2021, 12:31 PMmy bad