Hi all! I am trying to set up a connection between...
# feedback-and-requestss
Sophie Lohezic
03/08/2022, 1:34 PMHi all! I am trying to set up a connection between salesforce and bigquery with the GCS method (because we have errors with the insert method when we have many tables and it seems to be ok with 'only' 10 tables). Could you please detail how to check the connection between the bucket and the machine running airbyte please ?
in the docs : Make sure your GCS bucket is accessible from the machine running Airbyte. This depends on your networking setup. The easiest way to verify if Airbyte is able to connect to your GCS bucket is via the check connection tool in the UI.
We have deployed airbyte on a VM in GCP, we have created a bucket in the same project and given object creator / object viewer rights to the airbyte service account but I wonder where / if I have other permissions to give as I am running into errors when testing the connection. Many thanks for your help 🙏
a
Augustin Lafanechere (Airbyte)
03/08/2022, 2:55 PMHi @Sophie Lohezic, could you please share your error logs?
Augustin Lafanechere (Airbyte)
03/08/2022, 2:57 PMCould you try to write a file to your GCS bucket from your VM with gsutil?
s
Sophie Lohezic
03/08/2022, 4:46 PMThe connection tests failed.
Could not connect to the Gcs bucket with the provided configuration. The request signature we calculated does not match the signature you provided. Check your Google secret key and signing method. (Service: Amazon S3; Status Code: 403; Error Code: SignatureDoesNotMatch; Request ID: null; S3 Extended Request ID: null; Proxy: null)
Sophie Lohezic
03/08/2022, 5:14 PMso, here is the error logs when I click on 'save changes and test'
The connection tests failed.
Could not connect to the Gcs bucket with the provided configuration. Access denied. (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: null; S3 Extended Request ID: null; Proxy: null)
Sophie Lohezic
03/08/2022, 5:14 PMI am able to copy a file to the bucket with gsutil
Sophie Lohezic
03/08/2022, 5:15 PMand when I click on 'save changes and test' in the UI, I have the error above, but I do have a test_file written in the bucket (at the root, not in the folder I created)
h
Harshith (Airbyte)
03/10/2022, 9:59 AMHey can you create an issue around this in github so that team can look and get back to you
2 Views