Hi all! I need to get data from a csv file that is...
# replication-troubleshooting
l
Hi all! I need to get data from a csv file that is in my google Drive.Any ideas how to do that?
a
you can fetch data using google sheet connector
l
even if it is stored as a csv file in the google cloud?
n
What Akilesh suggested sounds good. As there is no official connector for this use case currently, I suggest you experiment with workarounds!
l
Hi, I read there is a google drive source connector,, with even git hub issues, but I can't find it..
@Akilesh V Hi, it falis with the google sheet connector. How do you do it?
a
@laila ribke please share the error log
l
Hi @Akilesh V, this is the failure log in File source The connection tests failed. Failed to load gs://drive.google.com/file/d/1Q6jzBgFX6oWd6vukS2d_XmAkY3kKPTBI/view?usp=sharing: FileNotFoundError('drive.google.com/file/d/1Q6jzBgFX6oWd6vukS2d_XmAkY3kKPTBI/view?usp=sharing') Traceback (most recent call last): File "/airbyte/integration_code/source_file/client.py", line 89, in open self._file = self._open() File "/airbyte/integration_code/source_file/client.py", line 99, in _open return self._open_gcs_url() File "/airbyte/integration_code/source_file/client.py", line 191, in _open_gcs_url file_to_close = smart_open.open(self.full_url, transport_params={"client": client}, **self.args) File "/usr/local/lib/python3.9/site-packages/smart_open/smart_open_lib.py", line 224, in open binary = _open_binary_stream(uri, binary_mode, transport_params) File "/usr/local/lib/python3.9/site-packages/smart_open/smart_open_lib.py", line 400, in _open_binary_stream fobj = submodule.open_uri(uri, mode, transport_params) File "/usr/local/lib/python3.9/site-packages/smart_open/gcs.py", line 108, in open_uri return open(parsed_uri['bucket_id'], parsed_uri['blob_id'], mode, **kwargs) File "/usr/local/lib/python3.9/site-packages/smart_open/gcs.py", line 141, in open fileobj = Reader( File "/usr/local/lib/python3.9/site-packages/smart_open/gcs.py", line 227, in init raise google.cloud.exceptions.NotFound('blob %s not found in %s' % (key, bucket)) google.api_core.exceptions.NotFound: 404 blob file/d/1Q6jzBgFX6oWd6vukS2d_XmAkY3kKPTBI/view?usp=sharing not found in drive.google.com The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/airbyte/integration_code/source_file/source.py", line 106, in check with client.reader.open(): File "/airbyte/integration_code/source_file/client.py", line 91, in open raise FileNotFoundError(self.url) from err FileNotFoundError: drive.google.com/file/d/1Q6jzBgFX6oWd6vukS2d_XmAkY3kKPTBI/view?usp=sharing
a
@laila ribke in the file connector you need to provide a url of file, here drive.google.com/file/d/1Q6jzBgFX6oWd6vukS2d_XmAkY3kKPTBI/view?usp=sharing using this link file connector can't load this as file
l
from where I should take the file url?
a
if you are using
airbyte cloud
easier option would be to use google sheet connector ->
sign in with google
to do oauth -> enter you sheet link