https://linen.dev logo
#feedback-and-requests
Title
# feedback-and-requests
a

Ander del Valle Castaños

09/06/2021, 10:18 AM
Hello, anyone know how to change localCSV route to GoogleDrive route? Thanks🙂
u

user

09/06/2021, 10:27 AM
Hey @Ander del Valle Castaños, while we don't have official docs for this (yet), this issue (and the linked slack chat) might help you 😄
u

user

09/06/2021, 10:35 AM
thanks @George Claireaux (Airbyte), in these case the SourceType, is Google Directory?
a

Ander del Valle Castaños

09/06/2021, 10:42 AM
The above just uses the standard files source. A dedicated Google Drive connector doesn't exist (yet)
u

user

09/06/2021, 11:18 AM
Well, i will try to connect with this?
u

user

09/06/2021, 11:24 AM
Yes if you use HTTPS as the provider and then your url should look something like:
<https://drive.google.com/uc?export=download&id=><DRIVE_FILE_ID>
where
<DRIVE_FILE_ID>
will be unique to your specific file.
u

user

09/06/2021, 11:26 AM
But this option is not possible as Destination-File, is correct?
u

user

09/06/2021, 11:26 AM
only is possible as SourceFile
u

user

09/06/2021, 11:30 AM
ah you want to use google drive as destination? I don't believe there is any way to do that currently... however you could create an issue for it to get it in our backlog 😄
u

user

09/06/2021, 11:31 AM
Okey, thanks
a

Ander del Valle Castaños

09/06/2021, 11:31 AM
I have requested the connector
u

user

09/06/2021, 11:31 AM
But there are a LocalCSV connector for destination
u

user

09/06/2021, 11:32 AM
is possible to configure http-URL with this option?
u

user

09/06/2021, 11:33 AM
Because, i have tested this connector and it creates the files in my local Docker Image TMP-url
u

user

09/06/2021, 11:33 AM
Maybe, is possible to change configuration to redirect the path to HTTP
u

user

09/06/2021, 11:35 AM
I suppose technically if you could mount your google drive to the container, then modify LOCAL_ROOT to point there (see local_csv docs) you might be able to make this work
u

user

09/06/2021, 11:37 AM
u

user

09/07/2021, 8:50 AM
Thanks @George Claireaux (Airbyte), can you know how to change LOCAL_ROOT of destination files?
u

user

09/07/2021, 8:51 AM
i try to read the guide but i dont find the parameters
u

user

09/07/2021, 8:54 AM
it's an environment variable set in the .env file. However you could get around changing that by doing something like:
u

user

09/07/2021, 8:55 AM
But you'd need to make sure you mount your google drive to "/tmp/airbyte_local/cars/models" where
/cars/models
in this example you replace with whatever you want
u

user

09/07/2021, 11:49 AM
thanks @George Claireaux (Airbyte)
s

Sandeep Devarapalli

09/07/2021, 11:50 AM
the process of mount drive i think have the limit of need access to local computer
u

user

09/07/2021, 11:50 AM
lmk how it goes 😄
u

user

09/07/2021, 11:50 AM
is possible to create a connector HTTP?
u

user

09/07/2021, 11:51 AM
it can be a custom connector, because it not appear on list of standard
u

user

09/07/2021, 11:51 AM
yeah the ideal solution here would be building a google drive connector (using our CDK) and the google drive API
u

user

09/07/2021, 11:52 AM
yes, it is for drive
s

Sandeep Devarapalli

09/07/2021, 11:52 AM
but is possible to create more generic
u

user

09/07/2021, 11:53 AM
as Source File Connector?
u

user

09/07/2021, 11:53 AM
do you think?
u

user

09/07/2021, 11:53 AM
i think the best option is replicate it
u

user

09/07/2021, 11:53 AM
do you mean a generic destination file connector?
u

user

09/07/2021, 11:56 AM
We effectively have a base for this with the S3 destination as it provides functionality for writing into various file formats so this could be reused to build a google drive connector
u

user

09/07/2021, 11:57 AM
I think generally the more generic a connector, the more full of if/else or case statements the code is, and the less reliable it is across all cases. The better approach is to build abstract layers that hold the reusable elements and then implement specific connectors building on top of those
u

user

09/07/2021, 12:02 PM
OK, thanks i will try replicate S3 destination connector
s

Sandeep Devarapalli

09/07/2021, 12:03 PM
for deploy connector after creation , i can do that directly?
u

user

09/07/2021, 12:05 PM
p

Peter Petrik

09/07/2021, 1:49 PM
this tutorial allows to create source and Destination connectors?
u

user

09/07/2021, 1:50 PM
i read using CDK is easy to create part of connector
u

user

09/07/2021, 1:50 PM
^ that's specifically for sources
u

user

09/07/2021, 1:51 PM
^ if you're more comfortable with python then use that, I just linked the java one because the file handling code already exists in the s3 destination and is in java
u

user

09/07/2021, 1:52 PM
yes, it is okey
p

Peter Petrik

09/07/2021, 1:52 PM
i think that this is the code for replicate with Drive, that you refer
2 Views