Hi,
I hope everyone doing fine.
I'm working on connector development for source which return compressed(tar.gz) file which have multiple .csv file as a response. Does anyone know how we can develop connector in this scenario.
s
Sherif Nada
10/28/2022, 4:52 AM
Youll need to decompress and decide the response
Sherif Nada
10/28/2022, 4:52 AM
Might be useful to write the file to disk to avoid memory spikes on large files
a
Arvind Patel
10/28/2022, 5:02 AM
thanks for your response. Is there any documentation which I can refer.
s
Sherif Nada
10/28/2022, 5:40 AM
not specifically for decompressing files, no, for that you'd just use a Python library (if you're using python)