Hello Everyone ! We have started exploring the air...
# advice-data-ingestion
a
Hello Everyone ! We have started exploring the airbyte where we have setup a connection as SQS-->AirByte-->S3. It works fine but the output from AirByte are stored as unreadable files. Afterwards, We downloaded these files from S3 and appended the files with ".gz" which helped to extract the file and view the contents inside it. I couldn't find any configuration which can be modified to fix it. Can someone please guide me if this is a default feature or am I doing something wrong here. Thanks in advance.
✅ 1
@Airbytes Pursuits
@Chris Rose (Airbyte) @Joey Taleño please guide
j
Hello @Akhtar Bhat, Wow I'm flattered but I'm also new in Airbyte. I haven't tried that kind of setup so far. Let's wait for the Airbyte folks to help you on this.
c
Hi Akhtar, I am not a technical person but i am tagging in our #use-team to come help with your question.
c
@Akhtar Bhat we had the same issue recently. We upgraded to the most recent version of s3 destination connector. Then saved our destination again to make sure it all was still working and now everything is functioning, note you can now output to csv or compressed gz files as output
✅ 1
a
OK thank you everyone, I will upgrade it to latest version to try it again . Will get back with the results.
a
Hi @Akhtar Bhat, you will find a better audience for this kind of troubleshooting question on our forum. Feel free to post there.
👍 1
a
It has worked, thank you !