Hello, We are using S3 destination connector. In ...
# replication-troubleshooting
v
Hello, We are using S3 destination connector. In the settings we have specified the format as JSON Lines with no compression. But the files are sill getting stored in s3 with gzip compression. Can you please advice on how to fix this?
Screenshot 2022-12-21 at 3.49.16 PM.png
@Nataly Merezhuk (Airbyte) Hey Nataly, can you help me on this?( Tagging you because you helped me last time)
n
v
My bad, will go through the code of conduct. Thanks for the response, attaching the logs
n
Thanks for the logs! I see that your Airbyte version is behind (
0.40.18
) and the S3 destination is also behind (
0.3.17
) and compression is indeed getting set :
S3 format config: S3JsonlFormatConfig{, compression=GZIP}
I think the config is not being saved correctly, it might be because the versions are not up to date. Please update and if the issue persists, please open an issue on GitHub!