Is there any idea of having

parquet file

compression functionality within airbyte after having synced multiple small files via append to S3 destination? Essentially a

S3 -> S3

but where you can compress the parquet files? Maybe that can be done right now?

Airbyte does support compression when exporting data to Parquet files in S3. However, the compression is applied during the data sync process and not after syncing multiple small files. The data sync may create multiple files as the output files can be partitioned by size, targeting a size of 200MB compressed or lower. If the output bucket contains too many files, the part id variable uses a

UUID

instead of a sequential ID [source](https://docs.airbyte.com/integrations/destinations/s3). As for the functionality to compress multiple small files after they have been synced to S3, there is no mention of such a feature in the provided extracts. If you have further questions or feature requests, it would be best to reach out to the Airbyte team directly or open a Github issue.