Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

I've been having some issues access files added to my S3 buckets by Airbyte and was curious if anyone has had a similar issue (or a solution).

We use Deepnote for some data work and they have an integration with S3. It can read the bucket, see all the folders and explore them. But it shows no files in the folder and acts as if they are empty.

If I create a test bucket and manually add files, there are no issues... Deepnote can't find anything and recommended me dig into Airbyte to see if there's something I've misconfigured or set up incorrectly. I can't find anything... so, last ditch effort is to ask here :sweat_smile:

Looks like when Airbyte is writing objects to the s3 bucket, these objects dont have the `x-amz-meta-mode header.`

And Deepnote isn't mounting it using `-o complement_stat`
```-o complement_stat (complement lack of file/directory mode)
              s3fs  complements  lack  of  information  about  file/directory mode if a file or a
              directory object does not have x-amz-meta-mode header.  As default, s3fs  does  not
              complements  stat  information for a object, then the object will not be able to be
              allowed to list/modify.```
Was able to fix and run locally