Hi everyone, First of all thanks for airbyte, the product looks really great, especially when I saw that your first pre-release was only a year ago, that impressing. I would like getting an advice on something. I have an usecase where I have hundred of CSV files. I would like to transform this data according to some business constraints and put everything into a postgres database. I saw this connector https://airbyte.io/connectors/csv-file but I didn't found a documented way to use it automatically on hundreds files. Did I missed something ? Does there is a contribution to do ? Or maybe there is a better way to approach such problem but I feel like a newbie with airbyte for the moment. After that, I'm gonna wrote an article to help newcomers to approach such problems with airbyte, because this product really looks promising.

You can use the File connector but is limited to 1 file only. Other way, would be upload the csv files to S3 or other blob store and use that connector to send data to Postgres. Also, a 3rd way, create a custom connector with the Airbyte CDK

Ty for the answer ! really appreciate 🙂