I'm trying to copy data from excel/csv to a Snowflake database. Within my files are datetime columns that are being stored in snowflake as varchars. Is there some way for Airbyte to recognize that these are timetamps and save them as such? 1. I can't fix this with dbt - we're planning on using the api to allow clients to create new tables and if we have to insert a manual step in the middle the flow breaks down 2. I tried adding {"parse_dates": true} to the reader options to see if I could get pandas to recognize the dates. I've also tried to manually set the columns to datetimes, and that doesn't work as well {"dtype": {"trans_date":"datetime64"}}. a. This does work when I just try to read the file using pandas.read_csv(), i.e. in a python interpreter and not through Airbyte 3. I tried dumping to postgres instead of Snowflake to see if it was a destination issue, and it was a varchar there as well Any ideas? Thanks

Looks there is a problem with the

reader_options

parameter. @Brad Nemetski do you mind opening a Github issue for that?

Thanks for taking a look, here's the issue: https://github.com/airbytehq/airbyte/issues/19901 let me know if you need more details. Also let me know when this will be fixed 🙂

I'm planning to solve this week the issue! Any update I'll return to you.

Thank you!

Sorry I didn’t have the time to solve the issue. I’m on PTO right now, @Nataly Merezhuk (Airbyte) could you take look here? 😄

@Nataly Merezhuk (Airbyte) Any chance you can give me an update? Thanks and have a good weekend!