Hi all, I'm quite new to Airbyte. I'm currently tr...
# advice-data-transformation
h
Hi all, I'm quite new to Airbyte. I'm currently transferring some tables from a MySQL source to a PostgreSQL destination. That works great so far with the default connectors in the web UI. However, all data types are being converted to either strings or numbers. In particular, I'm having issues with MySQL DATETIME columns that are being converted to strings. I need them to be of type TIMESTAMP in PostgreSQL. What would be the recommended way to achieve this?
a
One way to do this is to extract the dbt code generated by Airbyte during normalization and patch it. You can get an idea of what would that take in this tutorial: https://airbyte.com/tutorials/bigquery-partition-cluster Otherwise, I am not sure whether that is a bug and what would it take to make that fix on the Airbyte MySQL source or the PostgreSQL destination...
h
Yeah, I think it is a known limitation that Airbyte only supports a few column types. Transforming using dbt -- as linked above -- takes a bit to get initially set up, but once you have the repo in place, it is a very useful tool for building transformations. The instructions Airbyte provides will get you 90% there.
h
Thanks, guys. I was hoping that there would be a simpler way, but the way to go seems clear now. 👍🏻