https://linen.dev logo
#ask-community-for-troubleshooting
Title
# ask-community-for-troubleshooting
y

Yasmine Boussaid

04/22/2022, 12:29 PM
Hi everyone, is it possible to change data types in auto mapping when creating a connection?
1
a

Augustin Lafanechere (Airbyte)

04/25/2022, 7:59 AM
Hi @Yasmine Boussaid, no it's not possible at the moment, the source data type are defined or inferred by the source connectors. You can implement a custom transformation with DBT if you want to convert some types to your destination. We migrated our support on our forum, so feel free to post there if you want to follow up the conversation with our team.
🙏 1
м

Мария Платонова

01/18/2024, 3:05 PM
Hi, As far as I know, there is no option to configure normalization to select the proper data type in AirByte UI, so you have several options: use another specific tool or build transformation on your own. You can move and transform data via Datuum.ai: setup source connection, target connection and do the mapping. Datuum detects and casts data types automatically. It runs detection algorithms to find proper data types and cast it safely within the generated pipeline. For example, it casts a string to int/double/boolean/date/time/etc automatically based on given data. Also there are options to change data types manually if needed. Then, it generates a complete Airbyte pipeline for you. Check here the process of automapping here ->

https://www.youtube.com/watch?v=TqaenhL1Lwc

Another way is to do it manually in AirByte transformations. I guess you still need basic airbyte normalization, but you can add your own transformation (https://docs.airbyte.com/operator-guides/transformation-and-normalization/transformations-with-sql) and do manual casts to the required data type in the destination database. Although it may take time to set up a dbt project, create models and configure the dbt pipeline manually. I suggest you try Datuum.AI first, so you can save time. Hope it helps!
2 Views