https://linen.dev logo
d

dasol kim

02/16/2022, 1:45 AM
Hello! I have some questions about transformation. If the source and destination are the same DB type (e.g., the source is Postgres, the destination is also Postgres), can it be made to have the same column data type? Alternatively, is there a way to receive or check schema (e.g., column type) of the original source DB in the transformation step using the DBT after connection? Thanks.
1
m

Marcos Marx (Airbyte)

02/16/2022, 2:30 AM
Not possible; Airbyte first transform the record to the AirbyteMessageProtocol. This allow Airbyte to be generic allowing you to connect any source to any destination. The cons is in some cases you lost the similarity between data types. Somes date types are kepts, but others are lost. Please check the destination webpage to check the data types supported.
d

dasol kim

02/16/2022, 4:51 AM
So, there is no way to extract source data schema from Airbyte, right? Thanks.
4 Views