I don't see custom normalizations being an option ...
# advice-data-transformation
a
I don't see custom normalizations being an option for a mongo source...is this correct?
h
I'm relatively new to Airbyte, but I believe the custom normalizations would have to do with the Destination, not the source. For example, in our setup, we have some connectors syncing from publicly available CSV files into a Postgres database. The custom transformations happen after Airbyte has already sync'd across the raw rows. The source table for the dbt custom transformations is the
_airbyte_raw_mytable
table where the sync'd data is in the
_airbyte_data
column (as JSON). In short, it shouldn't matter what the source is. As long as the destination is something that dbt supports (a sql database / data warehouse).
a
Yep was curious if we could do dbt transformations before it ended up in our warehouse (e.g fivetran allows you to do this)