Hey everyone, is there a way to transform the data before sending to the destination ? Am I correct in assuming that Airbyte is ELT only ? For more context, There is a column of type geometry in my source (Mysql) table which is not being extracted properly. I was wondering if I can transform it into string before sending it to the destination

Hi Sanjeev, data gets sent to the destination first, then transformed. So the answer is no, unfortunately.

@Nataly Merezhuk (Airbyte) I’d like to reopen this conversation— I have a

GEOMETRY

column that’s being transformed into a VARCHAR and thus not being loaded to Redshift. Is there some way to account for this in Airbyte?

You'd either need to submit a PR to change the functionality of the connector, or use dbt on the raw tables in the destination to transform the type.

@Nataly Merezhuk (Airbyte) The issue is fundamental to how Airbyte works—

GEOMETRY

columns are transformed to VARCHAR and written to Redshift. Because of the limitations of VARCHAR, this results in most

GEOMETRY

datasets failing to write

I see! Then this is a good case to open a GitHub issue - we track all the bugs there. Please make sure to include as many details as you can

I will!