Title
#advice-data-transformation
Yudian

Yudian

04/12/2022, 9:11 PM
hello all, not sure this is the correct channel. I am wondering if airbyte can be integrated other solutions that can perform java / python transformers in the transform stage (i.e., after EL, as stated in https://docs.airbyte.com/operator-guides/transformation-and-normalization/transformations-with-sql)?
Ari Bajo (Airbyte)

Ari Bajo (Airbyte)

04/13/2022, 8:53 AM
Hi Yudian! Airbyte only supports SQL based transformations today. If you need to transform data on your destination with Python or Java, then you can plug in a data orchestration tool (Airflow, Prefect, Dagster...) to orchestrate the transformations for you. I linked three articles on how to use Airbyte with these tools for transforming data.
Yudian

Yudian

04/13/2022, 4:20 PM
ok thank you!