Hi everyone I have tried airbyte from MySQL to PostgreSQL wi Airbyte #ask-community-for-troubleshooting

Hi everyone. I have tried airbyte from MySQL to Po...

Agung Pratama

11/11/2022, 11:01 AM

Hi everyone. I have tried airbyte from MySQL to PostgreSQL with

Normalized tabular data

transformation. So far so good, the data succesfully synced to destination. However when I tried to use additional Custom Transformation with

dbt

within the airbyte, it was failed. But when I tried running my

dbt

project manually by

dbt run

, it was success. The error log found from the airbyte dashboard isn't really that helpful. Is there anyway to investigate/troubleshoot this further? What I did on my dbt project is to create view that base64 decode on some column on the tables ingested by airbyte (see the screenshot).

Agung Pratama

11/11/2022, 11:02 AM

here is some of the log indicated the failure

c4560f13_03df_48b9_b9db_a7dea1ba2a9c_logs_25_txt.txt

Agung Pratama

11/11/2022, 11:03 AM

Here is the transformation setting

Agung Pratama

11/11/2022, 11:14 AM

Ah NVM, i found the problem. Turns out my dbt folder is not in the root project location (in the git repo). Solved this already.

Agung Pratama

11/11/2022, 11:15 AM

Which raises another question: is it possible to customize the folder location (e.g: subfolder) in the git repository?

Nataly Merezhuk (Airbyte)

11/14/2022, 1:38 PM

Glad to hear you solved it! It is currently not possible to customize the folder location.

Rajesh Kumar

10/06/2023, 4:45 AM

Hi, im getting the same error, i have my dbt in root project in the git, but i have not added any docker image transformation settings ? can you help on this

27 Views

Open in Slack

Previous Next