Cross posting here as I am struggling to understand why dates are not being transformed correctly in the salesforce connector

Hi Team! Is there any update regarding running custom DBT in kubernetes?

Hi, could anyone help with my problem? I configured two transform models in DBT and connected it to GitHub, but when syncing the custom transform configured in Airbyte, there was a problem without exact description in the logs. Please I do need help

Hey everyone, I am curious to know what IDE you are using to develop your DBT projects. DBT positioning being quite unique, considering SQL as a full fledge programming language, I haven’t found the perfect IDE yet. Coming from the Python ecosystem, I am used to Jetbrain’s Pycharm so I am currently editing my DBT projects using the DataGrip IDE, but it’s not perfect as it fails to reformat my longest models + it is not free.

Question: Our Source database (Postgres) is converting date/timestamps to strings during basic normalization. How do we make sure this doesn’t happen?

Question: i am facing issue with converting CSV to postgres, all numbers are getting created as Float data type

any pointers how to control schema

Hi! Has anyone else had the issue when integrating with the Google Ads API that the Ad ID’s do not match the format for the Ad ID’s in the Google Ads Platform at all ? How did you resolve that issue?

Hi Team, any body know answer this problem

i am surprised even if we create table it is dropping again and making float at destination

Hello everybody. Does anyone know what the current state is for the goland SDK? A few months ago I was excited with the announcement but then I had to pause my project with Airbyte. Any connectors with this SDK? good reviews so far?

Hello , im having a problem , when i try to sync two tables , origin in mongodb dest in mysql a simple field with numbers in format : 2.15 are saved as strings and the column name is automatically changed to $name_airbyte_transform and shows all null values on the destination why is this happening?

is there way to integrate spark with Airbyte for transformations instead of dbt

dbt is not approved product then difficult to introduce two tools in org at a time

Hi, is there a way for me to make Airbyte run basic normalization using local installation of dbt or a different docker container of dbt? Reason is we need custom plugin property within dbt for it to work correctly with our database.

This message was deleted.

If the destination supports dbt yes

This message was deleted.

How can I change the number DBT threads from the default 4 that basic normalization uses?

Hey gang! I’ve been working on an initial import for a week & a half and haven’t been able to get it to complete. This process dies at the very end of the DBT normalization step while the Postgres target database is doing hours of vacuuming. It eventually results in a timeout. Here’s a screenshot of the output. The table it’s attempting to normalize is 68GB at the source. Any guidance or experience here? Thanks in advance!

https://github.com/airbytehq/airbyte/pull/16629 one more review please, this pr saves my life, thanks to krisjan

Hi All, this should be quick, can you tell us why there seems to be no activity between these two log messages?

2022-09-29 21:30:32 normalization > Found 212 models, 0 tests, 0 snapshots, 0 analyses, 558 macros, 0 operations, 0 seed files, 6 sources, 0 exposures, 0 metrics 2022-09-29 21:46:16 normalization > Concurrency: 8 threads (target='prod') 2022-09-29 21:46:28 normalization > 1 of 53 START incremental model public.ip5pxydtrvafvsh_ads.............................................................. [RUN] 2022-09-29 21:46:30 normalization > 2 of 53 START incremental model public.ip5pxydtrvafvsh_campaigns....

It waited for 15 minutes to start normalization

Also, is it normal for incremental models to take 10-20 seconds even when there is no insertions and we have less than 1MB of data?

2022-09-29 22:14:36 normalization > 24 of 53 OK created incremental model public.ip5pxydtrvafvsh_ad_c__rl_spec_windows_phone................................ [INSERT 0 0 in 21.98s] 2022-09-29 22:14:38 normalization > 25 of 53 OK created incremental model public.ip5pxydtrvafvsh_ad_c__template_url_spec_web................................ [INSERT 0 0 in 22.99s] 2022-09-29 22:14:38 normalization > 26 of 53 OK created incremental model public.ip5pxydtrvafvsh_ad_c__template_url_spec_ios................................ [INSERT 0 0 in 21.01s] 2022-09-29 22:14:39 normalization > 27 of 53 OK created incremental model public.ip5pxydtrvafvsh_ad_c___story_spec_link_data................................ [INSERT 0 38 in 22.31s] 2022-09-29 22:14:46 normalization > 28 of 53 OK created incremental model public.ip5pxydtrvafvsh_ad_c__ry_spec_template_data................................ [INSERT 0 0 in 16.61s] 2022-09-29 22:14:48 normalization > 29 of 53 OK created incremental model public.ip5pxydtrvafvsh_ad_c___story_spec_text_data................................ [INSERT 0 0 in 15.79s] 2022-0

Does postgres not work well with incremental models from DBT?

Hey, I would like to add a custom dbt transformation for my replication to Bigquery. I also need to specify custom destination dataset in Bigquery (default one writes to

airbyte_raw

). To do that I had to put my file

profiles.yml

into my dbt project github repo in order to specify my dataset. Following Airbyte doc, I have now to specify the

profiles.yml

path into Airbyte GUI

Entrypoint arguments for dbt cli

: that field is as follow

run --profiles-dir .

And this is where problems begin. When I run my Airbyte sync, I have the following error during dbt phase :

Could not find profile named 'normalize'

Problem is my profile name is not "normalize", neither in

profiles.yml

or in

dbt_project.yml

. What is the way to specify that

profiles.yml

path and why is it trying to use normalize project ? Also when I try to run the sync + transformation without specifying custom dataset, it works great.