Hey @channel
I am using this tutorial https://airbyte.com/tutorials/Incremental-data-synchronization as base of my implementation.
Source is Postgres
Destination is Bigquery
Airbyte version 0.40.4 (original instance)
Airbyte version 0.40.14 ( Second instance on a separate Machine, nothing on this machine except Airbyte and the two endpoints)
Issues encountered, during Normalization stage, this issue trigger
Immediately after
*1 of 3 Start view model _airbyte__public._stg
The following error is displayed,
*"unhandle error while executing model.airbyte_util._stg
*=table_name
Sync mode = Incremental | deduped + history
Transformation = Tabular Normalization
With this, dbt never normalized the data, hence normalised was never generated, however intermediate table source as raw, tmp were generated and populated.
I have the complete log file on this Airbyte discuss page.
https://discuss.airbyte.io/t/normalization-error-when-sync-mode-is-incremental-deduped-history-when-implementing-cdc-with-bigquery-as-destination/2839
Thanks
✍️ 1
u
user
10/10/2022, 3:40 PM
@[DEPRECATED] Marcos Marx turned this message into Zendesk ticket 2697 to ensure timely resolution!
q
Qamarudeen Muhammad
10/11/2022, 9:30 AM
I can confirm that same implementation work for Postgres as source and Postgres as destination.
I will appreciate, any clue on how to fix this.
u
user
10/11/2022, 1:27 PM
Hi! Thank you for your patience, we had a few team members out on Friday and yesterday. Since you already started the thread in the forum, let's continue our conversation there! :) I see your post and will reply shortly.
u
user
10/11/2022, 1:27 PM
Hi! Thank you for your patience, we had a few team members out on Friday and yesterday. Since you already started the thread in the forum, let's continue our conversation there! :) I see your post and will reply shortly.