Hi @Kyle Mok, are you using basic normalization? If yes, could you please check that the

_raw

ables are not re-created on each run and this problem only occurs for the normalized tables.

correct, the

_raw

tables are not recreated. the final destination tables are though, which seems a bit counter-intuitive to me

wondering if there's a reason for this, and if there's a way to change it to be append as opposed to recreate, since it tends to be inefficient for larger tables

@Chris Duong [Airbyte] do you know if this is an expected behavior for snowflake incremental normalization?

can you post logs?

in our tests on snowflake, that sync does merge statements instead of recreating the table: https://github.com/airbytehq/airbyte/blob/master/airbyte-integrations/bases/base-n[…]/airbyte_incremental/TEST_NORMALIZATION/DEDUP_EXCHANGE_RATE.sql

let me see if I can find logs for this - I'm using snowflake's

created

metadata on the table itself:

I see a transient table, can you post your airbyte version too?

(new version of airbyte are producing permanent tables now)

at the bottom of the UI I see : 0.30.20-alpha

let me know if that is the version or if it's somewhere else

if you upgrade your airbyte version to something greater than `0.30.24-alpha`the tables are not re-created but populated incrementally FYI we are now at version

0.35+

ooooh perfect, thank you!