im replicating postgres -> snowflake, all on the latest versions. 1 databases has much longer normalization seteps than others its replicating only a few thousand records every hour across like 50 tables, but normalization is taking like 20 minutes. i see that the snowflake warehouse has much higher load during the normalization step. my question is what are the main factors to consider for how long normalization will take? Since i have databases with more records/data/tables replicating hourly with noticeable faster normalization and lower snowflake warehouse load? (the syncs are spread out over hour as to not overlap)

@[DEPRECATED] Marcos Marx turned this message into Zendesk ticket 2982 to ensure timely resolution!

the issue was db partitioning of larger tables by month.... they never get new data so there is no diff so the normalization step keeps taking a long time for them as it treats it as the first run

Hey @Robert Put, have you found a workaround for this? You could submit a github issue to see if this can be improved

haven't tested it yet but was just gona directly modify the data to force a change, which i wouldn't really recommend to others unless they can do it safely and actually have access to do so... probably not a best practice