Hey guys. I am exploring CDC loads and after delet...
# replication-troubleshooting
j
Hey guys. I am exploring CDC loads and after delete records from source at final table the delete was not replicating for target. Using option INCREMENTAL APPEND, all records are persisted on the target but I can't know how data is alive, I need to use RAW TABLES to identify that. Using option INCREMENTAL DEDUP the records persists on target table and _SCD table like the record is valid.
u
Hello Joviano Cicero Costa Junior, it's been a while without an update from us. Are you still having problems or did you find a solution?
j
I found a solution. The automatic process that normalize de RAW results replicated consider deleted rows as row that need do be persisted on normalized table, but it is a wrong concept. I will implement a dbt transformation to generate normalized table correctly and leave airbyte only replicating to raw table.
u
Happy to hear you were able to find a solution by implementing your own dbt transformation. Let us know if you have more questions. 🙂