A data source reset fixed it. Not sure if that will a permanent solution going forward though.
✅ 1
g
George Claireaux (Airbyte)
09/28/2021, 2:01 PM
Hey Jonas, incremental syncs operate with an at least once guarantee, meaning records may be duplicated (it heavily depends on the specific source connector's implementation) but records should never be missed
j
Jonas Bolin
09/28/2021, 3:04 PM
Thanks @George Claireaux (Airbyte)! Am a bit new to this field. What's the common way to deal with this, is it the hash ID one uses to dedeplicate?
DISTINCT _airbyte_field_name_hashid
g
George Claireaux (Airbyte)
09/28/2021, 3:50 PM
Many connectors support Deduped History mode which should do what you're looking for 🙂
That docs page also walks through the logic for obtaining the deduped records