https://linen.dev logo
#ask-community-for-troubleshooting
Title
# ask-community-for-troubleshooting
v

Vika Petrenko

06/07/2021, 12:24 AM
How to watch item removal with the incremental stream? is it supposed soft deletion when the row is included in the response?
1
s

s

06/07/2021, 12:46 AM
@Vika Petrenko I’m not sure I understand the question, what are you trying to do?
d

Davin Chia (Airbyte)

06/07/2021, 1:04 AM
are you maybe referring to being notified when the item is deleted?
v

Vika Petrenko

06/07/2021, 8:42 AM
I use HTTP source, and just wondering how to track that item is removed with an incremental stream and append mode as only existent data returned when fetching with API. So I mean when the item is deleted from the API response. It seems that only the soft delete flag should be updated in API instead of the item removing otherwise item row exists in the previous batch import, new batch contains only updated/new once
u

[DEPRECATED] Marcos Marx

06/08/2021, 11:19 PM
@Vika Petrenko did you solve your issue or you need some help on that?
v

Vika Petrenko

06/09/2021, 9:33 AM
yes, just wondering how is it supposed to track that entity was deleted with incremental stream? In documentation:
Incremental means syncing only replicate new or modified data
so it means that deleted item should have flag “isRemoved” instead of to be completely deleted from HTTP endpoint?
d

Davin Chia (Airbyte)

06/09/2021, 9:35 AM
Ah yes. We don't support delete today, so an additional column to indicate deletion is what I'd recommend too
v

Vika Petrenko

06/10/2021, 3:45 PM
thanks, Davin!
3 Views