Mark Suemegi
01/06/2023, 12:30 PM_airbyte_emitted_at and _airbyte_normalized_at
We run this job daily (on working days), and in most cases it works how we expect it to work, the difference between these times is at most a few minutes.
Could someone clarify what could cause days of difference, as seen in the row I highlighted on the screenshot?
Thank you! 😊user
01/25/2023, 9:36 PMMark Suemegi
01/26/2023, 4:21 PM_airbyte_emitted_at as the "ingestion date". I still don't understand exactly how a record emitted on the 23rd is only normalized on the 28th. What I expected that If I run the connection daily, for every day I'll get new values (the date when the connection is triggered) for both of these columns. Is it the case that for incremental models, if a record is unchanged, then we don't have a new date for _airbyte_emitted_at?user
02/21/2023, 5:32 PM_airbyte_emitted_at value will be the same as the previous sync. This is because the record is not re-fetched from the source, and only new or modified records are replicated.For more information, please refer to the Incremental Append section of the Airbyte documentation. Does that answer your question?