We saw that Facebook Marketing connector version 3 was just released and asked ourselves if this issue https://github.com/airbytehq/airbyte/issues/36998 is covered in the release

@Maxime Carbonneau-Leclerc can you take a look on this issue?

It isn’t. The version 3 was released to ensure proper primary key when there were breakdowns. As for the issue, we would need more information to reproduce. Is it your issue? Can you share a specific case where we have more records than expected (I assume this is what happens as the ticket says

the filters aren’t applied properly and the default behavior is applied

)? What is the default behavior in that case? Once we are able to reproduce, it’s going to be much easier for us to work on this issue

@Stephane Clery could you please share our findings?

We have this issue: https://github.com/airbytehq/airbyte/issues/36998 when fetching from facebook for a lot of historical data we do not see deleted ads when using the Ad Insights streams. We do not have more record than expected we have less as the default beheviour is not to include the DELETED ads (and other filters). So to us we were seing less spend/impressions …. It seems to not include those on large batch of data. The original ticket from someone else did seem to find the actual underlying issue was (filters to include missing when the data is large and batching starts). [to add our data verification was comparing the data fetched aggregated spend for an account to the Facebook UI, the total spend missing was exactly that of a deleted ad, which could not be found in the fetched data despite specifically adding the DELETED ad flag (and other) in our import]

Thanks for the added information! Setting expectations: we will try to reproduce next week and see if we require more in order to scope the issue. We will keep you posted

Thanks to note the submitted community PR https://github.com/airbytehq/airbyte/pull/37437 claims to have solved it as well so might be useful to check it out.

Cool! I’ll reproduce the issue before running some validation on this PR. Thanks!

btw thanks for the fix we now have all the data including deleted campaigns.