We're syncing a large amount of ad creatives from facebook to bigquery across multiple ad accounts (have tried using full refresh overwrite and full refresh append) and we always see that even though the sync succeeds we're missing many records that we can verify exist on the facebook side through individual api calls. the number of creatives synced each day is also wildly different and goes up and down with seemingly no consistent reason. Anyone else seen this or know why this might be happening?

Hi Rohil, Have you checked the rate limits, pagination issues, or token/permission scope differences across ad accounts. One of those could be the reason you are experiencing the missing records you are referring to

we have the same permission scope across accounts. what I'm confused about is we sometimes get failures from the airbyte sync for rate limit issues that dont succeed on retries but for the syncs that did succeed I'm assuming that the rate limit failures are resolved by the exponential backoff. It's unclear to me what triggers an actual failed sync from airbyte vs a "success" with missing records