Hi everyone, I have deployed Airbyte on a GKS clu...
# give-feedback
t
Hi everyone, I have deployed Airbyte on a GKS cluster and configured connections for GA4, Google Analytics, WooCommerce, etc., loading data into BigQuery. I’m facing an issue with scheduled syncs. The cron job runs successfully at 6 AM UTC, but in the timeline it shows 0 records loaded, and the latest data is not appearing in BigQuery. I have deployed 3 separate Airbyte instances, and all of them are showing the same issue. Even when I run the sync manually, I get the same behavior. Sometimes the stream status also shows incomplete data for certain streams. Additionally, my streams are loading data at a very slow rate. Sync jobs are taking 1–2 hours to complete, which is another issue I’m facing. Could you please help me understand what might be causing these issues? I would really appreciate your support. Thank you.
s
Hi @Taimoor Ali, I too faced similar issues for other source and destination sometime ago. Post checks I found that newer airbyte docker images support only amd64 architecture and I was on arm64 architecture. So post migrating Airbyte on amd64 system it worked well. Also, found that we need to provide a start date to source (salesforce in my case) to fetch all records else airbyte was taking some random or calculated date due to which we were not getting all rows from source
❤️ 1
thanku 1