Hello All, while try to ingest data from Shopify t...
# airbyte-agents-ask-ai
v
Hello All, while try to ingest data from Shopify to Snowflake, few objects like Products, Product_Images, etc are silently failing, what i mean is Airbyte is creating the bulk jobs to read data but at the time of ingesting in Snowflake's internal Objects it is not writing a single records, I am seeing this issue since couple of days.
k
Shopify → Snowflake: product_images (and related streams) Writing 0 Records Your attached log confirms the issue clearly:
Copy code
Stream: `product_images`, the BULK Job: `<gid://shopify/BulkOperation/6569746989266>` time elapsed: 498.757 sec. Rows collected: 1665932 --> records: `0`.
The bulk job runs and collects rows, but 0 records are emitted. This is a known bug. Root Cause Starting with Shopify API version
2025-10
, the
groupObjects
parameter in
bulkOperationRunQuery
defaults to
false
instead of
true
. The Shopify connector's bulk record composition logic relies on grouped JSONL output where parent objects are immediately followed by their children. Without grouping, the record composition buffer either grows unboundedly (causing OOM kills) or produces 0 composed records — exactly what you're seeing. [OOM fix PR] The
product_images
stream is specifically one of the affected streams, as it uses parent-backed GraphQL Bulk operations. [Shopify limitations doc] What to Do 1. Upgrade the Shopify source connector to at least version 3.2.4 (which includes the
groupObjects: true
fix from PR #76183) or the latest available version. [OOM fix PR] 2. Clear and backfill affected streams after upgrading. The streams known to be affected include:Clearing a stream deletes the data Airbyte wrote for that stream in your destination, then a fresh sync will backfill it. See Clearing your data for instructions. [Shopify limitations doc] ◦
product_images
◦
metafield_products
◦
metafield_product_images
◦
metafield_customers
◦
customer_address
1. Check your current connector version — if you are already on 3.2.4+, please verify the exact version in your Airbyte UI, as the fix may not have been applied to your deployment yet. > Note: The bulk job successfully collecting 1,665,932 rows but emitting 0 records is the classic symptom of the
groupObjects
bug — the connector reads the data but cannot compose parent-child records without proper grouping. 👍 0 button 👎 0 button ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.