@kapa.ai Are there still issues with Snowflake to mongodb slow transfer speed?

The knowledge sources only mention performance issues for: • Snowflake as a source to Snowflake destination, with typical throughputs around 1.5–2 MB/s and discussion that this is “within the normal range” for current database connectors. [Sync performance] • Snowflake as a destination, where a specific regression in

destination-snowflake

v4.0.1 caused extremely slow loads due to many tiny PUT/COPY batches; this was fixed in later versions (4.0.3+). [Snowflake v4.0.1 slow] There is no information in the provided sources about a Snowflake → MongoDB pipeline specifically, nor about known, current issues unique to that pair. So, based on these documents alone, I cannot confirm whether there are ongoing, Snowflake→MongoDB‑specific slow‑transfer issues. The only clear guidance is: • Some database connectors (including Snowflake source) commonly see ~2 MB/s throughput and this is currently considered normal. [Sync performance] • If you are using Snowflake as a destination, upgrading to the latest

destination-snowflake

(≥4.0.3) is important to avoid the v4.0.1 performance bug. [Snowflake v4.0.1 slow] If you can share your connector versions and whether Snowflake is your source or destination, I can try to map them more precisely to what’s described in these sources. 👍 0 button 👎 0 button ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.

@kapa.ai How many records is 2Mb/ps

The knowledge sources do not provide a way to convert “2 MB/s” into “records per second,” because the number of records per megabyte depends entirely on the average record size, which varies by connector and dataset. What is shown in the sources is that Airbyte often reports both metrics separately, for example: •

23.31 MB | 44,800 emitted records | 8m 8s

for a sync, which you can use to compute an average bytes‑per‑record for that job and then derive records/sec from MB/sec. [Sync speed example] • Other logs show

recordsEmitted

and

bytesEmitted

together, again allowing you to calculate an average record size for that specific run. [Posthog speed] So, to answer “how many records is 2 MB/s” for your case, you’d need to: 1. Take one of your completed syncs and note: ◦ total

bytesEmitted

◦ total

recordsEmitted

2. Compute average bytes per record:

avg_bytes_per_record = bytesEmitted / recordsEmitted

3. Convert 2 MB/s to bytes/s (assuming 1 MB ≈ 1,000,000 bytes):

2,000,000 / avg_bytes_per_record = records per second at 2 MB/s

Because the sources don’t give a universal average record size, I can’t provide a single numeric “X records/sec at 2 MB/s” that would be generally correct. 👍 0 button 👎 0 button ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.