https://linen.dev logo
t

Thao Pham

02/11/2022, 5:49 PM
Hi everyone! Has anyone run into memory issue with migrating 20+ million rows of data and taking forever for the data to come over into Snowflake? Is there a fast way of doing this? Anyone familiar with streaming...would this be a solution?
👀 1
m

Marcos Marx (Airbyte)

02/11/2022, 5:50 PM
What connector are you trying to use as a Source?
t

Thao Pham

02/11/2022, 8:05 PM
MS SQL
m

Marcos Marx (Airbyte)

02/12/2022, 2:14 AM
You can increase the batch size to read more records each time; check more info here: https://github.com/airbytehq/airbyte/issues/4314
2 Views