Hello team, is it possible to increase reading fetchsize in ms sql server source connector? I’m doing a load test here with 50 million records and it’s so far very slow as it’s fetching data with 1k batches. any help is appreciated, thanks 🙂

@[DEPRECATED] Marcos Marx turned this thread into Zendesk ticket 2724 to ensure timely resolution!

Hi! Thank you for your patience, I was out of the office yesterday. What version of Airbyte/connectors are you on? Being behind on updates might be a reason for things not working :)

Hi! Thank you for your patience, I was out of the office yesterday. What version of Airbyte/connectors are you on? Being behind on updates might be a reason for things not working :)

I am using the latest version of sql server connector

Yes - In developing the adaptive fetch size we have focused on stability, and this can slow down the sync time. The only thing you could try right now is to allocate more memory to the connection. Here's the doc: https://docs.airbyte.com/operator-guides/configuring-connector-resources/#configuring-connection-specific-requirements The default it uses 500MB memory. Bumping this to 1GB or more will increase the JDBC fetch size, and potentially accelerate it. Let me know if this helps! Also I don't believe you mentioned your Airbyte version. Make sure you're on the latest release to make sure you're getting the latest updates and bugfixes!

Hi Nataly, thanks a lot for explanation I will check in detail, I’m using the latest version of Airbyte, v0.40.14

That's great, let me know how it goes!

That's great, let me know how it goes!