Replied to the PR, but this did not solve any performance issues. I'm seeing the same performance in the latest version 0.1.5 - The previous Mongo connector and all other services I'm using to connect to Mongo do not have this issue, so I believe it is specific to the connector. https://github.com/airbytehq/airbyte/pull/7982
11/18/2021, 7:37 PM
fyi @Andrii Korotkov [GL] seems like we need to reopen this issue
11/18/2021, 7:44 PM
@s I have already opened this task and will see what else I can do.
11/18/2021, 7:55 PM
I think if you use a test collection > 10k records you'll see the issue I'm talking about. Its like discovery doesn't stop at 10k records, but just requests 10k batches endlessly until it reaches the end of the collection