Maksims Voikovs
10/26/2023, 8:03 AMInternal message: com.mongodb.MongoCommandException: Command failed with error 292 (QueryExceededMemoryLimitNoDiskUseAllowed): 'Sort exceeded memory limit of 104857600 bytes, but did not opt in to external sorting. Aborting operation. Pass allowDiskUse:true
Connection with mongosh works fine. According MongoDB documentation allowDiskUse option isn't supported in connection strings, only in queries. So we don't have any means to pass this option. Is there any work arround of this problem?kapa.ai
10/26/2023, 8:04 AMallowDiskUse option during the setup of the connector. However, Airbyte's MongoDB connector does support [Change Data Capture (CDC)](https://docs.airbyte.com/understanding-airbyte/cdc) and reliable replication of any collection size with [checkpointing](https://docs.airbyte.com/understanding-airbyte/airbyte-protocol/#state--checkpointing) and chunking of data reads. This might help in handling large data sets and might indirectly address your issue. For more specific guidance, I recommend referring to the [Airbyte MongoDB documentation](https://docs.airbyte.com/integrations/sources/mongodb-v2) or asking your question in the [Airbyte community forum](https://discuss.airbyte.io).