Does Airbyte support views in MongoDB?

`2021-12-03 181730 ERROR () LineGobbler(voidCall):82 - /usr/local/bundle/gems/mongo-2.14.0/lib/mongo/operation/result.rb343in

raise_operation_failure': mapReduce on a view is not supported (166) (on myServer) (Mongo::Error::OperationFailure

Hi @Jeff Crooks I think you're not using our most recent MongoDB connector, could you access you sources configurations in the UI and check that you're using the

airbyte/source-mongodb-v2

image?

thats correct

i can tuse that connector due to performance reasons

separate open issue for that

😄

I'm afraid the Ruby client is trying to perform a mapReduce operation on the view, and map reduce operations on views are not allowed.

yep

the new one doing mapr as well or no?

i like 99% through this integration but the 1% s killing me 🙂

In v2 there's no specific processing for view and I do not see anything mapReduce related in our connector code. The read operation is quite straightforward:

final MongoCursor<Document> cursor = collection
          .find(filter.orElse(new BsonDocument()))
          .batchSize(BATCH_SIZE)
          .cursor();

Could you try reading a view with our v2 connector and tell me it works for you 😄 ?

schema discovery takes up to an hour and never returns

if i try a handful of times itll come back

Jeff I'll release a new version only using the 10k first records to discovery step today, I'll you know

@Joël Luijmes @[DEPRECATED] Marcos Marx Working great!!

and faster than the old connector

Only the discovery or the sync?