Hi Airbyte Community.
I have recently started working on Airbyte (replacing Singer API).
Issue i am facing is that while trying to sync data from mongo db to AWS s3 location,
few columns are being missed in tables.
For instance,
Consider a table users with columns user_id, name, location,phone_num
While the sync is performed, column 'location' is missed, while it is present in mongo db.
I tried to figure out this issue via Octavia CLI, but could not find any way that mising columns can be defined.
Just wanted to mention that this column has ~70% nan values.
But going with the fact that even for 30% data the column should not be missed.
It would be very kind of you guys if anyone can show some way out of this.
cc: @Sachin Tripathi @Vaidehi Khalpada