Hello : We are running a FB marketing pipeline wherein we use Airbyte FB source connector to pull data from FB marketing campaigns to AWS S3 bucket. We are pulling different tables from facebook and dumping them in s3. One of the field (column) of type array in one of the tables is skipped during ingestion, while other others are being successfully. I see several other array type columns being ingested but this one particularly fails. I am a newbie in airbyte field and appreciate support from the Airbyte team.

Hi. do you mean that you have a field that you do pull but is not written into the bucket?

Eli, I see the field in the schema but it is not present in AWS Athena table and aws s3.

can you verify in the airbyte tables that you see it in the json?

Airbyte tables meaning?

the tables that start with

__airbyte_raw__

Eli - is it possible to connect via zoom call?

Unfortunately I cant at the moment though you can try to look in those tables in the

_airbyte_data

field in the json

so in our case, we dump the data in the s3, so these tables will be present only if the destination is a table , correct?

Hey Anand! The raw tables should be present in S3 and they would have the data exactly as it is in the source. If there are any type conversion errors between the source and destination, these raw tables wouldn't reflect them. Could you check if this missing data is present in the raw tables?

Hi. If the data exists in the _airbyte tables then it is a problem in the normalization process - if they dont it is probably a bug