Hey there, was testing out Airbyte by ingesting da...
# ask-community-for-troubleshootingm
Mason Mahaffey
04/14/2022, 9:13 PMHey there, was testing out Airbyte by ingesting data into DynamoDB and noticed the following schema for all records ingested:
• `_airbyte_ab_id`: a uuid assigned by Airbyte to each event that is processed.
• `_airbyte_emitted_at`: a timestamp representing when the event was pulled from the data source.
• `_airbyte_data`: a json blob representing with the extracted data.
• `sync_time`: a tim
Is there any way to customize the record schema so that data is not nested within the
__airbyte__datam
Marcos Marx (Airbyte)
04/14/2022, 9:15 PMnot for dynamodb, some destination have the option to normalize/tabular the data like postgres and bigquery
👍 1
m
Mason Mahaffey
04/14/2022, 9:16 PMWill this feature be added anytime soon?
m
Marcos Marx (Airbyte)
04/14/2022, 9:16 PMI don’t think so, Airbyte uses dbt to apply normalization process and today there isn’t a package for dynamodb
👍 1
m
Mason Mahaffey
04/14/2022, 9:17 PMgotcha, you'd be surprised by how big of a need that is at my company
Mason Mahaffey
04/14/2022, 9:18 PMappreciate the help 🙂
Mason Mahaffey
04/14/2022, 9:20 PMCan airbyte load from Postgres to Dyanmodb?
m
Marcos Marx (Airbyte)
04/14/2022, 9:39 PMyes but data will be loaded as json into dynamodb
m
Mason Mahaffey
04/14/2022, 9:42 PMnot following, dynamo is json?
Mason Mahaffey
04/14/2022, 9:44 PMyou mean w/ a load into postgres it would include the same markup? So loading into Dynamo from postgres wouldn't work?
m
Marcos Marx (Airbyte)
04/14/2022, 10:01 PMwill work, but the data from postgres will be transfer as json in
_airbyte_data3 Views