Vasiliy Knizhnikov
07/26/2021, 1:46 PM{
"visitId":"xxx",
"visitStartTime":"xxx",
"date":"xxx",
"geoNetwork":{
"country":"xxx"
},
"hits":[
{
"page":{
"pagePath":"xxx",
"hostname":"xxx,
"pageTitle":"xxx"
}
}
]
}
Corresponding catalog for the schema:
{
"streams": [
{
"sync_mode": "full_refresh",
"destination_sync_mode": "overwrite",
"stream": {
"name": "data",
"json_schema": {
"type": "object",
"properties": {
"visitId": {
"type": "number"
},
"visitStartTime": {
"type": "number"
},
"date": {
"type": "string"
},
"geoNetwork": {
"type": "object",
"properties": {
"country": {
"type": "string"
}
}
},
"hits": {
"type": "array",
"properties": {
"page": {
"type": "object",
"properties": {
"pagePath": {
"type": "string"
},
"hostname": {
"type": "string"
},
"pageTitle": {
"type": "string"
}
}
}
}
}
}
}
}
}
]
}
So effectively, hits
property is an array where one of properties is an object.
I’m struggling with normalization here. Basic normalization works fine for flat nested objects like geoNetwork, but hits
table not even being created
❓ Do I need to create a custom dbt transform in order to normalize records like these or there’s other way to do this?
Thank you!charles
s
Howard Lince III
08/02/2021, 1:50 PMNorman Rosner
08/06/2021, 8:28 AMLars Kamp
08/11/2021, 7:21 AMcharles
s
gunu
08/23/2021, 11:15 AMairbyte-dbt
package (similar to fivetran dbt package)Hicham Rahj
08/25/2021, 8:08 AMJohn (Airbyte)
Steve
08/26/2021, 9:43 AMJarrod Parkes
09/03/2021, 3:55 PMNoel Gomez
09/11/2021, 2:22 PMs
Farman Pirzada
09/14/2021, 11:18 PMMichel
John (Airbyte)
Marwan
09/22/2021, 8:54 PMElaaf
09/27/2021, 11:21 AMMayank Sardana
09/30/2021, 4:45 AMchad cole
09/30/2021, 6:02 PMMatheus de Freitas Andrade
09/30/2021, 9:52 PMDavin Chia (Airbyte)
Aldo M
10/08/2021, 8:07 AMMichel Ebner
10/12/2021, 9:14 AMGergely Lendvai
10/15/2021, 8:47 AMSheshan
10/19/2021, 10:10 AMGergely Lendvai
10/20/2021, 1:24 PMGeorge Claireaux (Airbyte)