Hey team :sparkles:, We wanted to update the HubS...
# give-feedback
a
Hey team , We wanted to update the HubSpot connector but now experience doubled size and OOM of the pod, very long sync due to this PR which has been merged. All raw data are duplicated because of it (unnsest JSON + raw JSON) in
airbyte_data
field. We have millions of companies and hundred of columns. Full refresh are now not possible to perform. Do you plan on changing it ? Will this become a standard ? If so, we will have to maintain forks of connectors. Or at least give user a parameter to disable this unnest. IMO Airbyte should not alter raw data. cc @Anas El Mhamdi
👍 2
a
Hi Antoine - thanks for this feedback. I created a GitHub issue for this here. Feel free to add any more details to it