https://linen.dev logo
n

Nathan Gold

02/22/2022, 10:38 AM
Hi there, When I connect Stripe to BigQuerry, it's really strange, I only have 20 tables in Stripe and in GCP, Airbyte creates more than 100 tables ... Hundreds of empty tables... Any idea why ? Someone had the same issue ? Thanks for your help
n

Nicholas de Roualle

02/22/2022, 12:28 PM
I have the same, I guess it's because it's an API source and the API returns nested data so Airbyte unfolds it in several tables
e

Emmanuel Tarus

02/22/2022, 1:13 PM
Thx for your answer @Anatole Callies ! Any idea how to fix this ?
Why is it a problem ? I guess you could edit the connector code to retain the nested data in a json in the parent table, but it's a lot of work, rather than just querying the tables..
d

David Beaudway

02/22/2022, 6:20 PM
Hi @Nicholas de Roualle, as Anatole suggested, this is due to the normalization Airbyte runs. You can disable normalization, or implement a custom transformation with DBT if you want to change this behavior. You'll find a guide here.
o

Ofek Katriel

02/23/2022, 9:19 AM
Thank you very much @Augustin Lafanechere (Airbyte) !! I definitely have to work with DBT !
2 Views