Hi there,
When I connect Stripe to BigQuerry, it's really strange, I only have 20 tables in Stripe and in GCP, Airbyte creates more than 100 tables ... Hundreds of empty tables... Any idea why ? Someone had the same issue ?
Thanks for your help
n
Nicholas de Roualle
02/22/2022, 12:28 PM
I have the same, I guess it's because it's an API source and the API returns nested data so Airbyte unfolds it in several tables
e
Emmanuel Tarus
02/22/2022, 1:13 PM
Thx for your answer @Anatole Callies ! Any idea how to fix this ?
Why is it a problem ? I guess you could edit the connector code to retain the nested data in a json in the parent table, but it's a lot of work, rather than just querying the tables..
d
David Beaudway
02/22/2022, 6:20 PM
Hi @Nicholas de Roualle, as Anatole suggested, this is due to the normalization Airbyte runs. You can disable normalization, or implement a custom transformation with DBT if you want to change this behavior. You'll find a guide here.
o
Ofek Katriel
02/23/2022, 9:19 AM
Thank you very much @Augustin Lafanechere (Airbyte) !! I definitely have to work with DBT !