https://linen.dev logo
#ask-community-for-troubleshooting
Title
# ask-community-for-troubleshooting
a

Ashish Gupta

07/08/2021, 12:28 PM
Hey guys, been playing around with airbyte and it looks really cool. Couple of things that I see as roadblocks to adoption: 1) Scheduling with CRON: Can see the GitHub discussions on this so hoping this would be closed sometime soon. 2) Can't figure out how to sync only particular columns of a selected table to help keep the data warehouse lean. Was wondering if anyone had solved any of these or had some workarounds
1
a

Anton Nosovitsky

07/08/2021, 12:30 PM
Sounds like you could use dbt transformations to shape the output of your data, maybe that can be used?
d

Davin Chia (Airbyte)

07/08/2021, 12:54 PM
Hi, we have https://github.com/airbytehq/airbyte/issues/2227 around syncing only a particular columns of selected table. Please comment on this to help us prioritise!
otherwise, like what Anton says, one way is to use custom transforamations with dbt to filter retain a subset of the columns after the sync finishes
a

Ashish Gupta

07/08/2021, 1:10 PM
Thanks @Davin Chia (Airbyte) , have added comments and voted up.
Hey @Anton Nosovitsky, this can be done via dbt but seems like an unnecessary burden. Also adds to trasfer pipe and load. So not sure it's a long term solution.
3 Views