Hey guys, been playing around with airbyte and it ...
# ask-community-for-troubleshootinga
Ashish Gupta
07/08/2021, 12:28 PMHey guys, been playing around with airbyte and it looks really cool. Couple of things that I see as roadblocks to adoption: 1) Scheduling with CRON: Can see the GitHub discussions on this so hoping this would be closed sometime soon. 2) Can't figure out how to sync only particular columns of a selected table to help keep the data warehouse lean. Was wondering if anyone had solved any of these or had some workarounds
✅ 1
a
Anton Nosovitsky
07/08/2021, 12:30 PMSounds like you could use dbt transformations to shape the output of your data, maybe that can be used?
d
Davin Chia (Airbyte)
07/08/2021, 12:54 PM
Hi, we have https://github.com/airbytehq/airbyte/issues/2227 around syncing only a particular columns of selected table. Please comment on this to help us prioritise!
Davin Chia (Airbyte)
07/08/2021, 12:54 PM
otherwise, like what Anton says, one way is to use custom transforamations with dbt to filter retain a subset of the columns after the sync finishes
a
Ashish Gupta
07/08/2021, 1:10 PMThanks @Davin Chia (Airbyte) , have added comments and voted up.
Ashish Gupta
07/08/2021, 1:12 PMHey @Anton Nosovitsky, this can be done via dbt but seems like an unnecessary burden. Also adds to trasfer pipe and load. So not sure it's a long term solution.
3 Views