Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

Hi, I wanted to ask whether it is possible to selective sync few data from a table in postgres?

Can you create a view on postgres for that?

But can’t I select few data which I want in my destination db while setting up the connectors?

You can select the tables to sync from the source when setting up the connection, but I don't think you can select data within the table. For that, I think is better to create a view and pull data from that view.

For example, today you can't select which columns you want to replicate from the connection settings.

I think that this a popular feature request and it will be supported in the future :)

Could you provide a tentative timeline for this feature?

Not right now <@U02LWM60TV2> the most close issue requesting this feature is this one: <https://github.com/airbytehq/airbyte/issues/5541> you can subscribe to receive updates when is done.

Hi <@U02LWM60TV2> - it is usually better to have a separate transformation table to select fewer data columns. 1. Airbyte overwrites tables from temp tables when it syncs. So you should avoid working directly with Airbyte tables and have a transformation step. 2. Its better to get all the data from a given service, in case you want to use the data that you thought you don't need.

best!
Vijay.

Here is another popular Github issue requesting to filter fields <https://github.com/airbytehq/airbyte/issues/2227>

Thanks for sharing this, I'll check this out 