Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

Hi, does Airbyte support multiple cursor fields for Postgres?

My table does not use sequential IDs and it uses UUID. Also there are 2-3 timestamp fields (created_at, updated_at and sometimes deleted_at). Will Airbyte work?

No, Airbyte only support one cursor field at time.

Will you consider supporting above case? UUID as primary key and multple timestamps

Sure in the future this can be possible Lihan, could you create a Github issue requesting this feature&gt;

Also, just a question. Does Airbyte chunk the size of each batch ETL from Postgres? Since the data is very big, we have 500MB of data each day.

Yes, the batch size currently is 1000 records. You can edit the connector code to increase this value

<https://github.com/airbytehq/airbyte/issues/9561>