Vikram Kumar
02/04/2022, 11:42 AMAugustin Lafanechere (Airbyte)
02/04/2022, 1:48 PMfetchsize
Airbyte uses to read the source in batch. This fetchsize
is today of 10000 records. This is not configurable at the moment and if you want to customize this you'll have to build Airbyte your own version of the Postgres connector and patch this file airbyte-db/lib/src/main/java/io/airbyte/db/jdbc/PostgresJdbcStreamingQueryConfiguration.java
.
An issue exists in our repo about this topic and we plan to make the fetch size configurable.SYNC_JOB_MAX_TIMEOUT_DAYS
env variable, which defaults to 3 days.Vikram Kumar
02/04/2022, 3:25 PMAugustin Lafanechere (Airbyte)
02/04/2022, 3:29 PM