Jack Novorr
10/28/2024, 12:43 AMuser
10/28/2024, 12:43 AMuser
10/28/2024, 12:44 AMuser
10/28/2024, 12:44 AMJack Novorr
10/28/2024, 12:44 AMuser
10/28/2024, 12:44 AMuser
10/28/2024, 12:45 AMserver
section of your Airbyte configuration. According to the [Airbyte documentation on scaling](https://docs.airbyte.com/enterprise-setup/scaling-airbyte#schema-discovery-timeouts), you can increase the timeout limit as follows: yaml server: extraEnvs: - name: HTTP_IDLE_TIMEOUT value: 20m - name: READ_TIMEOUT value: 30m
This configuration increases the HTTP idle timeout to 20 minutes and the read timeout to 30 minutes. 2. For destination-specific timeouts: Check the flags.yaml
file for destination timeout settings. As mentioned in the [Airbyte heartbeats documentation](https://docs.airbyte.com/understanding-airbyte/heartbeats#destination), you can configure: - `destination-timeout-max-seconds`: This sets the maximum duration for a call to the destination before it's considered timed out. The default is 24 hours. - `destination-timeout.failSync`: If set to true (default), a detected destination timeout will cause the sync to fail. 3. For Nginx proxy timeouts (if you're using Nginx): Look for the BASIC_AUTH_PROXY_TIMEOUT
environment variable. According to a [GitHub issue comment](https://github.com/airbytehq/airbyte/discussions/40738), you can set this in your environment configuration: global: env_vars: HTTP_IDLE_TIMEOUT: 1800s
And for the webapp ingress: webapp: ingress: annotations: <http://kubernetes.io/ingress.class|kubernetes.io/ingress.class>: internal <http://nginx.ingress.kubernetes.io/proxy-body-size|nginx.ingress.kubernetes.io/proxy-body-size>: 16m <http://nginx.ingress.kubernetes.io/proxy-send-timeout|nginx.ingress.kubernetes.io/proxy-send-timeout>: 1800 <http://nginx.ingress.kubernetes.io/proxy-read-timeout|nginx.ingress.kubernetes.io/proxy-read-timeout>: 1800
4. For specific connectors: Some connectors might have their own timeout settings. For example, in a [discussion about the Postgres connector](https://discuss.airbyte.io/t/1715), it was mentioned that the timeout value was hardcoded. In such cases, you might need to check the specific connector's documentation or configuration options. Remember, the exact location and method of changing these settings may vary depending on your Airbyte deployment method (Docker, Kubernetes, etc.) and version. Always refer to the official Airbyte documentation for the most up-to-date information on configuring your specific setup.Jack Novorr
10/28/2024, 12:51 AMuser
10/28/2024, 12:51 AMuser
10/28/2024, 12:51 AMJack Novorr
10/28/2024, 1:14 AMuser
10/28/2024, 1:14 AMuser
10/28/2024, 1:14 AM