Hi <@U04SE163WC8> have setup kubernetes with airby...
# ask-ai
i
Hi @kapa.ai have setup kubernetes with airbyte but i faced issue in setting up the source connector of google sheets
u
I'm sorry to hear that you're having trouble setting up the Google Sheets source connector in Airbyte. Here are the steps you can follow to set it up: For Airbyte Cloud: 1. Log into your Airbyte Cloud account. 2. Click Sources and then click + New source. 3. On the Set up the source page, select Google Sheets from the Source type dropdown. 4. Enter a name for the Google Sheets connector. For Airbyte Open Source: 1. Navigate to the Airbyte Open Source dashboard. 2. Click Sources and then click + New source. 3. On the Set up the source page, select Google Sheets from the Source type dropdown. 4. Enter a name for the Google Sheets connector. 5. Select your authentication method: - For Airbyte Cloud: (Recommended) Select Authenticate via Google (OAuth) from the Authentication dropdown, click Sign in with Google and complete the authentication workflow. - For Airbyte Open Source: (Recommended) Select Service Account Key Authentication from the dropdown and enter your Google Cloud service account key in JSON format:
Copy code
json   {       "type": "service_account",       "project_id": "YOUR_PROJECT_ID",       "private_key_id": "YOUR_PRIVATE_KEY",       ...     }
If you're using Airbyte Open Source, you'll need to create a GCP project, enable the Google Sheets API in your GCP project, and create a Service Account Key with access to the Spreadsheet you want to replicate. If you're still facing issues, could you please provide more details about the problem? That would help me assist you better. Sources: - [Google Sheets Source Setup](https://docs.airbyte.com/integrations/sources/google-sheets#set-up-the-google-sheets-connector-in-airbyte) - [Google Sheets Source Prerequisites](https://docs.airbyte.com/integrations/sources/google-sheets#google-sheets) - [Google Sheets Source Setup for Airbyte Open Source](https://docs.airbyte.com/integrations/sources/google-sheets#for-airbyte-open-source)
i
I have done all this. @kapa.ai but i still run into timeout issues
u
A message from kapa.ai
u
I'm sorry to hear that you're experiencing timeout issues. This could be due to a large amount of data being fetched from Google Sheets. One way to address this is by increasing Airbyte's timeout limit. You can do this by setting the
HTTP_IDLE_TIMEOUT
and
READ_TIMEOUT
environment variables. Here's how you can do it:
Copy code
yaml server:     extraEnvs:       - name: HTTP_IDLE_TIMEOUT         value: 20m       - name: READ_TIMEOUT         value: 30m
This configuration sets the idle timeout to 20 minutes and the read timeout to 30 minutes. You can adjust these values as per your requirements. If you're still facing issues, it would be helpful if you could provide more details about the error message you're seeing or any relevant logs. This would help in diagnosing the problem more accurately. Source: [Scaling Airbyte After Installation - Schema Discovery Timeouts](https://docs.airbyte.com/enterprise-setup/scaling-airbyte#schema-discovery-timeouts)
i
@kapa.ai i got this error
Airbyte is temporarily unavailable. Please try again. (HTTP 502)
u
A message from kapa.ai
u
I'm sorry to hear that you're encountering a
HTTP 502
error. This error typically indicates that a server, while acting as a gateway or proxy, received an invalid response from an inbound server it accessed while attempting to fulfill the request. One possible reason for this could be that the server is taking too long to respond due to the large response for timesheet_details, causing a timeout. You might want to check the server timeout time and consider increasing it if necessary. Additionally, to help us understand better if the error is related to the platform or the specific API you're trying to connect to, could you try connecting to other sources like Github, CSV, or a local Postgres database and see if you encounter the same issue? If the issue persists, it would be helpful to check the logs for any errors. You can do this by running
kubectl logs <pod-name>
for the relevant Airbyte pods in your Kubernetes cluster. Sources: - [Facing Issue while trying to Hit Custom API in Airbyte](https://github.com/airbytehq/airbyte/discussions/34557) - [Hubspot source check fail](https://github.com/airbytehq/airbyte/discussions/37798) - [502 Timeout When Creating Connection](https://discuss.airbyte.io/t/1207) - [Self-hosted Airbyte in Docker stuck and will not trigger sync](https://github.com/airbytehq/airbyte/issues/44833) - [Nginx reverse proxy tells 502 until containers restarted](https://discuss.airbyte.io/t/3239)