<@U04SE163WC8> getting the following error while ...
# ask-ai
t
@kapa.ai getting the following error while syncing data from postgres to redshift: Discovering schema failed Failed to run schema discovery.
k
It looks like you're encountering an issue with schema discovery while syncing data from Postgres to Redshift. Based on the information available, here are a few steps you can take to troubleshoot and potentially resolve the issue: 1. Check the Logs for Detailed Errors: Review the logs to get more details about the error. For example, in one of the cases, the error message was:
Copy code
2022-10-21 05:44:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-21 05:44:36 ERROR i.a.i.b.AirbyteExceptionHandler(uncaughtException):26 - Something went wrong in the connector. See the logs for more details.
[Source](https://discuss.airbyte.io/t/2979) 2. Check for Unsupported Data Types: Ensure that the data types in your Postgres schema are supported by Airbyte. For instance, there was an issue with
TIMESTAMP_WITH_TIMEZONE
not being supported:
Copy code
java.lang.IllegalArgumentException: TIMESTAMP_WITH_TIMEZONE is not supported.
[Source](https://discuss.airbyte.io/t/1342) 3. Network and Permissions: - Open the network tab to get the API response and see if there is a better error explanation there. - Create a test user with access to only one table and see if it is able to fetch the schema. This can help isolate if the issue is related to specific tables or permissions. - Check how many tables the database has, as sometimes the number of tables can impact the schema discovery process. [Source](https://discuss.airbyte.io/t/2548) 4. Schema Configuration: Even if you apply a specific schema in the source configuration, it might still fail. Ensure that the schema configuration is correct and that the source connection succeeds before connecting the source to the destination. [Source](https://discuss.airbyte.io/t/2979) If these steps do not resolve the issue, you may need to provide more specific details or consult the [Airbyte documentation](https://docs.airbyte.com) for further troubleshooting steps.