Hi everyone, i have been running into issues doing...
# ask-community-for-troubleshooting
j
Hi everyone, i have been running into issues doing a transfer from PostgreSQL to MySQL. The stream runs fine for a certain period of time (can be anywhere from 15minutes to 2 hours) and then will end with an error: Connection org.postgresql.jdbc.PgConnection@69eb86b4 marked as broken because of SQLSTATE(08006), ErrorCode(0) Stack Trace: org.postgresql.util.PSQLException: An I/O error occurred while sending to the backend. I have attached my logs here. I am not sure what is causing this and am not finding anything on web searches. Was wondering what could be causing this
u
Hi Jesse! From what I see this looks like it's a problem with your Postgres instance and the issue might be that the socket is timing out. https://www.postgresql.org/message-id/001701c53a90%24cf879cc0%246600a8c0%40kermit Could you look into changing the default timeout in the Postgres settings?
j
Hi Nataly, thanks. Where would i check that?
u
As this isn't an Airbyte configuration setting, this might need further investigation, but I've found this: https://dba.stackexchange.com/questions/164419/is-it-possible-to-limit-timeout-on-postgres-server
j
thank you!
p
Hey @Jesse! Did this work for you? Because I am having the exact same error with the Postgres connector. I’ve already tried to increase the number of workers on Airbyte, to eliminate the possibility of “timeout” from the postgres side, but I am have the exact same error everyday
j
im giving it a shot
running very large tables
it works for seemingly like 6 hours and then sometimes dies sometimes doesn't
doing tables in bunches for an initial sync and then going from there
p
But are you changing any configuration on the Postgres side?
j
i changed the idle_transactino_time_out to 5days
and changed the statement_timeout to 0 (default) tht doesn't kill it
and put in some timeout prevention in the JDBC settings in the Airbyte setup
🙏 1
l
Hi @Jesse where I can set this settings in the Airbyte setup? I've facing the same issue but I don't know where to find airbyte setup