wave hello everyone I m trying to use Airbyte to migrate fr Airbyte #ask-community-for-troubleshooting

:wave: hello everyone ! I'm trying to use Airbyte...

Emmanuel Gomez

04/21/2022, 7:29 PM

👋 hello everyone ! I'm trying to use Airbyte to migrate from Postgres to Postgres, across AWS accounts. I've got things set up where I have Airbyte running locally and connecting to both DBs. It repeatably runs through a complete sync (2.5h) and then fails with

An I/O error occurred while sending to the backend.

I'm not quite sure where to look next. Does anyone have any pointers or ideas?

✅ 1

Emmanuel Gomez

04/21/2022, 9:32 PM

I should mention that shortly further down the stacktrace is the revelation that the above exception was

Caused by: java.io.EOFException

. I initially guessed this might be due to encountering disk space limits on the Postgres instance behind temporal, or something in that neighborhood, but I've ruled that out (I think)

Emmanuel Gomez

04/21/2022, 9:35 PM

OK, this appears to be a socket timeout wherein the query is running for a long time on the destination DB, and the pg client is getting dropped due to a socket timeout. libpq supports configuring keepalives for maintaining an open connection for a query that runs longer than a socket timeout. How can I configure socket keepalives in the Airbyte PostgreSQL destination?

Augustin Lafanechere (Airbyte)

04/25/2022, 8:12 AM

Hi @Emmanuel Gomez, we moved our community support on our forum. Could you please post this question in the troubleshooting category?

5 Views

Open in Slack

Previous Next