i'm Syncing Postgres to Weaviate and really close ...
# replication-ask-ai
v
i'm Syncing Postgres to Weaviate and really close to the end the sync failed with this stacktrace:
Copy code
2023-10-30 02:18:35 INFO i.a.w.g.BufferedReplicationWorker(readFromDestination):504 - readFromDestination: exception caught
io.airbyte.workers.internal.exception.DestinationException: Destination process exited with non-zero exit code 137
        at io.airbyte.workers.general.BufferedReplicationWorker.readFromDestination(BufferedReplicationWorker.java:498) ~[io.airbyte-airbyte-commons-worker-0.50.33.jar:?]
        at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$3(BufferedReplicationWorker.java:253) ~[io.airbyte-airbyte-commons-worker-0.50.33.jar:?]
        at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
        at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-10-30 02:18:35 INFO i.a.w.g.BufferedReplicationWorker(readFromDestination):507 - readFromDestination: done. (writeToDestFailed:true, dest.isFinished:true)
2023-10-30 02:18:35 INFO i.a.w.g.BufferedReplicationWorker(writeToDestination):468 - writeToDestination: exception caught
java.io.IOException: Broken pipe
        at java.io.FileOutputStream.writeBytes(Native Method) ~[?:?]
        at java.io.FileOutputStream.write(FileOutputStream.java:372) ~[?:?]
        at java.io.BufferedOutputStream.implWrite(BufferedOutputStream.java:216) ~[?:?]
        at java.io.BufferedOutputStream.write(BufferedOutputStream.java:205) ~[?:?]
        at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:313) ~[?:?]
        at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:385) ~[?:?]
        at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:361) ~[?:?]
        at sun.nio.cs.StreamEncoder.lockedWrite(StreamEncoder.java:162) ~[?:?]
        at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:143) ~[?:?]
        at java.io.OutputStreamWriter.write(OutputStreamWriter.java:220) ~[?:?]
        at java.io.BufferedWriter.implFlushBuffer(BufferedWriter.java:178) ~[?:?]
        at java.io.BufferedWriter.flushBuffer(BufferedWriter.java:163) ~[?:?]
Any idea?
k
Based on the information provided in the extracts, it's not possible to provide a specific solution to your problem. The error message
Destination process exited with non-zero exit code 137
typically indicates that the process was killed due to insufficient memory. However, without more context or information, it's hard to say definitively. One of the extracts mentions a similar issue where a sync operation failed due to insufficient memory. The user was advised to increase the memory limit for the job's main container by adjusting the
JOB_MAIN_CONTAINER_MEMORY_LIMIT
environment variable. However, please note that this is just a suggestion based on the information available in the extracts. For a more accurate diagnosis and solution, I would recommend posting your issue on the [Airbyte forum](https://discuss.airbyte.io) or reaching out to the Airbyte community on [Slack](https://airbytehq.slack.com).