https://linen.dev logo
Join Slack
Powered by
Hi, I am trying to synchronize a table of my MySQL...
# replication-troubleshooting
l
Hi, I am trying to synchronize a table of my MySQL database that is in Google Cloud SQL and I get an error that I can not understand why because it is very generic. The connection to the database is done through a SSH tunnel and the error received is the following. Any help can be good, thank you very much.
More info:
Copy code
2023-01-09 10:52:59 replication-orchestrator > JSON schema validation failed. 
errors: $: null found, object expected
2023-01-09 10:52:59 replication-orchestrator > Validation failed: null
Copy code
2023-01-09 10:53:00 replication-orchestrator > (pod: jobs / destination-bigquery-write-1094692-2-gefln) - Closed all resources for pod
2023-01-09 10:53:00 replication-orchestrator > Sync worker failed.
java.util.concurrent.ExecutionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!
	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?]
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?]
	at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:247) ~[io.airbyte-airbyte-commons-worker-dev-31c65f8eea.jar:?]
	at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:171) ~[io.airbyte-airbyte-commons-worker-dev-31c65f8eea.jar:?]
	at io.airbyte.container_orchestrator.orchestrator.ReplicationJobOrchestrator.runJob(ReplicationJobOrchestrator.java:168) ~[io.airbyte-airbyte-container-orchestrator-dev-31c65f8eea.jar:?]
	at io.airbyte.container_orchestrator.Application.run(Application.java:79) ~[io.airbyte-airbyte-container-orchestrator-dev-31c65f8eea.jar:?]
	at io.airbyte.container_orchestrator.Application.main(Application.java:38) ~[io.airbyte-airbyte-container-orchestrator-dev-31c65f8eea.jar:?]
	Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 3. This warning is normal if the job was cancelled.
		at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:151) ~[io.airbyte-airbyte-commons-worker-dev-31c65f8eea.jar:?]
		at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:192) ~[io.airbyte-airbyte-commons-worker-dev-31c65f8eea.jar:?]
		at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:171) ~[io.airbyte-airbyte-commons-worker-dev-31c65f8eea.jar:?]
		at io.airbyte.container_orchestrator.orchestrator.ReplicationJobOrchestrator.runJob(ReplicationJobOrchestrator.java:168) ~[io.airbyte-airbyte-container-orchestrator-dev-31c65f8eea.jar:?]
		at io.airbyte.container_orchestrator.Application.run(Application.java:79) ~[io.airbyte-airbyte-container-orchestrator-dev-31c65f8eea.jar:?]
		at io.airbyte.container_orchestrator.Application.main(Application.java:38) ~[io.airbyte-airbyte-container-orchestrator-dev-31c65f8eea.jar:?]
Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!
	at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$6(DefaultReplicationWorker.java:385) ~[io.airbyte-airbyte-commons-worker-dev-31c65f8eea.jar:?]
at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$6(DefaultReplicationWorker.java:385) ~[io.airbyte-airbyte-commons-worker-dev-31c65f8eea.jar:?]
	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 3. This warning is normal if the job was cancelled.
	at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:151) ~[io.airbyte-airbyte-commons-worker-dev-31c65f8eea.jar:?]
	at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$6(DefaultReplicationWorker.java:383) ~[io.airbyte-airbyte-commons-worker-dev-31c65f8eea.jar:?]
	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-01-09 10:53:00 replication-orchestrator > Source did not output any state messages
2023-01-09 10:53:00 replication-orchestrator > State capture: No state retained.
2023-01-09 10:53:00 replication-orchestrator > sync summary: {
"status" : "failed",
  "recordsSynced" : 272198,
  "bytesSynced" : 5720375735,
  "startTime" : 1673260773818,
  "endTime" : 1673261580548,
  "totalStats" : {
    "bytesEmitted" : 5720375735,
    "destinationStateMessagesEmitted" : 0,
    "destinationWriteEndTime" : 1673261580509,
    "destinationWriteStartTime" : 1673260781472,
    "meanSecondsBeforeSourceStateMessageEmitted" : 0,
    "maxSecondsBeforeSourceStateMessageEmitted" : 0,
f
@Luis Martinez What is the version you are using? I am facing the same issue on EKS with Airbyte version 0.40.10
l
I am using v0.40.29
f
Are you using kubernetes?
s
Hey @Luis Martinez thanks for the question. In addition to the question raised by Fabiano above, what version connectors are you using and would it be possible to post the full logs somehow?
f
@Luis Martinez I have upgraded to version 0.40.32 using kubernetes (helm chart), and I am facing the same issue
l
My error is related to the following thread: https://airbytehq.slack.com/archives/C021JANJ6TY/p1673525673443309
s
Hello, if you're still running into this issue please try the latest helm charts and reply here with results
5 Views
Open in Slack
PreviousNext
Powered by