Is this your first time deploying Airbyte: No OS Version / Instance: EC2 m5.2xlarge, Amazon Linux 2 Memory / Disk: 32Gb / 500 GB EBS Deployment: Docker Airbyte Version: 0.35.32-alpha Source name/version: BigQuery 0.1.6 Destination name/version: Local CSV 0.2.9 Step: Try ➡️ failure to sync data Description: I'm trying to sync data from BigQuery and it fails.

I created a BigQuery table in my project by running the following query and saving into a table :

SELECT
  *
FROM
  `bigquery-public-data.crypto_bitcoin.blocks`
WHERE
  timestamp_month = "2022-02-1";

When I try to sync this table to a local CSV (Tried first with a custom destination but did not work either), I get the following errors :

2022-02-21 14:06:16 [1;31mERROR[m i.a.w.DefaultReplicationWorker(run):168 - Sync worker failed.
java.util.concurrent.ExecutionException: io.airbyte.workers.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1
	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?]
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?]
	at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:161) ~[io.airbyte-airbyte-workers-0.35.32-alpha.jar:?]
	at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:56) ~[io.airbyte-airbyte-workers-0.35.32-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.32-alpha.jar:?]
	at java.lang.Thread.run(Thread.java:833) [?:?]
	Suppressed: io.airbyte.workers.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled.
		at io.airbyte.workers.protocols.airbyte.DefaultAirbyteSource.close(DefaultAirbyteSource.java:136) ~[io.airbyte-airbyte-workers-0.35.32-alpha.jar:?]
		at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:125) ~[io.airbyte-airbyte-workers-0.35.32-alpha.jar:?]
		at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:56) ~[io.airbyte-airbyte-workers-0.35.32-alpha.jar:?]
		at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.32-alpha.jar:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
Caused by: io.airbyte.workers.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1
	at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:311) ~[io.airbyte-airbyte-workers-0.35.32-alpha.jar:?]
	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
	... 1 more
2022-02-21 14:06:16 [32mINFO[m i.a.w.DefaultReplicationWorker(run):227 - sync summary: io.airbyte.config.ReplicationAttemptSummary@583be78e[status=failed,recordsSynced=0,bytesSynced=0,startTime=1645452372851,endTime=1645452376562,totalStats=io.airbyte.config.SyncStats@1f7ff6c8[recordsEmitted=0,bytesEmitted=0,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[]]
2022-02-21 14:06:16 [32mINFO[m i.a.w.DefaultReplicationWorker(run):249 - Source did not output any state messages
2022-02-21 14:06:16 [33mWARN[m i.a.w.DefaultReplicationWorker(run):260 - State capture: No state retained.
2022-02-21 14:06:16 [32mINFO[m i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling...
2022-02-21 14:06:16 [32mINFO[m i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$1):144 - sync summary: io.airbyte.config.StandardSyncOutput@773593b5[standardSyncSummary=io.airbyte.config.StandardSyncSummary@e6394d[status=failed,recordsSynced=0,bytesSynced=0,startTime=1645452372851,endTime=1645452376562,totalStats=io.airbyte.config.SyncStats@1f7ff6c8[recordsEmitted=0,bytesEmitted=0,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[]],state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@f241ee9[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@513215fa[stream=io.airbyte.protocol.models.AirbyteStream@ac18c52[name=btc_feb_blocks,jsonSchema={"type":"object","properties":{"bits":{"type":"string"},"hash":{"type":"string"},"size":{"type":"number"},"nonce":{"type":"string"},"number":{"type":"number"},"weight":{"type":"number"},"version":{"type":"number"},"timestamp":{"type":"string"},"merkle_root":{"type":"string"},"stripped_size":{"type":"number"},"coinbase_param":{"type":"string"},"timestamp_month":{"type":"string"},"transaction_count":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=a_test_ds,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@3bdcf016[failureOrigin=source,failureType=<null>,internalMessage=io.airbyte.workers.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@142072d2[additionalProperties={attemptNumber=0, jobId=5}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1
	at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)
	at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)
	at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: io.airbyte.workers.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1
	at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:311)
	at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
	... 3 more
,retryable=<null>,timestamp=1645452376477]]]
2022-02-21 14:06:16 [32mINFO[m i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating...

Hi @Stéphane K, could you please share the full sync attempts log as I'm not able to find the root cause in the log you shared. Maybe you source table has column with specific types that are difficult to handle by the local csv connector. Maybe you can give a try to our GCS destination connector. It supports CSV exports and might by more reliable than the local csv.