Ofek Katriel
02/21/2022, 6:47 PMVinod Varma
02/21/2022, 9:34 PMDustin Wood
02/21/2022, 10:18 PMuser
02/22/2022, 9:37 AMNathan Gold
02/22/2022, 10:38 AMSreeram Venkitesh
02/22/2022, 2:41 PMsource - 2022-02-22 08:22:41 INFO () DefaultAirbyteStreamFactory(internalLog):97 - Backing off _send(...) for 20.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)
source - 2022-02-22 08:23:06 INFO () DefaultAirbyteStreamFactory(internalLog):97 - Caught retryable error '' after 3 tries. Waiting 20 seconds then retrying...
source - 2022-02-22 08:23:06 INFO () DefaultAirbyteStreamFactory(internalLog):97 - Backing off _send(...) for 40.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)
source - 2022-02-22 08:23:51 INFO () DefaultAirbyteStreamFactory(internalLog):97 - Caught retryable error '' after 4 tries. Waiting 40 seconds then retrying...
source - 2022-02-22 08:23:51 INFO () DefaultAirbyteStreamFactory(internalLog):97 - Backing off _send(...) for 80.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)
source - 2022-02-22 08:25:16 INFO () DefaultAirbyteStreamFactory(internalLog):97 - Caught retryable error '' after 5 tries. Waiting 80 seconds then retrying...
source - 2022-02-22 08:25:16 ERROR () DefaultAirbyteStreamFactory(internalLog):95 - Giving up _send(...) after 6 tries (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)
source - 2022-02-22 08:25:16 ERROR () DefaultAirbyteStreamFactory(internalLog):95 - Encountered an exception while reading stream SourceStripe
Guillaume Chevalier
02/22/2022, 2:49 PMuser
02/22/2022, 5:00 PMRenzo B
02/22/2022, 6:18 PMDavid Beaudway
02/22/2022, 6:22 PM"Some properties contained invalid input."
but am am using the api as documented and this did work a couple of months ago when I built our original poc. I opened a github issue , not sure if that is the preferred thing to do, Any help would be greatly appreciatedJohn Maguire
02/22/2022, 6:34 PM2022-02-22 17:46:04 [44msource[0m > Setting state of ad_group_ads stream to {}
2022-02-22 17:46:05 [44msource[0m > Setting state of ad_group_ads stream to {}
2022-02-22 17:46:07 [44msource[0m > Setting state of ad_group_ads stream to {}
2022-02-22 17:46:08 [44msource[0m > Setting state of ad_group_ads stream to {}
2022-02-22 17:46:09 [44msource[0m > Setting state of ad_group_ads stream to {}
2022-02-22 17:46:10 [44msource[0m > Setting state of ad_group_ads stream to {}
2022-02-22 17:46:11 [44msource[0m > Setting state of ad_group_ads stream to {}
2022-02-22 17:46:11 [44msource[0m > Read 0 records from ad_group_ads stream
2022-02-22 17:46:11 [44msource[0m > Finished syncing SourceGoogleAds
Anyone got an idea of what might be happening here?Ofek Katriel
02/22/2022, 7:45 PMpods "...sync-...." is forbidden: failed quota: request-quota: must specify requests.cpu,requests.memory.', type='io.fabric8.kubernetes.client.KubernetesClientException', nonRetryable=...
Renzo B
02/22/2022, 8:14 PM2022-02-22 13:58:59 [32mINFO[m i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $: null found, object expected 2022-02-22 13:58:59 [1;31mERROR[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-02-22 13:59:05 [32mINFO[m i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $: null found, object expected 2022-02-22 13:59:05 [1;31mERROR[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-02-22 13:59:22 [32mINFO[m i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $: null found, object expected 2022-02-22 13:59:22 [1;31mERROR[m i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null
Which is followed by: 2022-02-22 13:59:31 [1;31mERROR[m i.a.w.DefaultReplicationWorker(run):141 - Sync worker failed. java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.RuntimeException: Source process exited with non-zero exit code 137 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:134) ~[io.airbyte-airbyte-workers-0.35.10-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:52) ~[io.airbyte-airbyte-workers-0.35.10-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:174) ~[io.airbyte-airbyte-workers-0.35.10-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Suppressed: io.airbyte.workers.WorkerException: Source process exit with code 137. This warning is normal if the job was cancelled. at io.airbyte.workers.protocols.airbyte.DefaultAirbyteSource.close(DefaultAirbyteSource.java:136) ~[io.airbyte-airbyte-workers-0.35.10-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:118) ~[io.airbyte-airbyte-workers-0.35.10-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:52) ~[io.airbyte-airbyte-workers-0.35.10-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:174) ~[io.airbyte-airbyte-workers-0.35.10-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?]
user
02/22/2022, 8:21 PMException in thread "main" java.nio.file.AccessDeniedException: s3-bucket: org.apache.hadoop.fs.s3a.auth.NoAwsCredentialsException: SimpleAWSCredentialsProvider: No AWS credentials in the Hadoop configuration
Also when I try with JSON/CSV format it works, and to mention that I attach an IAM role on the instance that runs Airbyte docker to read/write on the S3 bucket.Disi Koa
02/22/2022, 8:55 PMManoj Yadav
02/23/2022, 12:17 AMManoj Yadav
02/23/2022, 4:46 AMairbyte minio deployment
pod
API: SYSTEM()
Time: 04:47:08 UTC 02/23/2022
DeploymentID: f45f4b84-d973-46b6-9ff6-ae5fbd4d5c50
Error: Storage reached its minimum free disk threshold. (cmd.StorageFull)
1: cmd/data-usage.go:51:cmd.storeDataUsageInBackend()
Shah Newaz Khan
02/23/2022, 6:20 AMOfek Katriel
02/23/2022, 9:37 AMIvan Zaykov
02/23/2022, 10:47 AM2022-02-21 154040 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed.
errors: $: null found, object expected
2022-02-21 154040 ERROR i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: nullI used the exact same JSON schema with Redshift as destination and it worked. So i'm not sure whats wrong ?
César Sepúlveda
02/23/2022, 4:09 PMuser
02/25/2022, 8:12 PMi.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):87 - Attempting to get metadata from the database to see if we can connect.
Andrew Popp
02/25/2022, 9:26 PMNicolas Smith
02/28/2022, 9:42 PMReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 259000
2022-02-28 20:49:19 [32mINFO[m i.a.w.DefaultReplicationWorker(cancel):383 - Cancelling destination...
Patricio Lozano
02/28/2022, 10:02 PMCollin Lenon
03/01/2022, 1:37 AMSrinivasula Reddy Yennapusa
03/01/2022, 6:19 AMSrinivasula Reddy Yennapusa
03/01/2022, 6:21 AMIvan Coyoca
03/01/2022, 6:59 AMAdam Laurenčík
03/01/2022, 8:38 AM2022-02-28 15:58:47 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-02-28 15:58:47 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):178 - Executing finalization of tables.
2022-03-01 07:50:13 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):210 - Running sync worker cancellation...