Raj
04/04/2022, 12:01 PMAlban van Rijsewijk
04/04/2022, 4:29 PMConnor Lough
04/04/2022, 4:58 PMKris Hagel
04/04/2022, 7:01 PMMarcos Marx (Airbyte)
04/04/2022, 8:00 PMJerri Comeau (Airbyte)
gunu
04/04/2022, 10:56 PMPlease check with maintainers if the connector or library code should safely clean up its threads before quitting instead.
Is this considered an issue? Our EC2 Docker instance crashes infrequently after running without problems and this often follows attempts to use/troubleshoot the survey monkey connector.
2022-04-04 22:50:33 [43mdestination[0m > 2022-04-04 22:50:33 [33mWARN[m i.a.i.b.IntegrationRunner(watchForOrphanThreads):229 - The main thread is exiting while children non-daemon threads from a connector are still active.
2022-04-04 22:50:33 [43mdestination[0m > Ideally, this situation should not happen...
2022-04-04 22:50:33 [43mdestination[0m > Please check with maintainers if the connector or library code should safely clean up its threads before quitting instead.
2022-04-04 22:50:33 [43mdestination[0m > The main thread is: main (RUNNABLE)
2022-04-04 22:50:33 [43mdestination[0m > Thread stacktrace: java.base/java.lang.Thread.getStackTrace(Thread.java:1610)
2022-04-04 22:50:33 [43mdestination[0m > at io.airbyte.integrations.base.IntegrationRunner.dumpThread(IntegrationRunner.java:264)
2022-04-04 22:50:33 [43mdestination[0m > at io.airbyte.integrations.base.IntegrationRunner.watchForOrphanThreads(IntegrationRunner.java:233)
2022-04-04 22:50:33 [43mdestination[0m > at io.airbyte.integrations.base.IntegrationRunner.runConsumer(IntegrationRunner.java:190)
2022-04-04 22:50:33 [43mdestination[0m > at io.airbyte.integrations.base.IntegrationRunner.lambda$runInternal$1(IntegrationRunner.java:163)
2022-04-04 22:50:33 [43mdestination[0m > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:54)
2022-04-04 22:50:33 [43mdestination[0m > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:38)
2022-04-04 22:50:33 [43mdestination[0m > at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:163)
2022-04-04 22:50:33 [43mdestination[0m > at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:105)
2022-04-04 22:50:33 [43mdestination[0m > at io.airbyte.integrations.destination.snowflake.SnowflakeDestination.main(SnowflakeDestination.java:30)
2022-04-04 22:50:33 [43mdestination[0m > 2022-04-04 22:50:33 [33mWARN[m i.a.i.b.IntegrationRunner(watchForOrphanThreads):243 - Active non-daemon thread: pool-4-thread-1 (TIMED_WAITING)
2022-04-04 22:50:33 [43mdestination[0m > Thread stacktrace: java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method)
2022-04-04 22:50:33 [43mdestination[0m > at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252)
2022-04-04 22:50:33 [43mdestination[0m > at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1672)
2022-04-04 22:50:33 [43mdestination[0m > at java.base@17.0.1/java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:460)
2022-04-04 22:50:33 [43mdestination[0m > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
2022-04-04 22:50:33 [43mdestination[0m > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122)
2022-04-04 22:50:33 [43mdestination[0m > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
2022-04-04 22:50:33 [43mdestination[0m > at java.base@17.0.1/java.lang.Thread.run(Thread.java:833)
2022-04-04 22:50:33 [43mdestination[0m > 2022-04-04 22:50:33 [32mINFO[m i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded.
Shubham Kumar
04/05/2022, 5:56 AMRytis Zolubas
04/05/2022, 7:22 AMHa Pham
04/05/2022, 8:42 AMHaithem (WOOP)
04/05/2022, 8:42 AMKyle Vorster
04/05/2022, 8:49 AM2022-04-05 08:41:12 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating...
2022-04-05 08:41:12 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed.
errors: $.format_type: does not have a value in the enumeration [Avro], $.compression_codec: string found, object expected, $.compression_codec: should be valid to one and only one of the schemas
2022-04-05 08:41:12 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed.
errors: $.flattening: is missing but it is required, $.format_type: does not have a value in the enumeration [CSV]
2022-04-05 08:41:12 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed.
errors: $.format_type: does not have a value in the enumeration [JSONL]
Kiran Desi Reddy Venkata
04/05/2022, 1:01 PMHamza Liaqat
04/05/2022, 2:10 PM_airbyte_raw_issues
table is 1041 after sync 1, for example. Yet, if I rerun this experiment from scratch, the size of _airbyte_raw_issues
would be 1030 (for example) such it's not reproducible. I ran many experiments today but airbyte seems to miss at least a few records in raw issues table in each sync.Pranit
04/05/2022, 2:35 PMerrors: $.credential: is not defined in the schema and the schema does not allow additional properties, $.part_size_mb: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_name: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_path: is not defined in the schema and the schema does not allow additional properties, $.keep_files_in_gcs-bucket: is not defined in the schema and the schema does not allow additional properties, $.method: must be a constant value Standard
Pablo L.
04/05/2022, 2:45 PMJing Zhang
04/05/2022, 4:18 PMKevin Chan
04/05/2022, 4:32 PMKevin Chan
04/05/2022, 4:53 PMkomal azram
04/05/2022, 7:18 PMAndrés Bravo
04/05/2022, 9:17 PMv0.35.3-beta
to v0.35.46-beta
upgrading is fine but after that, export and import the same file fails with this message. Going v0.35.30-beta
first does not help.Steve Reeling
04/05/2022, 10:36 PMkomal azram
04/05/2022, 10:43 PMPiyush Bajaj
04/06/2022, 8:01 AMAbdulrahman Abu Tayli
04/06/2022, 8:23 AMIsaac Harris-Holt
04/06/2022, 9:36 AMIsaac Harris-Holt
04/06/2022, 9:43 AMMatheus Guinezi
04/06/2022, 1:26 PMPranit
04/06/2022, 5:13 PM2022-04-06 17:12:06 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed.
errors: $.credential: is not defined in the schema and the schema does not allow additional properties, $.part_size_mb: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_name: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_path: is not defined in the schema and the schema does not allow additional properties, $.keep_files_in_gcs-bucket: is not defined in the schema and the schema does not allow additional properties, $.method: must be a constant value Standard
Schuyler Duveen
04/06/2022, 7:57 PMi.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):305 - Total records read: 1 (0 bytes)