hi, we have just upgraded Airbyte from v0.26.1 to ...
# troubleshootingh
Ha Pham
04/05/2022, 8:42 AMhi, we have just upgraded Airbyte from v0.26.1 to v0.35.64-alpha and a sync from Hubspot to BigQuery (denormalized destination) failed
Ha Pham
04/05/2022, 8:43 AMa portion of the log:
Copy code
2022-04-05 08:13:36 [43mdestination[0m > 2022-04-05 08:13:36 [1;31mERROR[m i.a.i.d.b.u.AbstractBigQueryUploader(upload):64 - Got an error while writing message: Invalid format: "2020-04-27 08:18:38" is malformed at " 08:18:38"
2022-04-05 08:13:36 [43mdestination[0m > java.lang.IllegalArgumentException: Invalid format: "2020-04-27 08:18:38" is malformed at " 08:18:38"
2022-04-05 08:13:36 [43mdestination[0m > at org.joda.time.format.DateTimeParserBucket.doParseMillis(DateTimeParserBucket.java:187) ~[joda-time-2.10.4.jar:2.10.4]
2022-04-05 08:13:36 [43mdestination[0m > at org.joda.time.format.DateTimeFormatter.parseMillis(DateTimeFormatter.java:826) ~[joda-time-2.10.4.jar:2.10.4]
2022-04-05 08:13:36 [43mdestination[0m > at org.joda.time.convert.StringConverter.getInstantMillis(StringConverter.java:65) ~[joda-time-2.10.4.jar:2.10.4]
2022-04-05 08:13:36 [43mdestination[0m > at org.joda.time.base.BaseDateTime.<init>(BaseDateTime.java:173) ~[joda-time-2.10.4.jar:2.10.4]
2022-04-05 08:13:36 [43mdestination[0m > at org.joda.time.DateTime.<init>(DateTime.java:257) ~[joda-time-2.10.4.jar:2.10.4]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.destination.bigquery.BigQueryUtils.lambda$transformJsonDateTimeToBigDataFormat$0(BigQueryUtils.java:231) ~[io.airbyte.airbyte-integrations.connectors-destination-bigquery-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at java.util.ArrayList.forEach(ArrayList.java:1511) ~[?:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.destination.bigquery.BigQueryUtils.transformJsonDateTimeToBigDataFormat(BigQueryUtils.java:226) ~[io.airbyte.airbyte-integrations.connectors-destination-bigquery-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryDenormalizedRecordFormatter.formatDateTimeFields(DefaultBigQueryDenormalizedRecordFormatter.java:156) ~[io.airbyte.airbyte-integrations.connectors-destination-bigquery-denormalized-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryDenormalizedRecordFormatter.formatData(DefaultBigQueryDenormalizedRecordFormatter.java:143) ~[io.airbyte.airbyte-integrations.connectors-destination-bigquery-denormalized-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryDenormalizedRecordFormatter.lambda$getObjectNode$6(DefaultBigQueryDenormalizedRecordFormatter.java:189) ~[io.airbyte.airbyte-integrations.connectors-destination-bigquery-denormalized-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at java.util.stream.Collectors.lambda$uniqKeysMapAccumulator$1(Collectors.java:180) ~[?:?]
2022-04-05 08:13:36 [43mdestination[0m > at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169) ~[?:?]
2022-04-05 08:13:36 [43mdestination[0m > at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:179) ~[?:?]
2022-04-05 08:13:36 [43mdestination[0m > at java.util.Iterator.forEachRemaining(Iterator.java:133) ~[?:?]
2022-04-05 08:13:36 [43mdestination[0m > at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1845) ~[?:?]
2022-04-05 08:13:36 [43mdestination[0m > at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509) ~[?:?]
2022-04-05 08:13:36 [43mdestination[0m > at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?]
2022-04-05 08:13:36 [43mdestination[0m > at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921) ~[?:?]
2022-04-05 08:13:36 [43mdestination[0m > at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
2022-04-05 08:13:36 [43mdestination[0m > at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682) ~[?:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryDenormalizedRecordFormatter.getObjectNode(DefaultBigQueryDenormalizedRecordFormatter.java:188) ~[io.airbyte.airbyte-integrations.connectors-destination-bigquery-denormalized-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryDenormalizedRecordFormatter.formatData(DefaultBigQueryDenormalizedRecordFormatter.java:145) ~[io.airbyte.airbyte-integrations.connectors-destination-bigquery-denormalized-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryDenormalizedRecordFormatter.formatRecord(DefaultBigQueryDenormalizedRecordFormatter.java:115) ~[io.airbyte.airbyte-integrations.connectors-destination-bigquery-denormalized-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.destination.bigquery.uploader.AbstractBigQueryUploader.upload(AbstractBigQueryUploader.java:62) ~[io.airbyte.airbyte-integrations.connectors-destination-bigquery-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.destination.bigquery.BigQueryRecordConsumer.processRecord(BigQueryRecordConsumer.java:53) ~[io.airbyte.airbyte-integrations.connectors-destination-bigquery-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.destination.bigquery.BigQueryRecordConsumer.acceptTracked(BigQueryRecordConsumer.java:45) ~[io.airbyte.airbyte-integrations.connectors-destination-bigquery-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.accept(FailureTrackingAirbyteMessageConsumer.java:50) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.base.IntegrationRunner.consumeWriteStream(IntegrationRunner.java:182) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.base.IntegrationRunner.lambda$runConsumer$2(IntegrationRunner.java:191) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.base.IntegrationRunner.watchForOrphanThreads(IntegrationRunner.java:220) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.base.IntegrationRunner.runConsumer(IntegrationRunner.java:190) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.base.IntegrationRunner.lambda$runInternal$1(IntegrationRunner.java:163) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:54) [io.airbyte.airbyte-integrations.bases-base-java-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:38) [io.airbyte.airbyte-integrations.bases-base-java-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:163) [io.airbyte.airbyte-integrations.bases-base-java-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:105) [io.airbyte.airbyte-integrations.bases-base-java-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > at io.airbyte.integrations.destination.bigquery.BigQueryDenormalizedDestination.main(BigQueryDenormalizedDestination.java:50) [io.airbyte.airbyte-integrations.connectors-destination-bigquery-denormalized-0.35.64-alpha.jar:?]
2022-04-05 08:13:36 [43mdestination[0m > 2022-04-05 08:13:36 [1;31mERROR[m i.a.i.d.b.u.AbstractBigQueryUploader(upload):65 - Failed to process a message for job:
2022-04-05 08:13:36 [43mdestination[0m > io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter@46aa712c,m
Marcos Marx (Airbyte)
04/05/2022, 5:03 PMHi there! Thank you for your time posting in our Slack Channel. This week we’re moving our support discussions over to discuss.airbyte.io; if you would be so kind as to post your questions there, you’ll be able ask for help from fellow users as well as the Airbyte team. It is our intention that as of Friday afternoon (Pacific Time) we will lock this channel to everything except administrator posts. We’ll leave everything in place for the rest of April if you need to get information or troubleshooting from existing threads, with the intention of archiving the channel in early May. We really appreciate everyone helping us to build our community, and we’re looking forward to the next phase.
h
Ha Pham
04/06/2022, 3:04 AMThanks, I posted to the forum
4 Views