https://linen.dev logo
Join Slack
Powered by
Hi folks, I keep fighting with Airbyte. Now I have...
# replication-troubleshooting
m
Hi folks, I keep fighting with Airbyte. Now I have a error when I try to make a connection. In docker logs I don't see any "error" and in the web I only see this.. Any help? 
TypeError: Cannot convert undefined or null to object
n
Hey Mario! I need more info for this - what version of Airbyte and connectors are you using? Does this happen during sync?
m
Yes, this happen during the first sync, when it starts the schema validation. Any option to skip the validation? My JSON response from my API have diferents fields in the same response, so it is imposible to create the schema.
Some logs for the server:
Copy code
airbyte-worker                    | 2022-12-21 09:39:06 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.26
airbyte-worker                    | 2022-12-21 09:39:06 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation
airbyte-worker                    | 2022-12-21 09:39:06 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.26
airbyte-worker                    | 2022-12-21 09:39:06 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation
airbyte-temporal                  | {"level":"info","ts":"2022-12-21T09:39:07.266Z","msg":"Get dynamic config","name":"limit.blobSize.error","value":2097152,"default-value":2097152,"logging-call-at":"config.go:79"}
airbyte-temporal                  | {"level":"info","ts":"2022-12-21T09:39:07.266Z","msg":"Get dynamic config","name":"limit.blobSize.warn","value":262144,"default-value":262144,"logging-call-at":"config.go:79"}
airbyte-worker                    | 2022-12-21 09:39:07 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if <http://304572438839.dkr.ecr.eu-central-1.amazonaws.com/airbyte/source-nailted-zubi:0.0.2|304572438839.dkr.ecr.eu-central-1.amazonaws.com/airbyte/source-nailted-zubi:0.0.2> exists...
airbyte-worker                    | 2022-12-21 09:39:07 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if <http://304572438839.dkr.ecr.eu-central-1.amazonaws.com/airbyte/source-nailted-zubi:0.0.2|304572438839.dkr.ecr.eu-central-1.amazonaws.com/airbyte/source-nailted-zubi:0.0.2> exists...
airbyte-worker                    | 2022-12-21 09:39:07 INFO i.a.c.i.LineGobbler(voidCall):114 - <http://304572438839.dkr.ecr.eu-central-1.amazonaws.com/airbyte/source-nailted-zubi:0.0.2|304572438839.dkr.ecr.eu-central-1.amazonaws.com/airbyte/source-nailted-zubi:0.0.2> was found locally.
airbyte-worker                    | 2022-12-21 09:39:07 INFO i.a.w.p.DockerProcessFactory(create):120 - Creating docker container
airbyte-worker                    | 2022-12-21 09:39:07 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):97 - Reading messages from protocol version 0.2.0
airbyte-worker                    | 2022-12-21 09:39:07 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):97 - Reading messages from protocol version 0.2.0
airbyte-worker                    | 2022-12-21 09:39:11 WARN c.n.s.JsonMetaSchema(newValidator):278 - Unknown keyword existingJavaType - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
airbyte-worker                    | 2022-12-21 09:39:11 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
airbyte-worker                    | 2022-12-21 09:39:11 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
airbyte-cron                      | 2022-12-21 09:39:11 INFO i.a.c.s.DefinitionsUpdater(updateDefinitions):54 - Connector definitions update disabled.
airbyte-temporal                  | {"level":"info","ts":"2022-12-21T09:39:12.032Z","msg":"Get dynamic config","name":"frontend.sendRawWorkflowHistory","value":false,"default-value":false,"logging-call-at":"config.go:79"}
airbyte-temporal                  | {"level":"info","ts":"2022-12-21T09:39:12.042Z","msg":"Get dynamic config","name":"system.visibilityArchivalState","value":"enabled","default-value":"enabled","logging-call-at":"config.go:79"}
n
Is this a custom connector? Schema validation cannot be skipped. If this is something you're developing, look into dynamic schemas: https://docs.airbyte.com/connector-development/cdk-python/schemas/#dynamic-schemas
m
Yes, it is a custom connector. However, from the logs, how do I know what is going wrong? I have already made several custom connector, but in this case in the logs I do not see any ERROR.
n
Our team does not have the capacity to provide custom connector development support, unfortunately. From the initial error you posted 
TypeError: Cannot convert undefined or null to object
It looks to me like there is an object that is undefined/null, and when the function/call goes on it causes this exception. I think the best solution would be to implement an exception handler for this and await for the object not to be null. Hope this helps and sorry that we don't have the capacity to provide more support!
p
I’m also using a custom connector; I have the same error when viewing the Replication tab of a connection @Mario Beteta have you found the reason why? my previous custom connectors are working as well
m
Hi philippe, the solution is downgrade tu 0.40.25
a
@Adham Suliman tracking
5 Views
Open in Slack
PreviousNext
Powered by