Hi team, I ran into another issue with one of my c...
# replication-troubleshooting
t
Hi team, I ran into another issue with one of my custom HTTP connectors and would be very thankful if you could help. When running the source-connector from the console using the following command, everything works fine:
Copy code
docker run --rm -v $(pwd)/secrets:/secrets -v $(pwd)/sample_files:/sample_files airbyte/<CUSTOM_SOURCE>:dev read --config /secrets/config.json --catalog /sample_files/configured_catalog.json
However, the Airbyte GUI throws the following error message and the sync fails (I tried it with both S3 and local json destinations):
Copy code
airbyte-worker      | 2022-09-06 12:46:11 ERROR i.a.w.g.DefaultReplicationWorker(run):184 - Sync worker failed.
airbyte-worker      | java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.NullPointerException: Cannot invoke "java.net.URI.toString()" because "currentUri" is null
airbyte-worker      | 	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?]
airbyte-worker      | 	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?]
airbyte-worker      | 	at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:177) ~[io.airbyte-airbyte-workers-0.40.1.jar:?]
airbyte-worker      | 	at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.40.1.jar:?]
airbyte-worker      | 	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.40.1.jar:?]
airbyte-worker      | 	at java.lang.Thread.run(Thread.java:1589) [?:?]
airbyte-worker      | 	Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled.
airbyte-worker      | 		at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:136) ~[io.airbyte-airbyte-workers-0.40.1.jar:?]
airbyte-worker      | 		at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:141) ~[io.airbyte-airbyte-workers-0.40.1.jar:?]
airbyte-worker      | 		at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.40.1.jar:?]
airbyte-worker      | 		at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.40.1.jar:?]
airbyte-worker      | 		at java.lang.Thread.run(Thread.java:1589) [?:?]
airbyte-worker      | Caused by: java.lang.RuntimeException: java.lang.NullPointerException: Cannot invoke "java.net.URI.toString()" because "currentUri" is null
airbyte-worker      | 	at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:372) ~[io.airbyte-airbyte-workers-0.40.1.jar:?]
airbyte-worker      | 	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
airbyte-worker      | 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
airbyte-worker      | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
airbyte-worker      | 	... 1 more
airbyte-worker      | Caused by: java.lang.NullPointerException: Cannot invoke "java.net.URI.toString()" because "currentUri" is null
airbyte-worker      | 	at com.networknt.schema.JsonSchema.combineCurrentUriWithIds(JsonSchema.java:90) ~[json-schema-validator-1.0.42.jar:?]
airbyte-worker      | 	at com.networknt.schema.JsonSchema.<init>(JsonSchema.java:72) ~[json-schema-validator-1.0.42.jar:?]
airbyte-worker      | 	at com.networknt.schema.JsonSchema.<init>(JsonSchema.java:58) ~[json-schema-validator-1.0.42.jar:?]
airbyte-worker      | 	at com.networknt.schema.JsonSchema.<init>(JsonSchema.java:53) ~[json-schema-validator-1.0.42.jar:?]
airbyte-worker      | 	at com.networknt.schema.JsonSchemaFactory.newJsonSchema(JsonSchemaFactory.java:254) ~[json-schema-validator-1.0.42.jar:?]
airbyte-worker      | 	at com.networknt.schema.JsonSchemaFactory.getSchema(JsonSchemaFactory.java:362) ~[json-schema-validator-1.0.42.jar:?]
airbyte-worker      | 	at io.airbyte.validation.json.JsonSchemaValidator.validateInternal(JsonSchemaValidator.java:63) ~[io.airbyte-airbyte-json-validation-0.40.1.jar:?]
airbyte-worker      | 	at io.airbyte.validation.json.JsonSchemaValidator.ensure(JsonSchemaValidator.java:78) ~[io.airbyte-airbyte-json-validation-0.40.1.jar:?]
airbyte-worker      | 	at io.airbyte.workers.RecordSchemaValidator.validateSchema(RecordSchemaValidator.java:51) ~[io.airbyte-airbyte-workers-0.40.1.jar:?]
airbyte-worker      | 	at io.airbyte.workers.general.DefaultReplicationWorker.validateSchema(DefaultReplicationWorker.java:393) ~[io.airbyte-airbyte-workers-0.40.1.jar:?]
airbyte-worker      | 	at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:321) ~[io.airbyte-airbyte-workers-0.40.1.jar:?]
airbyte-worker      | 	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
airbyte-worker      | 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
airbyte-worker      | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
airbyte-worker      | 	... 1 more
e
Hi. This is the error:
Copy code
"java.net.URI.toString()" because "currentUri" is null
check the logic
t
Hi Eli, thanks for your reply. I have seen that this is the error and I believe that this is Airbyte logic. I do not quite understand where the error stems from, especially since the Python source connector runs perfectly when executed in the terminal.
e
this requires more debugging then. What connector are you using? what did you change?