Hi, I'm having some issues with JSON validation I ...
# connector-development
t
Hi, I'm having some issues with JSON validation I was hoping you could help with. The errors I'm getting are inconsistent, and not reproducible, in the sense that they occur for a different data point on separate runs. An example error is as below:
Copy code
2022-01-28 04:55:07 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. 
errors: $: string found, object expected
2022-01-28 04:55:07 ERROR i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: "type"
Can you please give me any insight into this issue. I can confirm that the data points are as expected by running the script locally.
w
Hey can you help with more info like at what step is this happening and it would be great if you can use the issue template which is pinned in #public-troubleshooting channel
f
Is this your first time deploying Airbyte: Yes OS Version / Instance: Ubuntu 18.04 Memory / Disk: 32Gb / 500Gb HDD Deployment: Docker Airbyte Version: 0.35.4-alpha Source name/version: Custom module Destination name/version: Custom module (Postgres) Description: When trying to sync data, some of the records get corrupted due to errors as indicated below, however, the records themselves have no issues. This only occurs ad hoc, and appears to be due to the worker parsing the stdout of the source, validating and then passing to the destination. It appears that it is somehow getting confused due to the structure of one of our LOG messages, which then clobbers the next RECORD?
Copy code
2022-01-25 01:48:09 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$2):216 - Records read: 2000
2022-01-25 01:48:09 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. 
errors: $: string found, object expected
2022-01-25 01:48:09 ERROR i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: ": "
j
I'm also seeing some very strange logs, not sure if these are expected?