Running airbyte via an aws ec2 instance (arm64), g...
# replication-troubleshooting
r
Running airbyte via an aws ec2 instance (arm64), getting this error during normalization to Snowflake?
Copy code
2023-01-14 16:34:30 INFO i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/1/0/normalize --log-driver none --name normalization-snowflake-normalize-1-0-frzai --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.40.28 airbyte/normalization-snowflake:0.2.25 run --integration-type snowflake --config destination_config.json --catalog destination_catalog.json
2023-01-14 16:34:33 normalization > [FATAL tini (6)] exec /airbyte/entrypoint.sh failed: Exec format error
2023-01-14 16:34:33 INFO i.a.w.n.DefaultNormalizationRunner(close):189 - Terminating normalization process...
2023-01-14 16:34:33 ERROR i.a.w.g.DefaultNormalizationWorker(run):83 - Normalization failed for job 1.
io.airbyte.workers.exception.WorkerException: Normalization process did not terminate normally (exit code: 1)
	at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:200) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:81) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:34) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.40.28.jar:?]
source, destination, and normalization versions are:
Copy code
airbyte/source-postgres            1.0.34    c4194c9f52c9   4 weeks ago    640MB
airbyte/destination-snowflake      0.4.42    a1e9484f57f2   41 hours ago   1.41GB
airbyte/normalization-snowflake    0.2.25    7ddea81b7155   5 weeks ago    783MB
Running Airbyte version 0.40.28
r
do you find any other error message with "ERROR" tag in the log? usually related to json file parsing based on json schema you defined.
r
Copy code
2023-01-14 17:09:33 ERROR c.n.s.DateTimeValidator(tryParse):82 - Invalid date-time: No timezone information: 2016-01-01T00:00:00.000000
2023-01-14 17:09:33 ERROR 2023-01-14 17:09:33 ERROR c.n.s.DateTimeValidator(tryParse):82 - Invalid date-time: No timezone information: 2016-01-01T00:00:00.000000
2023-01-14 17:09:33 ERROR c.n.s.DateTimeValidator(tryParse):82 - Invalid date-time: No timezone information: 2016-01-01T00:00:00.000000
2023-01-14 17:09:33 ERROR c.n.s.DateTimeValidator(tryParse):82 - Invalid date-time: No timezone information: 2016-01-01T00:00:00.000000
2023-01-14 17:09:33 ERROR c.n.s.DateTimeValidator(tryParse):82 - Invalid date-time: No timezone information: 2016-01-01T00:00:00.000000
2023-01-14 17:09:33 ERROR c.n.s.DateTimeValidator(tryParse):82 - Invalid date-time: No timezone information: 2016-01-01T00:00:00.000000
2023-01-14 17:09:33 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):393 - Schema validation errors found for stream public_cardprograms. Error messages: [$.subbinstart is of an incorrect type. Expected it to be string, $.subbinend is of an incorrect type. Expected it to be string, $.config is of an incorrect type. Expected it to be string, $.created is of an incorrect type. Expected it to be date-time, $.name is of an incorrect type. Expected it to be string, $.memo is of an incorrect type. Expected it to be string, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string]
2023-01-14 17:09:54 ERROR i.a.w.g.DefaultNormalizationWorker(run):83 - Normalization failed for job 1.
2023-01-14 17:09:54 normalization > [FATAL tini (6)] exec /airbyte/entrypoint.sh failed: Exec format error
errors: $.method: must be a constant value Standard
errors: $.auth_type: must be a constant value OAuth2.0, $.auth_type: does not have a value in the enumeration [OAuth2.0], $.access_token: is missing but it is required, $.refresh_token: is missing but it is required
errors: $.auth_type: must be a constant value Key Pair Authentication, $.auth_type: does not have a value in the enumeration [Key Pair Authentication], $.private_key: is missing but it is required
errors: $.password: object found, string expected
errors: $.method: does not have a value in the enumeration [Standard]
u
Hello Rocky Appiah, it's been a while without an update from us. Are you still having problems or did you find a solution?
r
@Sajarin Dider I was never able to get it running on a gravitron2 (arm arch), reverted to using x86 type instance (i.e.: t3.large)