Hi team, a sync from a custom source (http) to an S3 destination cancelled itself. It was triggered by Airflow's

AirbyteTriggerSyncOperator

. The logs (see below for the entire log) do not contain any info wrt why it was cancelled or what cancelled it. The warnings about the JSON schema validation can be ignored as they appear during every sync (even the successful ones) and have nothing to do with the cancellation issue. I would greatly appreciate your help, since I cannot explain this (it happened twice yet).

Cancelled
NaN Bytes | no records | no records | 10s | Sync
Failure Origin: Unknown, Message: This attempt was cancelled
7:03AM 10/29
2022-10-29 05:03:47 - Additional Failure Information: Setting attempt to FAILED because the job was cancelled

2022-10-28 05:03:33 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-10-28 05:03:33 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.format_type: does not have a value in the enumeration [Avro], $.compression_codec: string found, object expected, $.compression_codec: should be valid to one and only one of the schemas 
2022-10-28 05:03:33 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword requires - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-10-28 05:03:33 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.flattening: is missing but it is required, $.format_type: does not have a value in the enumeration [CSV]
2022-10-28 05:03:33 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.format_type: does not have a value in the enumeration [JSONL]
2022-10-28 05:03:33 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-10-28 05:03:34 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/321/0/logs.log
2022-10-28 05:03:34 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.40.1
2022-10-28 05:03:34 INFO i.a.c.i.LineGobbler(voidCall):83 - Checking if <http://134983622818.dkr.ecr.eu-central-1.amazonaws.com/airbyte/source-<THESOURCE>:0.1.0|134983622818.dkr.ecr.eu-central-1.amazonaws.com/airbyte/source-<THESOURCE>:0.1.0> exists...
2022-10-28 05:03:34 INFO i.a.c.i.LineGobbler(voidCall):83 - <http://134983622818.dkr.ecr.eu-central-1.amazonaws.com/airbyte/source-<THESOURCE>:0.1.0|134983622818.dkr.ecr.eu-central-1.amazonaws.com/airbyte/source-<THESOURCE>:0.1.0> was found locally.
2022-10-28 05:03:34 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 321
2022-10-28 05:03:34 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/321/0 --log-driver none --name source-<THESOURCE>-check-321-0-furce --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -WORKER_CONNECTOR_IMAGE=<WORKER_CONNECTOR_IMAGE>.<http://amazonaws.com/airbyte/source-<THESOURCE>:0.1.0|amazonaws.com/airbyte/source-<THESOURCE>:0.1.0> -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.40.1 -e WORKER_JOB_ID=321 <WORKER_CONNECTOR_IMAGE>.<http://dkr.ecr.eu-central-1.amazonaws.com/airbyte/source-<THESOURCE>:0.1.0|dkr.ecr.eu-central-1.amazonaws.com/airbyte/source-<THESOURCE>:0.1.0> check --config source_config.json
2022-10-28 05:03:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - Check succeeded
2022-10-28 05:03:40 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling...
2022-10-28 05:03:40 INFO i.a.w.t.s.a.StreamResetActivityImpl(deleteStreamResetRecordsForJob):37 - deleteStreamResetRecordsForJob was called for job 321 with config type sync. Returning, as config type is not resetConnection.
2022-10-28 05:03:40 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.format_type: does not have a value in the enumeration [Avro], $.compression_codec: string found, object expected, $.compression_codec: should be valid to one and only one of the schemas 
2022-10-28 05:03:40 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed.

Hi Timo! I don't see anything in the logs that might be helpful, and since this is a custom connector it's a bit harder to debug. Do you have any logs from previous runs when the sync was successful or failed without the self cancellation?