@kapa.ai I'm using this condition {{ record["updated_at"]["$date"] >= stream_interval["start_time"] }} in record filter in rest_api creation , what should be the format so that this can be valid

Record Filter

conditions must be written as an interpolated string using Airbyte’s expression syntax, inside double curly braces

{{ }}

. Inside, you can use Python‑like expressions and the provided context variables (

record

,

stream_interval

, etc.). [[RecordFilter ref](https://docs.airbyte.com/platform/connector-development/config-based/understanding-the-yaml-file/reference#/definitions/RecordFilter); [Record filter UI](https://docs.airbyte.com/platform/connector-development/connector-builder-ui/record-processing#record-filter)] Your expression:

jinja {{ record["updated_at"]["$date"] >= stream_interval["start_time"] }}

is already in the correct syntactic format for a Record Filter, assuming: - Each record has a nested value like

{"updated_at": {"$date": "..."}}

-

stream_interval["start_time"]

is comparable (same type: both strings in the same datetime format, or both numeric timestamps, etc.) If you’re getting an error, the problem is usually type/format, not the expression syntax itself. Airbyte’s docs do not specify automatic parsing for complex/nested date formats inside filters; they only show examples where the compared values are already in a directly comparable format (e.g. flat

record['created_at']

vs

stream_interval['start_time']

). [[RecordFilter ref](https://docs.airbyte.com/platform/connector-development/config-based/understanding-the-yaml-file/reference#/definitions/RecordFilter)] Given the available documentation, there is no explicit support described for applying custom datetime parsing inside the Record Filter expression itself. If

record["updated_at"]["$date"]

is not already the same string format as

stream_interval["start_time"]

, you would need to normalize the cursor field earlier (e.g., via transformations / moving or reformatting the field) so that:

jinja {{ record["updated_at"] >= stream_interval["start_time"] }}

compares two compatible values. So, from the docs: - Your overall format

{{ ... }}

is correct. - The inner expression must evaluate to a boolean and use only the provided variables. - The docs do not describe a way to specify a datetime format for this filter; you must ensure the actual field values are already comparable.

This is current format, should this work?

A message from kapa.ai