Bow Bow
09/24/2024, 9:34 AMuser
09/24/2024, 9:34 AMrecord_filter
to the selector in the YAML file. The expression in the filter will be evaluated to a boolean returning true if the record should be included. Here is an example where all records with a created_at
field greater than the stream slice's start_time
will be filtered out: yaml selector: extractor: field_path: [] record_filter: condition: "{{ record['created_at'] < stream_slice['start_time'] }}"
[source](https://docs.airbyte.com/connector-development/config-based/understanding-the-yaml-file/record-selector#filtering-records) For more complex filtering, you might need to perform the filtering on the destination side after the data has been replicated.