Another question for the team : I am synchronizing a Sql Server db and some of source tables are massive is there a way to set a permanent filter to off set history. Basically a 50 000 000 row table where only records from 2021 ( 5 000 000 are usefull). I d like to have a static filter like ModifiedAt >= 2021 Also ModifiedAt is my curose_field so I imagine there is a way to override the value used by airbyte to go incremental ?

Could you not just create a view and sync that instead then?

unfortunately I have only read access on source db (third party)

+1 I too have similar use-case

If you're doing incremental append you could probably get away with just deleting the older data after it's first sync. Theres no way to alter the select statement currently that I'm aware of.

Problem is with first sync only. 😅

yes I really believe this feature is needed. It may be an additionnal field where you ste up your incremental field. Othere use case using same feature : build an dev connector with a really small set of data