Hi, I'm looking at airbyte in order to load some data from a third party bigquery warehouse and transform it for our use since I am unable to do this inside of the bigquery instance. Is it possible to set up a connection so that it only extracts data that is later than a specified key, for example only extracting data from 2021-01-01, but ongoing as new data gets added?

Hi @Alistair Wright, no this is not possible out of the box with Airbyte. We usually suggest users to create a view from the table they want to replicate that only has the data they want to replicate. In your case you could create a view on BigQuery from your source table which is only listing data after 2021-01-01.

Which would require access to BigQuery - I do like this solution, I just need to see if I can convince the third party to allow me to create views or do so for me. Thank you.