Rutger Weemhoff
05/01/2023, 12:38 PM{{ last_records[-1]['id'] }}
. Now I would like to use the actual cursor value in a custom Request Body parameter with key "query".
The value of this request body parameter would be something like:
select id, ..., ... from table where id > {{ cursor_value }} order by id
I am not sure in which variable the actual cursor value would be stored or how I can find out. Can you please point me in the right direction?
For incremental syncs I am already using {{ stream_slice['start_date'] }}
and {{ stream_slice['end_date'] }}
succesfully in the same way.kapa.ai
05/01/2023, 12:38 PMkapa.ai
05/01/2023, 12:38 PMCursorPagination
, the cursor value is output by evaluating its cursor_value
string with the following parameters: - `response`: The decoded response - `headers`: HTTP headers on the response - `last_records`: List of records selected from the last response This cursor value can be used to request the next page of records [source](https://docs.airbyte.com/connector-development/config-based/understanding-the-yaml-file/pagination). For more information on pagination and incremental syncs, you can refer to the following documentation: - [Pagination](https://docs.airbyte.com/connector-development/config-based/understanding-the-yaml-file/pagination) - [Incremental Syncs](https://docs.airbyte.com/connector-development/config-based/understanding-the-yaml-file/incremental-syncs)Rutger Weemhoff
05/01/2023, 1:31 PM{{ next_page_token['next_page_token'] }}
It's working with:
select * from table where id > {{ next_page_token['next_page_token'] or 0 }} order by id
Source: https://docs.airbyte.com/connector-development/config-based/understanding-the-yaml-file/reference/#/variables/next_page_token