Hello there! I am trying to add to my custom sourc...
# replication-troubleshooting
a
Hello there! I am trying to add to my custom source (HTTP API source) support for different sync_modes but get kind of lost for where to configure this I tried per stream in my
configured_catalog.json
with following syntax
Copy code
{
    "streams": [
        {
            "stream": {
                "name": "items",
                "supported_sync_modes": ["full_refresh", "incremental"],
                "default_cursor_field": ["id"],
                "source_defined_cursor": true,
                "json_schema": {...}
            },
            "sync_mode": "incremental",
            "destination_sync_mode": "overwrite",
            "cursor_field": ["id"],
            "primary_key": [["id"]]
        }]
}
This did not change anything if the sync options I try after that to add to my
spec.yaml
following
Copy code
supported_sync_modes:
  - overwrite
  - append
  - append_dedup
connectionSpecification:
Non of that helped. How can I configure what supported_sync_modes are available for my source, that I can choose from the UI
e
Hi. great stuff. did you try to pass it to the streams read_records? for example: bla bla in read_records(SyncMode.full_refresh):
a
no
let me take a look, I never thought that I need explicitly to provide this via the SyncMode
I was thinking as long as the iterator find my cursor field would work base on the catalog
having this
"default_cursor_field": ["id"],
and
"cursor_field": ["id"],
and
"primary_key": [["id"]]
e
it seems that you've created the functionality though didnt implement it
👍 1