Hey All! Getting the following error on a custom ...
# replication-troubleshooting
p
Hey All! Getting the following error on a custom low-code connector when trying to add it as a source:
ISO8601Error("Unable to parse duration string '1d'")
, which is strange. Previously, in the tutorial this was the value shown as an example, but now it looks like it's
P1D
for both step and cursor granularity. If I try and use those locally, I get a different error:
Something went wrong in the connector. See the logs for more details...line 190, in _parse_timedelta\n  assert parts is not None\nAssertionError\n.
Can anyone provide a bit of guidance on what the step and cursor_granularity should actually be here? Coming from the stream slicer section in the yaml file:
Copy code
stream_slicer:
      type: "DatetimeStreamSlicer"
      start_datetime:
        datetime: "{{ config['start_date'] }}"
        datetime_format: "%Y-%m-%d"
      end_datetime:
        datetime: "{{ now_utc() }}"
        datetime_format: "%Y-%m-%d %H:%M:%S.%f+00:00"
      step: "1d"
      datetime_format: "%Y-%m-%d"
      cursor_field: "{{ options['stream_cursor_field'] }}"
      cursor_granularity: "day"
    $options:
      name: "austin_permits"
      primary_key: "permit_number"
      path: "/3syk-w9eu.json?$where=issue_date>='{{config['start_date'] or 'latest'}}'"
      cursor_field: "issue_date"
s
Hi, I had a discussion with the airbyte support two weeks ago about the same topic. Hope that helps https://airbytehq.slack.com/archives/C03UEMGGEGZ/p1673278450686539
p
@Sebastian Brickel ah you are a lifesaver! thanks - just picking this up again and running into the same thing
s
I hope you it helps you solving your problem!
p
unfortunately, throws errors locally when I use
P1D
: (
did you have to upgrade anything?
s
Your airbyte version needs to be updated
p
got it, makes sense - thank you!
s
Good luck octavia muscle