Hi all I m running into an issue setting up a connection usi Airbyte #ask-community-for-troubleshooting

Hi all, I’m running into an issue setting up a con...

Ben Pankow

10/06/2022, 9:46 PM

Hi all, I’m running into an issue setting up a connection using Mixpanel. While I can create a Source ok, it appears that fetching the schema causes an error, because some of the

default_cursor_field

values are unexpectedly `null`:

Copy code

2022-10-06 21:38:31 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed.
errors: $.catalog.streams[4].default_cursor_field: null found, array expected, $.catalog.streams[5].default_cursor_field: null found, array expected
Log4j2Appender says: JSON schema validation failed.
errors: $.catalog.streams[4].default_cursor_field: null found, array expected, $.catalog.streams[5].default_cursor_field: null found, array expected

(more info in thread)

✍️ 1

Ben Pankow

10/06/2022, 9:47 PM

The returned schema entry in question:

Copy code

{
  "name": "engage",
  "json_schema": {
    "$schema": "<http://json-schema.org/draft-07/schema#>",
    "type": "object",
    "properties": {
        ...
    },
    "additionalProperties": false
  },
  "supported_sync_modes": [
    "full_refresh",
    "incremental"
  ],
  "source_defined_cursor": false,
  "default_cursor_field": null,
  "source_defined_primary_key": [
    [
      "distinct_id"
    ]
  ]
}

Ben Pankow

10/06/2022, 9:50 PM

I initially set up using the “Project Secret” option, switching to a Service Account didn’t fix unfortunately

Ben Pankow

10/06/2022, 9:52 PM

I’m using connector version

0.1.27

, will try downgrading to

0.1.25

since this looks like it might be related:

0.1.26 2022-09-28 17304 Migrate to per-stream states.

Ben Pankow

10/06/2022, 10:23 PM

Looks like

0.1.25

ends up hitting the same issue

Ben Pankow

10/06/2022, 10:27 PM

Seems like the two fields which don’t have cursors are

engage

and

cohort_members

Ben Pankow

10/06/2022, 10:29 PM

Looks like https://github.com/airbytehq/airbyte/issues/17373

user

10/06/2022, 10:57 PM

@[DEPRECATED] Marcos Marx turned this thread into Zendesk ticket 2632 to ensure timely resolution!

Marcos Marx (Airbyte)

10/06/2022, 11:00 PM

PR is in progress: https://github.com/airbytehq/airbyte/pull/17699

🙏 1

Ben Pankow

10/06/2022, 11:11 PM

great, thank you!

Ben Pankow

10/06/2022, 11:15 PM

@Marcos Marx (Airbyte) For what it’s worth, it looks like

cohort_members

might also. have a

null

cursor field

Ben Pankow

10/06/2022, 11:16 PM

Copy code

{
    "name": "cohort_members",
    "json_schema": {
        "$schema": "<http://json-schema.org/draft-07/schema#>",
        "type": "object",
        "properties": {
    ...
        },
        "additionalProperties": false
    },
    "supported_sync_modes": [
        "full_refresh",
        "incremental"
    ],
    "source_defined_cursor": false,
    "default_cursor_field": null,
    "source_defined_primary_key": [
        [
        "distinct_id"
        ]
    ]
}

Ben Pankow

10/07/2022, 5:06 PM

The new connector version has fixed this issue for me. Thanks for the fast fix!

49 Views

Open in Slack

Previous Next