Hello I m starting my journey with Airbyte devopment a pipel Airbyte #replication-troubleshooting

Hello! I'm starting my journey with Airbyte devopm...

Paulo Singaretti

11/15/2022, 4:02 PM

Hello! I'm starting my journey with Airbyte devopment a pipeline to collect data from Postgres(CDC) that sends to Kafka and then send these data to S3 or Kinesis, but I'm facing errors in any of these destinations I choose: S3:

Copy code

ERROR i.a.i.b.AirbyteExceptionHandler(uncaughtException):26 - Something went wrong in the connector. See the logs for more details.
2022-11-15 15:59:03 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):78 - java.lang.ArrayIndexOutOfBoundsException: Index 1 out of bounds for length 1

Kinesis:

Copy code

ERROR i.a.i.b.AirbyteExceptionHandler(uncaughtException):26 - Something went wrong in the connector. See the logs for more details.
2022-11-15 15:59:41 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):78 - java.lang.ArrayIndexOutOfBoundsException: Index 1 out of bounds for length 1

Do you guys have any idea what I'm doing wrong? I guess it's something in Kafka due to same error.

Paulo Singaretti

11/15/2022, 4:17 PM

This is an example of message in kafka topic I'm trying to work:

Copy code

{
  "_airbyte_ab_id": "2e444ed0-06a5-4337-b33e-40d19f3ff980",
  "_airbyte_stream": "ab_streaming_table",
  "_airbyte_emitted_at": 1668489305557,
  "_airbyte_data": {
    "id": 10985,
    "blah": null,
    "_ab_cdc_updated_at": "2022-11-15T05:15:02.262Z",
    "_ab_cdc_lsn": 423314336320,
    "_ab_cdc_deleted_at": null
  }
}

Paulo Singaretti

11/15/2022, 11:04 PM

Airbyte version: 0.40.18

user

12/06/2022, 8:25 PM

Hello Paulo Singaretti, it's been a while without an update from us. Are you still having problems or did you find a solution?

25 Views

Open in Slack

Previous Next