Hey I am trying to build a custom connector I have followed Airbyte #ask-community-for-troubleshooting

Hey, - I am trying to build a custom connector. I ...

BASTIN JERRY

09/15/2022, 10:51 AM

Hey, • I am trying to build a custom connector. I have followed the steps and built a source http connector using pokemon api • When I tried to get the response from an api I got this error

{"type": "LOG", "log": {"level": "FATAL", "message": "1 validation error for ConfiguredAirbyteCatalog\nstreams\n  field required (type=value_error.missing)

• I did not change anything in the

configured_catalog.json

that I downloaded from the documentation any idea how to resolve this?

Sunny Hashmi (Airbyte)

09/15/2022, 5:30 PM

Hmm, I haven't tested yet but it is always possible that something in the api response has changed. The way to troubleshoot this would be to run the

discover

function, which will pull the schema from the source itself using your config. The structure of the configured catalog needs to be compatible with that schema, and if there are changes then the configured catalog needs to be adjusted

Sunny Hashmi (Airbyte)

09/15/2022, 5:37 PM

I wonder if the config you are passing in contains the

pokemon_name

object?

BASTIN JERRY

09/16/2022, 6:36 AM

Hi @Sunny Hashmi (Airbyte), Yes, I am passing the pokemon_name from

configured_catalog.json

file.

streams->streaam->json_schema->properties->pokemon_name

this is the json path in the file ( i just downloaded the

configured_catalog.json

from the airbyte official http connector documentation as i just started learning it )

BASTIN JERRY

09/16/2022, 7:09 AM

@Sunny Hashmi (Airbyte) this is discover function's output

Copy code

{
  "type": "CATALOG",
  "catalog": {
    "streams": [
      {
        "name": "pokemon",
        "json_schema": {
          "$schema": "<http://json-schema.org/draft-07/schema#>",
          "type": "object",
          "properties": {
            "id": {
              "type": [
                "null",
                "integer"
              ]
            },
            "abilities": {
              "type": [
                "null",
                "array"
              ],
              "items": {
                "type": [
                  "null",
                  "object"
                ],
                "properties": {
                  "is_hidden": {
                    "type": [
                      "null",
                      "boolean"
                    ]
                  },
                  "slot": {
                    "type": [
                      "null",
                      "integer"
                    ]
                  },
                  "ability": {
                    "type": [
                      "null",
                      "object"
                    ],
                    "properties": {
                      "name": {
                        "type": [
                          "null",
                          "string"
                        ]
                      },
                      "url": {
                        "type": [
                          "null",
                          "string"
                        ]
                      }
                    }
                  }
                }
              }
            },
            "forms": {
              "type": [
                "null",
                "array"
              ],
              "items": {
                "type": [
                  "null",
                  "object"
                ],
                "properties": {
                  "name": {
                    "type": [
                      "null",
                      "string"
                    ]
                  },
                  "url": {
                    "type": [
                      "null",
                      "string"
                    ]
                  }
                }
              }
            },
            "game_indices": {
              "type": [
                "null",
                "array"
              ],
              "items": {
                "type": [
                  "null",
                  "object"
                ],
                "properties": {
                  "game_index": {
                    "type": [
                      "null",
                      "integer"
                    ]
                  },
                  "version": {
                    "type": [
                      "null",
                      "object"
                    ],
                    "properties": {
                      "name": {
                        "type": [
                          "null",
                          "string"
                        ]
                      },
                      "url": {
                        "type": [
                          "null",
                          "string"
                        ]
                      }
                    }
                  }
                }
              }
            },
            "held_items": {
              "type": [
                "null",
                "array"
              ],
              "items": {
                "type": [
                  "null",
                  "object"
                ],
                "properties": {
                  "item": {
                    "type": [
                      "null",
                      "object"
                    ],
                    "properties": {
                      "name": {
                        "type": [
                          "null",
                          "string"
                        ]
                      },
                      "url": {
                        "type": [
                          "null",
                          "string"
                        ]
                      }
                    }
                  },
                  "version_details": {
                    "type": [
                      "null",
                      "array"
                    ],
                    "items": {
                      "type": [
                        "null",
                        "object"
                      ],
                      "properties": {
                        "version": {
                          "type": [
                            "null",
                            "object"
                          ],
                          "properties": {
                            "name": {
                              "type": [
                                "null",
                                "string"
                              ]
                            },
                            "url": {
                              "type": [
                                "null",
                                "string"
                              ]
                            }
                          }
                        },
                        "rarity": {
                          "type": [
                            "null",
                            "string"
                          ]
                        }
                      }
                    }
                  }
                }
              }
            },
            "location_area_encounters": {
              "type": [
                "null",
                "string"
              ]
            },
            "moves": {
              "type": [
                "null",
                "array"
              ],
              "items": {
                "type": [
                  "null",
                  "object"
                ],
                "properties": {
                  "move": {
                    "type": [
                      "null",
                      "object"
                    ],
                    "properties": {
                      "name": {
                        "type": [
                          "null",
                          "string"
                        ]
                      },
                      "url": {
                        "type": [
                          "null",
                          "string"
                        ]
                      }
                    }
                  },
                  "version_group_details": {
                    "type": [
                      "null",
                      "array"
                    ],
                    "items": {
                      "type": [
                        "null",
                        "object"
                      ],
                      "properties": {
                        "move_learn_method": {
                          "type": [
                            "null",
                            "object"
                          ],
                          "properties": {
                            "name": {
                              "type": [
                                "null",
                                "string"
                              ]
                            },
                            "url": {
                              "type": [
                                "null",
                                "string"
                              ]
                            }
                          }
                        },
                        "version_group": {
                          "type": [
                            "null",
                            "object"
                          ],
                          "properties": {
                            "name": {
                              "type": [
                                "null",
                                "string"
                              ]
                            },
                            "url": {
                              "type": [
                                "null",
                                "string"
                              ]
                            }
                          }
                        },
                        "level_learned_at": {
                          "type": [
                            "null",
                            "integer"
                          ]
                        }
                      }
                    }
                  }
                }
              }
            },
            "sprites": {
              "type": [
                "null",
                "object"
              ],
              "properties": {
                "front_default": {
                  "type": [
                    "null",
                    "string"
                  ]
                },
                "front_shiny": {
                  "type": [
                    "null",
                    "string"
                  ]
                },
                "front_female": {
                  "type": [
                    "null",
                    "string"
                  ]
                },
                "front_shiny_female": {
                  "type": [
                    "null",
                    "string"
                  ]
                },
                "back_default": {
                  "type": [
                    "null",
                    "string"
                  ]
                },
                "back_shiny": {
                  "type": [
                    "null",
                    "string"
                  ]
                },
                "back_female": {
                  "type": [
                    "null",
                    "string"
                  ]
                },
                "back_shiny_female": {
                  "type": [
                    "null",
                    "string"
                  ]
                }
              }
            },
            "species": {
              "type": [
                "null",
                "object"
              ],
              "properties": {
                "name": {
                  "type": [
                    "null",
                    "string"
                  ]
                },
                "url": {
                  "type": [
                    "null",
                    "string"
                  ]
                }
              }
            },
            "stats": {
              "type": [
                "null",
                "array"
              ],
              "items": {
                "type": [
                  "null",
                  "object"
                ],
                "properties": {
                  "stat": {
                    "type": [
                      "null",
                      "object"
                    ],
                    "properties": {
                      "name": {
                        "type": [
                          "null",
                          "string"
                        ]
                      },
                      "url": {
                        "type": [
                          "null",
                          "string"
                        ]
                      }
                    }
                  },
                  "effort": {
                    "type": [
                      "null",
                      "integer"
                    ]
                  },
                  "base_stat": {
                    "type": [
                      "null",
                      "integer"
                    ]
                  }
                }
              }
            },
            "types": {
              "type": [
                "null",
                "array"
              ],
              "items": {
                "type": [
                  "null",
                  "object"
                ],
                "properties": {
                  "slot": {
                    "type": [
                      "null",
                      "integer"
                    ]
                  },
                  "type": {
                    "type": [
                      "null",
                      "object"
                    ],
                    "properties": {
                      "name": {
                        "type": [
                          "null",
                          "string"
                        ]
                      },
                      "url": {
                        "type": [
                          "null",
                          "string"
                        ]
                      }
                    }
                  }
                }
              }
            }
          }
        },
        "supported_sync_modes": [
          "full_refresh"
        ]
      }
    ]
  }
}

this is my

configured_catalog.json

Copy code

{
  "streams": [
    {
      "stream": {
        "name": "pokemon",
        "json_schema": {
          "$schema": "<http://json-schema.org/draft-04/schema#>",
          "type": "object",
          "properties": {
            "pokemon_name": {
              "type": "string"
            }
          }
        },
        "supported_sync_modes": [
          "full_refresh"
        ]
      },
      "sync_mode": "full_refresh",
      "destination_sync_mode": "overwrite"
    }
  ]
}

2 Views

Open in Slack

Previous Next