Hi I`ve built a new source and followed step by step with th Airbyte #replication-troubleshooting

Hi. I`ve built a new source and followed step by ...

Eli Sigal

08/14/2022, 11:12 AM

Hi. I`ve built a new source and followed step by step with this video :

https://www.youtube.com/watch?v=kJ3hLoNfz_E▾

and this doc: https://docs.airbyte.com/connector-development/tutorials/cdk-speedrun/ As described in the video and docs - I`ve passed all the tests and ran the docker build command and when I go to the UI to try to add the new connector I`m getting this error:

Internal Server Error: Get Spec job failed.

I`m not sure why I`m getting this error since I`ve passed all the tests i.e. the check, discover and read. These are the test commands:

py -m main check --config sample_files/config.json

py -m main discover --config sample_files/config.json

py -m  main read --config sample_files/config.json --catalog sample_files/configured_catalog.json

This is the build command:

docker build . -t airbyte/source-my-new-source:dev

What am I missing? Thank you.

Eli Sigal

08/15/2022, 7:40 PM

For future reference - found a solution. Used docker logs container_name (the airbyte server) for the logs -saw it says no module x found so went to setup.py and fixed the requirements in that file. Added in

airbyte-config\init\src\main\resources\seed\source_definitions.yaml

logic for the image i.e.

MAIN_REQUIREMENTS

also in

airbyte-config\init\src\main\resources\seed\source_specs.yaml

added the logic needed for the UI for the image also made sure that Dockerfile is the same logic as other connectors and built on top of that the docs nor the video are correct for python source

Open in Slack

Previous Next