https://linen.dev logo
Join Slack
Powered by
Hey folks - very new to airbyte, and to be honest,...
# help-connector-development
g
Hey folks - very new to airbyte, and to be honest, not much of a python or java guy either. So forgive me for any stupid thing in advance. Also I just opened this: https://github.com/airbytehq/airbyte/issues/25738 - no pressing reason for writing this connector myself, but definitely willing to help! Here's the issue:
k
A message from kapa.ai
Hello! I appreciate your willingness to help with the connector development. Based on the information extracts provided, I can't see the specific issue you're referring to. However, I can give you some general guidance on how to contribute to Airbyte and build connectors. First, you can check out the [contributing guide on building connectors](https://docs.airbyte.com/contributing-to-airbyte/) to get an idea of the process. Airbyte connectors can be written in any language, as they are encapsulated within Docker containers. For sources, you can refer to the [Python CDK](https://docs.airbyte.com/connector-development/cdk-python/) for guidance. To create a connector from a template, you can follow these steps: 1. Run the interactive generator:
Copy code
cd airbyte-integrations/connector-templates/generator      ./generate.sh
2. Choose the relevant template using the arrow keys. This will generate a new connector in the 
airbyte-integrations/connectors/<your-connector>
directory. 3. Search the generated directory for "TODO"s and follow them to implement your connector. You can also follow the relevant tutorial from the list provided in the [connector development documentation](https://docs.airbyte.com/connector-development/). When you're ready to submit your connector to Airbyte, you can follow the [Submitting a Source to Airbyte checklist](https://docs.airbyte.com/connector-development/tutorials/building-a-python-source#submitting-a-source-to-airbyte). If you need help with any step of the process, feel free to submit a PR with your progress and any questions you have. You can also ask questions on the [Airbyte community Slack channel](https://slack.airbyte.io). Good luck with your connector development, and thank you for contributing to Airbyte!
g
I am trying to test my code by issuing
Copy code
cat integration_tests/messages.jsonl | docker run --rm -v $(pwd)/secrets:/secrets -v $(pwd)/integration_tests:/integration_tests airbyte/destination-turso:dev write --config /secrets/config.json --catalog /integration_tests/configured_catalog.json
as suggested by the README. But inside the 
write
function, messages are always empty. I have the following file with messages that I just copied from SQLite
Copy code
{"type": "RECORD", "record": {"stream": "airbyte_acceptance_table", "data": {"column1": "my_value", "column2": 221, "column3": "2021-01-01T20:10:22", "column4": 1.214, "column5": [1,2,3]}, "emitted_at": 1626172757000}}
{"type": "RECORD", "record": {"stream": "airbyte_acceptance_table", "data": {"column1": "my_value2", "column2": 222, "column3": "2021-01-02T22:10:22", "column5": [1,2,null]}, "emitted_at": 1626172757000}}
(fwiw, got this to work now by calling python directly instead of docker)
Open in Slack
PreviousNext
Powered by