Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

Hi everyone,
I am new to Airbyte, our team is looking to use airbyte for different sources - ranging from http api (web scraped website) to websites containing datasets like kaggle etc. we are looking to create custom connectors for these sources. I am looking for some guide on how to get started with this resources.
More details in :thread:

I have implemented the custom connector for a sample api using below guide.
<https://docs.airbyte.com/connector-development/tutorials/cdk-tutorial-python-http/creating-the-source>

I need to look at other ways of
1. getting data from a website (scrapped into my destination) using custom connector.
2. getting data from kaggle or equivalent data source using custom connector.
please let me know how to achieve above tasks.