When using the airbyte operator for airflow, when ...
# ask-ai
d
When using the airbyte operator for airflow, when I run the DAG I get the following error: requests.exceptions.MissingSchema: Invalid URL 'localhost/jobs': No scheme supplied. Perhaps you meant https://localhost/jobs? During handling of the above exception, another exception occurred:
u
The error message suggests that the URL you're using to connect to the Airbyte API is missing a scheme, which is the
http://
or
https://
part of the URL. In the context of Airbyte and Airflow, you need to set up an Airbyte connection in Apache Airflow. This connection should point to the Airbyte API, which typically runs on
<http://localhost:8001>
for a local setup. Here's how you can do it: 1. Once Airflow starts, navigate to Airflow's
Connections
page. The Airflow UI can be accessed at
<http://localhost:8080/>
. 2. Airflow will use the Airbyte API to execute actions. The Airbyte API uses HTTP, so you'll need to create an HTTP Connection. Airbyte is typically hosted at
localhost:8001
. Configure Airflow's HTTP connection accordingly. Please ensure that you're using the correct URL with the
http://
scheme when setting up the connection in Airflow. For example, use
<http://localhost:8001>
instead of just
localhost
. If you're using a remote instance of Airbyte, replace
localhost:8001
with the URL of your Airbyte instance. For more details, you can refer to the [Airbyte documentation on using the Airflow Airbyte operator](https://docs.airbyte.com/operator-guides/using-the-airflow-airbyte-operator#2-create-a-dag-in-apache-airflow-to-trigger-your-airbyte-job).