Nguyen Dao (Bach)
10/28/2023, 2:35 PMkapa.ai
10/28/2023, 2:36 PMConnections page. Airflow will use the Airbyte API to execute our actions. The Airbyte API uses HTTP, so you'll need to create a HTTP Connection. Airbyte is typically hosted at localhost:8001. Configure Airflow's HTTP connection accordingly. Don't forget to click save! [source](https://docs.airbyte.com/operator-guides/using-the-airflow-airbyte-operator) 2. Retrieve the Airbyte Connection ID: This ID can be seen in the URL on the connection page in the Airbyte UI. The Airbyte UI can be accessed at localhost:8000. [source](https://docs.airbyte.com/operator-guides/using-the-airflow-airbyte-operator) 3. Create a DAG in Apache Airflow to trigger your Airbyte job: You can create a simple Airflow DAG to run an Airbyte Sync Job. Here is an example of how to do it: python from airflow import DAG from airflow.utils.dates import days_ago from airflow.providers.airbyte.operators.airbyte import AirbyteTriggerSyncOperator with DAG(dag_id='trigger_airbyte_job_example', default_args={'owner': 'airflow'}, schedule_interval='@daily', start_date=days_ago(1) ) as dag: money_to_json = AirbyteTriggerSyncOperator( task_id='airbyte_money_json_example', airbyte_conn_id='airbyte_conn_example', connection_id='1e3b5a72-7bfd-4808-a13c-204505490110', asynchronous=False, timeout=3600, wait_seconds=3 ) [source](https://docs.airbyte.com/operator-guides/using-the-airflow-airbyte-operator) 4. Monitor the Job Status: You can monitor the job status by checking the Airbyte UI's Sync History tab to see if the job started syncing! [source](https://docs.airbyte.com/operator-guides/using-the-airflow-airbyte-operator) Please note that the Airbyte operator is designed to work with the internal Config API rather than the newer Airbyte API and is therefore not intended or designed for orchestrating Airbyte Cloud. [source](https://docs.airbyte.com/operator-guides/using-the-airflow-airbyte-operator)Nguyen Dao (Bach)
10/28/2023, 2:37 PMkapa.ai
10/28/2023, 2:37 PM