Hi Everyone, I am trying to use airflow as my airbyte etl orchestrator but I am having challenges with it.
Things I have done:
-I have installed airflow and airbyte in docker containers and they are running and I can access them via their UI
-I have setup source to destination connection in airbyte.
-I have installed the airbyte operator for airflow using: pip install apache-airflow-providers-airbyte
-I have also configured the connection in airflow and put my .py file in the Dags folder using the guide here:https://github.com/airbytehq/airbyte/tree/master/resources/examples/airflow
The challenge I am having is that my dag shows import errors and the error was : ModuleNotFoundError: No module named 'airflow.providers.airbyte'
How can I fix this?
08/18/2021, 1:52 PM
maybe the import is not OK, we use
from airflow.providers.airbyte.operators.airbyte import AirbyteTriggerSyncOperator