Hi! I'm trying to follow this tutorial for automating my data scraping (
https://airbyte.com/tutorials/data-scraping-with-airflow-and-beautiful-soup). Everything is working fine until the actual implementation of the dag.
First, the provided python code doesn't actually compile (after substituting the required variables in the code). However, once I get the python code to compile, Airflow doesn't actually pick up on my new dag on the webserver (after I restarted the webserver and scheduler). I've been really struggling to get the new dag on airflow. The connection on airbyte seems to be up and running fine though. Any help would be greatly appreciated!