Hi everyone, I’m getting this error whilst using the athena recipe with airflow:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/airflow/models/taskinstance.py", line 984, in _run_raw_task
    result = task_copy.execute(context=context)
  File "/usr/local/lib/python3.6/site-packages/airflow/operators/python_operator.py", line 113, in execute
    return_value = self.execute_callable()
  File "/usr/local/lib/python3.6/site-packages/airflow/operators/python_operator.py", line 118, in execute_callable
    return self.python_callable(*self.op_args, **self.op_kwargs)
  File "/usr/local/airflow/dags/datahub_ingestion_athena.py", line 50, in ingest_from_athena
    pipeline.run()
  File "/usr/local/lib/python3.6/site-packages/datahub/ingestion/run/pipeline.py", line 108, in run
    for wu in self.source.get_workunits():
  File "/usr/local/lib/python3.6/site-packages/datahub/ingestion/source/sql_common.py", line 283, in get_workunits
    yield from self.loop_views(inspector, schema, sql_config)
  File "/usr/local/lib/python3.6/site-packages/datahub/ingestion/source/sql_common.py", line 344, in loop_views
    for view in inspector.get_view_names(schema):
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/reflection.py", line 326, in get_view_names
    self.bind, schema, info_cache=self.info_cache
  File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/interfaces.py", line 345, in get_view_names
    raise NotImplementedError()
NotImplementedError

Seems view ingestion is not implemented for athena. Could you disable view ingestion in your recipe or config?

yep, thanks that seems to work

Yep - added this PR to clarify the docs https://github.com/linkedin/datahub/pull/2924

I’ve not looked at the code, but could that be added as a default for Athena?