https://datahubproject.io logo
Join Slack
Powered by
Hey, I am running `v0.10.0` and was trying to figu...
# troubleshoot
b
Hey, I am running 
v0.10.0
and was trying to figure if I can do an advanced filter with an expression like 
Domain = null
? Can't figure this out in the UI, maybe I am missing something?
I see you can do a 
not equal
expression type and list all the domains, but that's a bit tedious.
Just noticed that I am using 
acryl-datahub['looker']==0.10.0.5
- not sure if that's the issue though
Nope, same happens with 
0.10.0.0
as well
As far as I understand from the stack trace Looker source is now depending on Lookml source:
Copy code
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/datahub/entrypoints.py", line 175, in main
    sys.exit(datahub(standalone_mode=False, **kwargs))
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/datahub/telemetry/telemetry.py", line 379, in wrapper
    raise e
  File "/usr/local/lib/python3.9/site-packages/datahub/telemetry/telemetry.py", line 334, in wrapper
    res = func(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/datahub/utilities/memory_leak_detector.py", line 95, in wrapper
    return func(ctx, *args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/datahub/cli/ingest_cli.py", line 197, in run
    loop.run_until_complete(run_func_check_upgrade(pipeline))
  File "/usr/local/lib/python3.9/asyncio/base_events.py", line 647, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.9/site-packages/datahub/cli/ingest_cli.py", line 158, in run_func_check_upgrade
    ret = await the_one_future
  File "/usr/local/lib/python3.9/site-packages/datahub/cli/ingest_cli.py", line 149, in run_pipeline_async
    return await loop.run_in_executor(
  File "/usr/local/lib/python3.9/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.9/site-packages/datahub/cli/ingest_cli.py", line 140, in run_pipeline_to_completion
    raise e
  File "/usr/local/lib/python3.9/site-packages/datahub/cli/ingest_cli.py", line 132, in run_pipeline_to_completion
    pipeline.run()
  File "/usr/local/lib/python3.9/site-packages/datahub/ingestion/run/pipeline.py", line 339, in run
    for wu in itertools.islice(
  File "/usr/local/lib/python3.9/site-packages/datahub/utilities/source_helpers.py", line 85, in auto_stale_entity_removal
    for wu in stream:
  File "/usr/local/lib/python3.9/site-packages/datahub/utilities/source_helpers.py", line 36, in auto_status_aspect
    for wu in stream:
  File "/usr/local/lib/python3.9/site-packages/datahub/ingestion/source/looker/looker_source.py", line 1278, in get_workunits_internal
    ) = job.result()
  File "/usr/local/lib/python3.9/concurrent/futures/_base.py", line 439, in result
    return self.__get_result()
  File "/usr/local/lib/python3.9/concurrent/futures/_base.py", line 391, in __get_result
    raise self._exception
  File "/usr/local/lib/python3.9/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.9/site-packages/datahub/ingestion/source/looker/looker_source.py", line 1158, in process_dashboard
    metric_dim_workunits = self.process_metrics_dimensions_and_fields_for_dashboard(
  File "/usr/local/lib/python3.9/site-packages/datahub/ingestion/source/looker/looker_source.py", line 989, in process_metrics_dimensions_and_fields_for_dashboard
    chart_mcps = [
  File "/usr/local/lib/python3.9/site-packages/datahub/ingestion/source/looker/looker_source.py", line 990, in <listcomp>
    self._make_metrics_dimensions_chart_mcp(element, dashboard)
  File "/usr/local/lib/python3.9/site-packages/datahub/ingestion/source/looker/looker_source.py", line 1097, in _make_metrics_dimensions_chart_mcp
    fields=self._input_fields_from_dashboard_element(dashboard_element)
  File "/usr/local/lib/python3.9/site-packages/datahub/ingestion/source/looker/looker_source.py", line 1028, in _input_fields_from_dashboard_element
    explore = self.explore_registry.get_explore(
  File "/usr/local/lib/python3.9/site-packages/datahub/ingestion/source/looker/looker_common.py", line 929, in get_explore
    looker_explore = LookerExplore.from_api(
  File "/usr/local/lib/python3.9/site-packages/datahub/ingestion/source/looker/looker_common.py", line 629, in from_api
    from datahub.ingestion.source.looker.lookml_source import _BASE_PROJECT_NAME
  File "/usr/local/lib/python3.9/site-packages/datahub/ingestion/source/looker/lookml_source.py", line 37, in <module>
    from datahub.ingestion.source.git.git_import import GitClone
  File "/usr/local/lib/python3.9/site-packages/datahub/ingestion/source/git/git_import.py", line 8, in <module>
    import git
  File "/usr/local/lib/python3.9/site-packages/git/__init__.py", line 91, in <module>
    raise ImportError("Failed to initialize: {0}".format(exc)) from exc
It's hard to say for certain since lines don't exactly match when checking out tag 
0.10.0
and I don't see a 
0.10.0.5
tag that I could checkout
it turns out this is just the 
git
python package. Setting this env var 
GIT_PYTHON_REFRESH=quiet
prevents the ingestion from failing
Ignore all of the above, I was replying to a wrong thread 🤦‍♂️
a
Hi @bumpy-activity-74405, so this is resolved?
b
Not really, I still can't figure out how to get all entities without a a domain set
a
You might need to use the GraphQL explorer here, I’m not sure filters can handle null/none as of now. We have an upcoming release that should address this though https://datahubproject.io/docs/how/search/#graphql
4 Views
Open in Slack
PreviousNext
Powered by