Hi all, hope you guys all well. I just encountered...
# troubleshoot
h
Hi all, hope you guys all well. I just encountered a trouble while ingesting by sql-profiles be enabled. I quit sure that I have installed the sql-profiles plugin successfully, but when I checked and see if the plugin be installed or not by command "Datahub check plugins", failed to found the plugin name in the plugins list.
Copy code
[root@QgY85nPtI2 ~]# python3 -m datahub check plugins
Sources:
athena
azure-ad
bigquery       (disabled)
bigquery-usage (disabled)
datahub-business-glossary
dbt
druid          (disabled)
feast
file
glue           (disabled)
hive           (disabled)
kafka          (disabled)
kafka-connect
ldap           (disabled)
looker         (disabled)
lookml         (disabled)
mongodb        (disabled)
mssql          (disabled)
mysql
okta           (disabled)
oracle         (disabled)
postgres       (disabled)
redash         (disabled)
redshift       (disabled)
sagemaker      (disabled)
snowflake      (disabled)
snowflake-usage(disabled)
sqlalchemy
superset

Sinks:
console
datahub-kafka  (disabled)
datahub-rest
file

Transformers:
add_dataset_ownership
add_dataset_tags
mark_dataset_status
pattern_add_dataset_ownership
set_dataset_browse_path
simple_add_dataset_ownership
simple_add_dataset_tags
simple_remove_dataset_ownership
And, when I try to ingest data while enable sql-profile option and error encountered and tell me, Table profiles requested but profiler plugin is not enabled. Try running: pip install 'acryl-datahub[sql-profiles]'
Copy code
File "/usr/local/python3/lib/python3.6/site-packages/datahub/entrypoints.py", line 91, in main
    sys.exit(datahub(standalone_mode=False, **kwargs))
File "/usr/local/python3/lib/python3.6/site-packages/click/core.py", line 1137, in __call__
    return self.main(*args, **kwargs)
File "/usr/local/python3/lib/python3.6/site-packages/click/core.py", line 1062, in main
    rv = self.invoke(ctx)
File "/usr/local/python3/lib/python3.6/site-packages/click/core.py", line 1668, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/python3/lib/python3.6/site-packages/click/core.py", line 1668, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/python3/lib/python3.6/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/python3/lib/python3.6/site-packages/click/core.py", line 763, in invoke
    return __callback(*args, **kwargs)
File "/usr/local/python3/lib/python3.6/site-packages/datahub/cli/ingest_cli.py", line 52, in run
    pipeline = Pipeline.create(pipeline_config)
File "/usr/local/python3/lib/python3.6/site-packages/datahub/ingestion/run/pipeline.py", line 103, in create
    return cls(config)
File "/usr/local/python3/lib/python3.6/site-packages/datahub/ingestion/run/pipeline.py", line 72, in __init__
    self.config.source.dict().get("config", {}), self.ctx
File "/usr/local/python3/lib/python3.6/site-packages/datahub/ingestion/source/sql/mysql.py", line 23, in create
    return cls(config, ctx)
File "/usr/local/python3/lib/python3.6/site-packages/datahub/ingestion/source/sql/mysql.py", line 18, in __init__
    super().__init__(config, ctx, "mysql")
File "/usr/local/python3/lib/python3.6/site-packages/datahub/ingestion/source/sql/sql_common.py", line 278, in __init__ "Table profiles requested but profiler plugin is not enabled. "ConfigurationError: Table profiles requested but profiler plugin is not enabled. Try running: pip install 'acryl-datahub[sql-profiles]'
May someone give me a favor? Many thanks in advance..
w
Hi @hundreds-twilight-96303, sql-profiles doesn’t show up even when you install it. This a bug.
However, if you installed sql-profiles correctly as mentioned in the docs, this error shouldn’t be raised.
Can you share your ingestion recipe yml?
Can you rerun
pip install 'acryl-datahub[sql-profiles]'
?