Hi Team, I have enabled column level profiling for bigquery, but not getting any for string fields, any suggestions : Error log : Failed to get unique count for column project_nameFBT.FBT_Diff.Anchor_Item Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/google/cloud/bigquery/dbapi/cursor.py", line 203, in _execute self._query_job.result() File "/usr/local/lib/python3.7/site-packages/google/cloud/bigquery/job/query.py", line 1499, in result do_get_result() File "/usr/local/lib/python3.7/site-packages/google/api_core/retry.py", line 354, in retry_wrapped_func on_error=on_error, File "/usr/local/lib/python3.7/site-packages/google/api_core/retry.py", line 191, in retry_target return target() File "/usr/local/lib/python3.7/site-packages/google/cloud/bigquery/job/query.py", line 1489, in do_get_result super(QueryJob, self).result(retry=retry, timeout=timeout) File "/usr/local/lib/python3.7/site-packages/google/cloud/bigquery/job/base.py", line 728, in result return super(_AsyncJob, self).result(timeout=timeout, **kwargs) File "/usr/local/lib/python3.7/site-packages/google/api_core/future/polling.py", line 261, in result raise self._exception google.api_core.exceptions.BadRequest: 400 Unrecognized name: `"Anchor_Item"`; Did you mean Anchor_Item? at [1:30] Location: US Job ID: ad9f0d21-f927-4974-a896-8d54b0f8a655 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1901, in _execute_context cursor, statement, parameters, context File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute cursor.execute(statement, parameters) File "/usr/local/lib/python3.7/site-packages/google/cloud/bigquery/dbapi/_helpers.py", line 494, in with_closed_check return method(self, *args, **kwargs) File "/usr/local/lib/python3.7/site-packages/google/cloud/bigquery/dbapi/cursor.py", line 167, in execute formatted_operation, parameters, job_id, job_config, parameter_types File "/usr/local/lib/python3.7/site-packages/google/cloud/bigquery/dbapi/cursor.py", line 205, in _execute raise exceptions.DatabaseError(exc) google.cloud.bigquery.dbapi.exceptions.DatabaseError: 400 Unrecognized name: `"Anchor_Item"`; Did you mean Anchor_Item? at [1:30] Location: US Job ID: ad9f0d21-f927-4974-a896-8d54b0f8a655 The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/datahub/ingestion/source/ge_data_profiler.py", line 331, in _get_column_cardinality unique_count = self.dataset.get_column_unique_count(column) File "/usr/local/lib/python3.7/site-packages/datahub/ingestion/source/ge_data_profiler.py", line 130, in get_column_unique_count_patch ).select_from(self._table) File "/usr/local/lib/python3.7/site-packages/datahub/utilities/sqlalchemy_query_combiner.py", line 272, in _sa_execute_fake return _sa_execute_underlying_method(conn, query, *args, **kwargs) File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1380, in execute return meth(self, multiparams, params, _EMPTY_EXECUTION_OPTS) File "/usr/local/lib/python3.7/site-packages/sqlalchemy/sql/elements.py", line 335, in _execute_on_connection self, multiparams, params, execution_options File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1582, in _execute_clauseelement cache_hit=cache_hit, File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1944, in _execute_context e, statement, parameters, cursor, context File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 2125, in _handle_dbapi_exception sqlalchemy_exception, with_traceback=exc_info[2], from_=e File "/usr/local/lib/python3.7/site-packages/sqlalchemy/util/compat.py", line 211, in raise_ raise exception File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1901, in _execute_context cursor, statement, parameters, context File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/default.py", line 736, in do_execute cursor.execute(statement, parameters) File "/usr/local/lib/python3.7/site-packages/google/cloud/bigquery/dbapi/_helpers.py", line 494, in with_closed_check return method(self, *args, **kwargs) File "/usr/local/lib/python3.7/site-packages/google/cloud/bigquery/dbapi/cursor.py", line 167, in execute formatted_operation, parameters, job_id, job_config, parameter_types File "/usr/local/lib/python3.7/site-packages/google/cloud/bigquery/dbapi/cursor.py", line 205, in _execute raise exceptions.DatabaseError(exc) sqlalchemy.exc.DatabaseError: (google.cloud.bigquery.dbapi.exceptions.DatabaseError) 400 Unrecognized name: `"Anchor_Item"`; Did you mean Anchor_Item? at [1:30] Location: US Job ID: ad9f0d21-f927-4974-a896-8d54b0f8a655 [SQL: SELECT APPROX_COUNT_DISTINCT(

"Anchor_Item"

) FROM

project_name-thd

.

FBT.FBT_Diff

] (Background on this error at: https://sqlalche.me/e/14/4xp6)

Hi @quaint-barista-82836, what BigQuery roles/permissions do you have configured?

Hi @astonishing-answer-96712, Below permissions are present

Hi @quaint-barista-82836 I recall this being solved recently - which version of DataHub CLI are you using? I will find the PRs where I think we solved...

Here, I think this is an issue with our recent release where we quote automatically the column names, but it seems like, in this case, the column name is already quoted. I need to check what is going on.

@big-carpet-38439 am using DataHub v0.9.6.1

I am getting this error as well, and we don't have double-quoted names. I am also on acryl-datahub v0.10.0 @big-carpet-38439 Are you still aware of this issue?

@great-flag-53653 please, can you test with the latest release? -> https://pypi.org/project/acryl-datahub/0.10.0.3/