Hi all, I’m trying to enable data profiling for th...
# ingestion
g
Hi all, I’m trying to enable data profiling for the Google Big Query Table but getting the following error, below mentioned is the recipe. does anyone has any idea about it ?
Copy code
source:
    type: bigquery
    config:
        credential:
            private_key_id: '${private_key_id}'
            project_id: '${project_id}'
            client_email: '${Client_email}'
            private_key: '${private_key}'
            client_id: '${client_id}'
        profiling:
            enabled: true
        project_id: '${project_id}'
        table_pattern:
            allow:
                - daas-prod-251711.cdo.online_merchant
        profile_pattern:
            allow:
                - daas-prod-251711.cdo.online_merchant
pipeline_name: 'urn:li:dataHubIngestionSource:60e4b0c9-dc16-4138-8fa7-d0c881af095a'
@hundreds-photographer-13496 do you have any idea about it ?
h
Hey what version are you using ?
also are there more logs below this line ? It would be helpful if you can share entire stack trace
g
Hi @hundreds-photographer-13496 the CLI version is 0.8.42 and Please find above the complete stack trace
h
this could be problem with improper escaping, as schema name starts with number - 123. Would it be possible for you to ingest using bigquery-beta source with latest CLI version 0.8.45 and see if the problem appears there as well.
g
Thanks @hundreds-photographer-13496 for the help, I’ll try it once and let you know