hi team, im trying to connect by bigquery to datah...
# troubleshoot
a
hi team, im trying to connect by bigquery to datahub ( it worked before but now its now ) ... This is the log file im getting with an error, any idea on what I may be doing wrong?
Copy code
File "/tmp/datahub/ingest/venv-bigquery-0.10.2/lib/python3.10/site-packages/datahub/ingestion/run/pipeline.py", line 121, in _add_init_error_context
    raise PipelineInitError(f"Failed to {step}: {e}") from e
datahub.ingestion.run.pipeline.PipelineInitError: Failed to find a registered source for type bigquery: 'str' object is not callable
l
Hey there 👋 I'm The DataHub Community Support bot. I'm here to help make sure the community can best support you with your request. Let's double check a few things first: 1️⃣ There's a lot of good information on our docs site: www.datahubproject.io/docs, Have you searched there for a solution? Yes button 2️⃣ It's not uncommon that someone has run into your exact problem before in the community. Have you searched Slack for similar issues? Yes button
d
Hello, thank you for reporting. we are aware of this issue, and we have fixes coming in the next release. cf. https://datahubspace.slack.com/archives/CUMUWQU66/p1681912575061489
Hey @adorable-river-99503, could you actually try again with version 0.10.2.1? this version should address this issue!
a
I updated the CLI version and then tried to nuke and rerun my datahub instance pointing towards my custom compose file. Got the following errors now: Unable to run quickstart - the following issues were detected: - kafka-setup is not running - elasticsearch-setup is not running - mysql-setup is not running - datahub-upgrade is not running
d
okay, there could be multiple reasons for this. can you retry it after deleting all the local images/volumes/containers?
a
I was able to remove containers and rerun the quick start to get it to work. But I had a docker compose file where i mount my DBT manifest files that I need for ingest and when I try to run that version it gives me the error, maybe its an outdated docker compose file with the newest upgrade?
okay so i resolved it! Redownloaded the latest docker compose file and added my mounted volumes and now im back up and running 🙂 Thanks for the feedback and support!
@delightful-ram-75848 I am able to successfully upgrade my datahub version but still get the same ingest error with bigquery connection!