A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hey folks! Is there a specific version of Python we should use when building datahub locally i.e. `./gradlew build`?

Hi <@U04FEQXAUNT>, we use python3 in this doc <https://datahubproject.io/docs/developers>

To the best of my knowledge, the most recent stable release should work. Is there an older version you are looking to use?

I have been trying to build datahub on my Mac but it consistently fails as shown here <https://datahubspace.slack.com/archives/CV2KB471C/p1674054473068889?thread_ts=1661384731.692819&amp;cid=CV2KB471C>

Hey Eric! M1 Mac user here. I’m using Python 3.11 and it works well. Perhaps you can try that instead?

Hi <@U04FEQXAUNT>, were you able to get this built?

Is this still the same ongoing header issue? And upgrade to 3.11 didn’t resolve?

It seems like python-ldap lib can’t be build on your machine.
Can you try to follow the steps to build on the python ldap library page? -&gt; <https://www.python-ldap.org/en/python-ldap-3.3.0/installing.html#macos>

<@UV14447EU> that unblocked me but I ran into another issue. I now get this error:
```ERROR: No matching distribution found for sqlalchemy-bigquery&gt;=1.4.1; extra == "dev"```

<@UV14447EU> your suggestion here <https://datahubspace.slack.com/archives/C029A3M079U/p1674672308737919?thread_ts=1674152430.384559&amp;cid=C029A3M079U>

ahh, cool, do you have access to <http://pypi.org|pypi.org>?
<https://pypi.org/project/sqlalchemy-bigquery/#history> -&gt; should be available

<@UV14447EU> do you know why I keep getting this error
```   ERROR: Failed building wheel for pyarrow
      Failed to build pyarrow
      ERROR: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects```
It forces me to do a clean build each time. Also the :metadata-io:test task fails unless I run it on its own. Any suggestion on how to get the gradlew build command run from start to finish?

<@U04FEQXAUNT> which version of python are you using?

I think that is the problem as pyarrow just built wheel for 3.11 quite recently

<https://github.com/apache/arrow/pull/14499>

and the corresponding stackoverflow issue -&gt; <https://stackoverflow.com/questions/74254073/installation-error-streamlit-building-wheel-for-pyarrow-pyproject-toml-er>

Which version of Python do you recommend I use?

I will give that a try. Thanks for your help