A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi! I wrote a test to <https://github.com/linkedin/datahub/blob/master/smoke-test/test_e2e.py|test_e2e.py> and I was wondering if I should <https://docs.pytest.org/en/latest/how-to/usage.html|install pytest >to run the tests or if there's another recommended way? Thank you in advance!

Hey Melinda! I'd work through this metadata-ingestion developing guide:

<https://datahubproject.io/docs/metadata-ingestion/developing/>

and then run the pytest command from inside the virtual environment you create!

Screen Shot 2021-09-13 at 11.32.38 AM.png

hi again :blob-wave: I'm following the doc above and when <https://datahubproject.io/docs/metadata-ingestion/developing/#:~:text=all%20dev%20requirements.-,pip%20install%20-e%20%27.%5Bdev%5D%27,-%23%20For%20running%20integration|trying to install dev requirements> I get an error reading `File "setup.py" or "setup.cfg" not found.`  Do you think this could be because I'm using python 3.9 and not 3.6?

try running those commands from the `metadata-ingestion` directory?

ahh.. yes thats it :hot_face: thank you gabe!

Another question :sweat_smile: so while the test I wrote is passing, 3 other tests that I didn't write are failing. The failing tests are exactly the same as the ones in DH's repo -- should I just leave them as they are?

*nevermind - solved issue! solution below* test_ingestion_via_kafka, test_gms_search_dataset[covid-1], test_frontend_search_datasets[covid-1]

Screen Shot 2021-09-15 at 8.20.41 AM.png

for the first test it recommended running  `pip install 'acryl-datahub[datahub-kafka]'` and I did but all the requirements were already fulfilled. for the other two tests, it seems like it's expecting more than 1 result when querying covid but is getting 0.

omg.. so... I actually fixed the issue. I didn't have the lzma module for python downloaded and that was preventing certain tests from passing apparently :flushed: I used `brew install xz &amp;&amp; pyenv install 3.7.9`