Hey guys, first of all thanks for this nice commun...
# troubleshootd
dazzling-appointment-34954
11/09/2021, 12:58 PMHey guys, first of all thanks for this nice community and the help! This might be a noobie problem, still I hope you can give me some support. We just setup a Datahub instance and I am now trying to install the plugins for Metadata ingestions as described here: https://datahubproject.io/docs/metadata-ingestion
Sadly I receive the error visible within the screenshot, can someone point me to a solution? Thanks!
m
mammoth-bear-12532
11/09/2021, 2:35 PM
@dazzling-appointment-34954: are you on a mac M1 by any chance?
d
dazzling-appointment-34954
11/09/2021, 3:18 PMyes 🙈
m
mammoth-bear-12532
11/09/2021, 3:39 PM
For M1, building the python pieces is a bit tricky currently. @dazzling-judge-80093 has been able to do it. Step 1 is ensuring you have python 3.9.x
thank you 1
d
dazzling-appointment-34954
11/09/2021, 4:13 PMI have Python 3.9.2, so that is working at least 😄 One question regarding this: I thought the plugins are being installed at the server side (which is obviously not running on M1)? We have it running in our own cloud system. Or is this still related to the client that is used for the plugin installation?
m
mammoth-bear-12532
11/09/2021, 4:42 PM
The plugins form the ingestion package which run as standalone ingestion agents (running outside the server)
mammoth-bear-12532
11/09/2021, 4:43 PM
so if you want to run them as a scheduled job for example, you would need to deploy an airflow job that runs them or a docker container that runs the ingestion schedule on a cron
d
dazzling-appointment-34954
11/09/2021, 5:40 PMok got it, so when I install the plugin locally I can ingest data on the server as a one time job? And this is done through Recipes? Sorry for the beginner questions 😕
m
mammoth-bear-12532
11/09/2021, 6:56 PM
correct… the plugin will connect to your datasource and send metadata to the server