Small question: have a setup of datahub (self-host...
# all-things-deploymentf
faint-school-61982
06/07/2023, 3:27 PMSmall question: have a setup of datahub (self-hosted in cloud) up and running, but would like to ingest on-prem SQL server metadata. Of course, we could open up these connections but security-wise, we'd rather not have to resort to this, so we figured these are our options:
✅ 1
faint-school-61982
06/07/2023, 3:30 PM1. use the cli and schedule this job. Con: each on-prem team needs to manage this
2. use an agent. I saw someone mention this but haven't read anything about it. Please give me some hints as to where info is on this. Agent would phone home (outbound, so no firewall issues) and would wait for instructions basically
3. We currently also have an canonical meta data model so we can also add metadata from our sql servers as csv files on a data lake, which are then picked up and pushed to datahubproject.
d
delightful-ram-75848
06/08/2023, 12:16 AMI think for self-hosted datahub the possible options would be 1,3 - 2 is only available for managed datahub (saas) .
f
faint-school-61982
06/26/2023, 9:37 AMThank you for clarifying that the agent option is only with SaaS. We've implemented option 3 for now.