Hi guys! What would be the "best practice" go get data from a Postgres db hosted in AWS on a private VPC? I've created a

db in lake formation

, then a crawler to populate it, then plug Datahub into the s3 bucket...is this the best-cost effective way to do it? or would you rather to have an endpoint in an EC2 instance?

Hi @agreeable-thailand-43234. Just to clarify, are you asking about where to host datahub? or assuming datahub and postgres are hosted in different vpc how to ingest metadata about postgres into an already deployed datahub?

atm, i'm still working "locally" with Datahub (ie: using the docker image) so, the question would be what's the best way to ingest data from a DB that is hosted in a private VPC

Hello @agreeable-thailand-43234, may be run the ingestion form a machine which is in same VPC as the DB or a machine with vpn connection to the DB ,