Hello. Is dynamo db supported?
# ingestions
stocky-television-65849
12/10/2021, 8:17 PMHello. Is dynamo db supported?
i
incalculable-ocean-74010
12/10/2021, 8:34 PMHi Jainice!
I don't think dynamo is explicitly supported but it should be simple enough to add support for it. DataHub already supports no-sql DBs like MongoDB.
You can check the list of supported sources here: https://datahubproject.io/docs/
incalculable-ocean-74010
12/10/2021, 8:35 PMThe ingestion framework that reads from multiple sources is implemented in python and uses SQLAlchemy. It is possible to query the DynamoDB using the library: https://www.cdata.com/kb/tech/dynamodb-python-sqlalchemy.rst
If we have the connector it should just a matter of adding an extra source.
incalculable-ocean-74010
12/10/2021, 8:36 PMHere is the PR that supported Mongo: https://github.com/linkedin/datahub/pull/2289
s
stocky-television-65849
12/10/2021, 8:40 PMthanks!!!
6 Views