Hi everyone, we are ingesting from two different `...
# ingestion
m
Hi everyone, we are ingesting from two different
postgres
data sources but with same db and table name, so naturally we want to use
platform_instance
to customize the URNs... only to find out
postgres
recipe doesn't support
platform_instance
as
MySQL
and
MSSQL
do. Can I ask if there is any special consideration for this?
m
Hi @millions-waiter-49836: just an omission in the docs I think. Have you tried the
postgres
source with
platform_instance
specified?
m
Thanks for the response! I can try it. Or if possible, could you point me to the source code where it mentions
platform_instance
?
m
Yeah I checked the code and since Postgres just sits on top of
sql_common
and the config classes are also inherited, I believe it will just work.
and the code in sql_common that mints urns is e.g. here -> https://github.com/linkedin/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/sql/sql_common.py#L811 (there are a couple other places too)
m
Many thanks Shirshanka! I tested it through to prove
data_platform
works for postgres. I just submitted a PR to modify the doc