brief-toothbrush-55766
03/05/2021, 12:31 PMbig-carpet-38439
03/05/2021, 3:44 PMDataPlatformInfo.json
... Basically just need to make sure the ingested data's "platform" field matches one of the entries in DataPlatformInfo.jsonbig-carpet-38439
03/05/2021, 3:44 PMbrief-toothbrush-55766
03/06/2021, 11:21 AMbrief-toothbrush-55766
03/06/2021, 11:43 AMDataPlatformInfo.json
file, postgres is included. And my recipe looks like this:brief-toothbrush-55766
03/06/2021, 11:46 AMsource:
type: postgres
config:
username: <user>
password: <pw>
host_port: <host:port>
database: <dbname>
sink:
type: "datahub-rest"
config:
server: 'server:port'
brief-toothbrush-55766
03/06/2021, 12:34 PMbrief-toothbrush-55766
03/06/2021, 1:10 PMbrief-toothbrush-55766
03/06/2021, 1:11 PMcurl -H 'X-RestLi-Protocol-Version:2.0.0' -H 'X-RestLi-Method: get' '<http://host>:port/datasets/($params:(),name:gama-pg-db.public.ken_roads,origin:PROD,platform:urn%3Ali%3AdataPlatform%3Apostgresql)' | jq
big-carpet-38439
03/06/2021, 5:29 PMbig-carpet-38439
03/06/2021, 5:29 PMbig-carpet-38439
03/06/2021, 5:30 PMbig-carpet-38439
03/06/2021, 5:30 PMbrief-toothbrush-55766
03/08/2021, 8:52 AMbig-carpet-38439
03/08/2021, 1:02 PMbrief-toothbrush-55766
03/08/2021, 5:38 PMbig-carpet-38439
03/08/2021, 6:04 PMbig-carpet-38439
03/08/2021, 6:04 PMbrief-toothbrush-55766
03/08/2021, 7:17 PM