green-lion-58215
06/28/2022, 8:36 PMfrom datahub.ingestion.run.pipeline import Pipeline
pipeline = Pipeline.create(
{
"source": {
"type": "dbt",
"config": {
"manifest_path": "/tmp/manifest.json",
"catalog_path": "/tmp/catalog.json",
"sources_path": "/tmp/sources.json",
"target_platform": "databricks",
"load_schemas": True
},
},
"sink": {
"type": "datahub-rest",
"config": {"server": "http://<masked>:8080"},
},
}
)
green-lion-58215
06/28/2022, 10:03 PMgreen-lion-58215
06/28/2022, 10:04 PM