Is there a way to specify multiple configs in a si...
# ingestion
m
Is there a way to specify multiple configs in a single ingestion file. Eg. I have this ingestion file for mysql currently with localhost as my host port. Can I specify another config with a different ingestion hostport, database etc in the same file ?
Copy code
---
# see <https://datahubproject.io/docs/metadata-ingestion/source_docs/mysql> for complete documentation
source:
  type: "mysql"
  config:
    host_port: localhost:3306
    database: world_x
    username: datahub
    password: datahub
    include_tables: True
    include_views: True
    schema_pattern:
      allow:
        - "^world_x"

# see <https://datahubproject.io/docs/metadata-ingestion/sink_docs/datahub> for complete documentation
sink:
  type: "datahub-rest"
  config:
    server: "<http://localhost:8080>"
Above is existing config. Would like to have another hsotport, datbase specified in the same file
@gray-shoe-75895 @miniature-tiger-96062 @helpful-optician-78938?
h
@many-pilot-7340, We don't support it currently. You need to create another yml recipe for for a different host_port.
m
Thanks @helpful-optician-78938
@miniature-tiger-96062 Can you pls point to the script to delete lineage you mentioned ? since there is no REST Api for it
m
@many-pilot-7340: what lineage are you trying to delete?
In terms of recipes for ingesting from two different host:port combos, it is better to have separate recipes for separate sources. We don't plan to have combined recipes for multiple sources as that can lead to unnecessary coupling.
m
Thanks @mammoth-bear-12532 Is it possible to have multiple databases at the same host:port combo ?
Copy code
config:
    host_port: localhost:3306
    database: world_x
Also, lineage that was created through Airflow in Datahub for Mysql dataset, is there any way to delete it, after a DAG has run ?