For those who are looking for ingestion from Verti...
# ingestion
t
For those who are looking for ingestion from Vertica - objects like table: install alchemy plugin:
Copy code
# python3 -m pip install 'acryl-datahub[sqlalchemy]'
# python3 -m pip install sqlalchemy-vertica-python
Build and ingest Yaml • vertica_ingest.yaml
Copy code
Source:
    type: sqlalchemy
    config:
        platform: vertica
        connect_uri: 'vertica+vertica_<python://datahub_user:password@1.1.1.1:5433/verticadb>'
sink:
    type: datahub-rest
    config:
        server: 'http:// 1.1.1.1:8080'
To ingest via CLI:
Copy code
datahub ingest -c vertica_ingest.yaml
Could the Vertica Dialect for SQL Alchemy could be added to the offical image :)?
thank you 1
h
Hi @thankful-glass-88027, is the only thing missing the
sqlalchemy-vertica-python
package installation? Yes, it can be added to the official image. You can feel free to contribute or open a github issue to request this feature. 🙂
b
Thank you Ogniomistrz, this seems like a great approach. Ofc, it has its downsides: it doesn’t ingest views nor table column comments and doesn’t show up as a Platform in the UI, but is still a great stepping stone
b
@helpful-optician-78938 I have been ingesting metadata from vertica this way for a while now and was aware of the problem of not supporting ingest of views. To fully support Vertica, it is necessary to override
sqlalchemy-vertica-python
and add
get_view_definition
etc. I am trying to get DataHub to support Vertica. Can I create a
vertica.py
etc. like other sql based souces, and create a PR as Beta, albeit incomplete?