Hi Datahub support Team. I am using below yaml for...
# all-things-deployment
c
Hi Datahub support Team. I am using below yaml for source and sink for data ingestion but i am having issue as failed.
Copy code
source:
    type: starburst-trino-usage
    config:
        host_port: '<http://datamesh.conest.com:443|datamesh.conest.com:443>'
        database: tpch
        username: ds-starburst
        include_views: true
        include_tables: true
        profiling:
            enabled: true
            profile_table_level_only: true
        stateful_ingestion:
            enabled: true
        password: '${starburst-trino-cred}'
sink:
    type: datahub-rest
    config:
        server: 'datahub-datahub-gms:8080'
I am receiving this error datahub.ingestion.run.pipeline.PipelineInitError: Failed to set up framework context: Failed to instantiate a valid DataHub Graph instance One more thing is that i have a gms running with ALB endpoint so what should be the gms value in sink ? it should be like above one or "http://datahub-datahub-gms.svc.cluster.local:8080" or datahub-datahub-gms LoadBalancer 10.100.85.45 a6af33dc651074b21-608523110.eu-west-1.elb.amazonaws.com 808030858/TCP,431830170/TCP 37h
a
Hi, you may need to increase allocation to the containers