my recipe is like
source:
type: mssql
config:
...
# ingestiona
able-activity-25706
08/19/2021, 7:58 AMmy recipe is like
source:
type: mssql
config:
host_port: "localhost:16000"
database: demo_db
username: datahub
password: datahub
sink:
type: "datahub-rest"
config:
server: "http://127.0.0.1:18080"
c
clever-ocean-10572
08/19/2021, 1:54 PMI had this issue at one point and it was because I had a $ in the password. To get it to read it literally, I escaped it by using a \in front of it.
💯 1
b
brave-market-65632
09/11/2021, 3:09 PMThanks! just had the same issue 🙂
a
alert-fall-82501
09/02/2022, 10:19 AMhi @clever-ocean-10572 @brave-market-65632 I am having same issue . I tried your suggestion but still facing some issues
alert-fall-82501
09/02/2022, 10:19 AMcan you please help ?
alert-fall-82501
09/02/2022, 10:19 AMbelow is my recipe
alert-fall-82501
09/02/2022, 10:21 AMsource:
type: redshift
config:
# Coordinates
host_port: atlas.ctbsm6jecdy0.us-west-2.redshift.amazonaws.com:5439
database: atlas
database_alias: atlas
# Credentials
username: datahub
password: ${XXXXX_XXXXX}
include_views: True # whether to include views, defaults to True
include_tables: True # whether to include views, defaults to True
schema_pattern:
allow: ['rawdata']
sink:
type: "datahub-rest"
config:
server: "https://datahub-gms.amer-prod.xxxx.com:8080"
b
brave-market-65632
09/03/2022, 7:19 AMHere are few things that helped me overcome this.
1. I let the recipe running for a long time after the timeout. I could see further output about it trying to build dependencies. After some false starts, it eventually did complete.
2. I ran the ingestion twice - first with lineage = False and then re-ran with lineage = True.
3. Maxed out the CPU and memory for my docker settings. Not sure if this helped but the ingestion did complete.
The whole process took about 2-3 hours though.
3 Views