Hi, I also tried to apply a recipe to access a po...
# ingestion
m
Hi, I also tried to apply a recipe to access a postgres database metadata. The PG database has ssl=require option set. I could not find documentation on how to set this option. Without the option set the ingestion process reports: SSL connection is required. Please specify SSL options and retry. What needs to be set in the recipe to make this work?
b
Looking at the source code here you can use this in the
host_port
field:
Copy code
user:password@host:port/dbname[?key=value&key=value...]
where I believe you can specify the ssl options after the dbname. See this
g
@broad-flag-97458 is totally right. Another way to do it would be to specify some config options, since anything set there is passed directly into sqlalchemy and then to the postgres connection driver. For example:
Copy code
source:
  type: postgres
  config:
    # standard config here
    options: # options is same as above
      connect_args:
        sslmode: require
[I haven't tested that locally, but it should work]
m
Thx, it worked by adding the options section.
🎉 1
g
Awesome!
m
I tried to extend the examples with the information provided in the Metadata Ingestion documentation, but had no logon info to do the edit...
p
Thanks @mammoth-bear-12532 trick worked. Append to host_port attribute it didn’t work because there is validation for port (must be int value) but when I appended to database attribute
"database": "dbname*?ssl=true&ssl_verify_cert=false*"
everything started working fine
m
Thanks for the update @prehistoric-yak-75049. @gray-shoe-75895 we need to update docs on ssl configs for the sql sources.