Hi, Is there a way to use NiFi as a source with a ...
# ingestion
p
Hi, Is there a way to use NiFi as a source with a self signed cert? I have a NiFi instance I want to pull from. Right now in dev, it's in just the default configuration with self signed cert and single user sign on. When I try to connect DataHub to it, the connection fails with:
Copy code
"retries exceeded with url: /nifi-api/access/token (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] "
Any help resolving this without having to re-configure NiFi certs would be appreciated.
h
Hey @steep-bear-46368 you can use
ca_file
source config mention in nifi source to specify path to trusted certificates - i.e. cert file of server. The source will then use this to verify SSL .
p
Great. Thank you. I also went in and added a config flag to the nifi plugin for DataHub so I could turn verify ssl on/off as needed. Would that be useful to put into main plugin?
h
Yes it would be useful. From security standpoint though, I believe its better to provide server ca_file than disabling verification altogether.
c
@polite-art-12182 Would you like to share the solution to turn verify ssl off? I met the same problem, even rebuilt one new docker image of datahub-action with the certification chains of target website and it was ok to verify certification in curl.
@hundreds-photographer-13496 Is _*ca_file*_ located in datahub-action? Thanks.
@polite-art-12182 @hundreds-photographer-13496 My nifi ingestion succeed when option _*ca_file*_ is configured with value '_*/etc/ssl/certs/ca-certificates.crt*_' which contains the certification chain.
p
@clean-magician-86038 Just seeing this. I went into the plugin and set: self.session.verify = False. That disables the ssh verification.
Also on the post I set verify=False