Hi all, I’m trying to ingest the ldap users from l...
# ingestion
k
Hi all, I’m trying to ingest the ldap users from ldap server for which I’m trying below recipe:
Copy code
source:
  type: "ldap"
  config:
    ldap_server: <server>
    ldap_user: "cn=<user_name>,dc=example,dc=org"
    ldap_password: "<password>"
    base_dn: "dc=example,dc=org"
but on running this recipe on ui i’m getting below errors
Copy code
ERROR    {datahub.ingestion.run.pipeline:127} - LDAP connection failed\n'

"AttributeError: 'Pipeline' object has no attribute 'source'\n"
           "[2022-09-22 07:19:56,128] ERROR    {datahub.entrypoints:188} - Command failed with 'Pipeline' object has no attribute 'source'
if someone can suggest the reason?
h
LDAP connection failed
is main error that needs to be solved here. Can you check logs if it says why LDAP connection failed
m
This has happened to me while trying to ingest from other sources. The main problem is that the pipeline tag is added automatically at the end and it is having some trouble as there might be some strange spaces or something like that. I think that erasing the pipeline lines and making your recipe last line the last would solve it
This would be your recipe:
Copy code
sink:
    type: datahub-rest
    config:
        server: '<http://datahub-gms:8080>'
source:
    type: <type>
    config:
        database: null
        host_port: '<host>:<port>'
pipeline_name: 'urn:li:dataHubIngestionSource:1b9301bb-bf64-48b9-ad19-958157c538b5'
This would be the resultant recipe:
Copy code
sink:
    type: datahub-rest
    config:
        server: '<http://datahub-gms:8080>'
source:
    type: <type>
    config:
        database: null
        host_port: '<host>:<port>'
k
but it gets added automatically. I tried to run it without that.
m
It does, but I think the problem mught might be some invisible characters or something like that at the end of your recipe. So maybe they were added if you copy and pasted the recipe. That was usually my problem when it appeared to me
k
@microscopic-mechanic-13766 I tried it after removing that. Didn’t work.
m
I know this might a bit silly but could you try to erase the ingestion source and start it over from scratch? Since there is real problem with your recipe, I think the problem might be related to the creation of the source, its recipe or some sort.
k
I did that too.
h
Can you try ingesting using Datahub CLI, if it works.
As I mentioned earlier - the error seems to be about connectivity, and debugging would be easier if we use Datahub CLI with --debug enabled..
k
Thanks Mayuri I’ll try this also.