Hi, I am planning on making a custom connection to enable HDFS ingestion. Could someone walk me through on what would be needed to be created? Just a file like the ones that can be found under the path

/datahub/metadata-ingestion/src/datahub/ingestion/source

inside the project?

I think this is the closest what you need -> https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/s3/source.py

Thanks Tamas, I will try to do a PR when it is ready! (although I don't promise much 😅)

nw, let me know if you need any help

in that case, should I write personally to you? Or in the ingestion channel?

if you write to the ingestion channel there, more people can see and learn

sounds good to me!