❓*Question of the Week: What is/are the main hurdle(s) you face when contributing to the OSS DataHub project? How could the Core DataHub team help to make it easier to contribute?* @echoing-airport-49548 can’t wait to hear your thoughts — share your thoughts in the thread 🧵! We’ll choose a random swag winner next Monday 😎

For me, the biggest challenge has been finding core DataHub members who know about a certain concept that I need to develop or propose an improvement. Perhaps a good solution for this is a restructuring of the contribution documentation adding not only a set of prerequisite knowledge needed to contribute (links to other documents or useful references) but also the assignment of core members as responsible for the contribution within that scope. (as is done with entity owners on the DataHub).

I can only speak for the metadata-ingestion sub-project, but when I contributed the Iceberg source, I found that: • I had to do a lot of copy-paste from other ingestion sources code (this could be easily avoided by providing more utilities and abstract base classes). I also found there was different ways different sources would achieve the same thing, which made it hard to figure how my Iceberg source should do it. I guess it comes down to the lack of consistency across the ingestion sources by not having a mature enough ingestion framework? • ~60% of my problems came from the

schema_util.py

module and using AVRO as translator to Datahub schema. I think having access to a builder pattern to create a Datahub schema would make the AVRO translator obsolete and make this whole process much easier.

For me, the biggest challenge has been finding core DataHub members who know about a certain concept that I need to develop or propose an improvement.

This is amazing feedback, @gentle-camera-33498! Is it more of an issue of getting your contribution moved through the review process & not knowing who to work with, or is it more of an issue of finding the right person to think through design/implementation during development?

This is amazing feedback, @gentle-camera-33498! Is it more of an issue of getting your contribution moved through the review process & not knowing who to work with, or is it more of an issue of finding the right person to think through design/implementation during development?

@little-megabyte-1074 It's more about having the possibility to align with the right person to discuss design/implementation and clarify doubts (know who to work with).

As promised, we have swagggg!!! @gentle-camera-33498 you’re our lucky winner whoop I’ll DM ya!